Apr 14 01:36:23 user nova-compute[71498]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Apr 14 01:36:26 user nova-compute[71498]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=71498) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=71498) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=71498) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 14 01:36:26 user nova-compute[71498]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:36:26 user nova-compute[71498]: INFO nova.virt.driver [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] Loading compute driver 'libvirt.LibvirtDriver'
Apr 14 01:36:26 user nova-compute[71498]: INFO nova.compute.provider_config [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] Acquiring lock "singleton_lock" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] Acquired lock "singleton_lock" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] Releasing lock "singleton_lock" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] Full set of CONF: {{(pid=71498) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] ******************************************************************************** {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] Configuration options gathered from: {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] ================================================================================ {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] allow_resize_to_same_host      = True {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] arq_binding_timeout            = 300 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] backdoor_port                  = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] backdoor_socket                = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] block_device_allocate_retries  = 300 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] block_device_allocate_retries_interval = 5 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cert                           = self.pem {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] compute_monitors               = [] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] config_dir                     = [] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] config_drive_format            = iso9660 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] config_source                  = [] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] console_host                   = user {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] control_exchange               = nova {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cpu_allocation_ratio           = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] daemon                         = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] debug                          = True {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] default_access_ip_network_name = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] default_availability_zone      = nova {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] default_ephemeral_format       = ext4 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] default_schedule_zone          = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] disk_allocation_ratio          = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] enable_new_services            = True {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] enabled_apis                   = ['osapi_compute'] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] enabled_ssl_apis               = [] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] flat_injected                  = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] force_config_drive             = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] force_raw_images               = True {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] graceful_shutdown_timeout      = 5 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] heal_instance_info_cache_interval = 60 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] host                           = user {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] instance_build_timeout         = 0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] instance_delete_interval       = 300 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] instance_format                = [instance: %(uuid)s]  {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] instance_name_template         = instance-%08x {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] instance_usage_audit           = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] instance_usage_audit_period    = month {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] internal_service_availability_zone = internal {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] key                            = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] live_migration_retry_count     = 30 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] log_config_append              = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] log_dir                        = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] log_file                       = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] log_options                    = True {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] log_rotate_interval            = 1 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] log_rotate_interval_type       = days {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] log_rotation_type              = none {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] long_rpc_timeout               = 1800 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] max_concurrent_builds          = 10 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] max_concurrent_live_migrations = 1 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] max_concurrent_snapshots       = 5 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] max_local_block_devices        = 3 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] max_logfile_count              = 30 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] max_logfile_size_mb            = 200 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] maximum_instance_delete_attempts = 5 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] metadata_listen                = 0.0.0.0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] metadata_listen_port           = 8775 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] metadata_workers               = 3 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] migrate_max_retries            = -1 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] mkisofs_cmd                    = genisoimage {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] my_ip                          = 10.0.0.210 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] network_allocate_retries       = 0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] osapi_compute_listen_port      = 8774 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] osapi_compute_unique_server_name_scope =  {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] osapi_compute_workers          = 3 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] password_length                = 12 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] periodic_enable                = True {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] periodic_fuzzy_delay           = 60 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] pointer_model                  = ps2mouse {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] preallocate_images             = none {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] publish_errors                 = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] pybasedir                      = /opt/stack/nova {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] ram_allocation_ratio           = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] rate_limit_burst               = 0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] rate_limit_except_level        = CRITICAL {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] rate_limit_interval            = 0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] reboot_timeout                 = 0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] reclaim_instance_interval      = 0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] record                         = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] reimage_timeout_per_gb         = 20 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] report_interval                = 10 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] rescue_timeout                 = 0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] reserved_host_cpus             = 0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] reserved_host_disk_mb          = 0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] reserved_host_memory_mb        = 512 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] reserved_huge_pages            = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] resize_confirm_window          = 0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] resize_fs_using_block_device   = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] resume_guests_state_on_host_boot = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] rpc_response_timeout           = 60 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] run_external_periodic_tasks    = True {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] running_deleted_instance_action = reap {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] running_deleted_instance_poll_interval = 1800 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] running_deleted_instance_timeout = 0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] scheduler_instance_sync_interval = 120 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] service_down_time              = 60 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] servicegroup_driver            = db {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] shelved_offload_time           = 0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] shelved_poll_interval          = 3600 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] shutdown_timeout               = 0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] source_is_ipv6                 = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] ssl_only                       = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] state_path                     = /opt/stack/data/nova {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] sync_power_state_interval      = 600 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] sync_power_state_pool_size     = 1000 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] syslog_log_facility            = LOG_USER {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] tempdir                        = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] timeout_nbd                    = 10 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] transport_url                  = **** {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] update_resources_interval      = 0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] use_cow_images                 = True {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] use_eventlog                   = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] use_journal                    = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] use_json                       = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] use_rootwrap_daemon            = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] use_stderr                     = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] use_syslog                     = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vcpu_pin_set                   = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vif_plugging_is_fatal          = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vif_plugging_timeout           = 0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] virt_mkfs                      = [] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] volume_usage_poll_interval     = 0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] watch_log_file                 = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] web                            = /usr/share/spice-html5 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_concurrency.disable_process_locking = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api.auth_strategy              = keystone {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api.compute_link_prefix        = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api.dhcp_domain                = novalocal {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api.enable_instance_password   = True {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api.glance_link_prefix         = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api.instance_list_per_project_cells = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api.list_records_by_skipping_down_cells = True {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api.local_metadata_per_cell    = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api.max_limit                  = 1000 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api.metadata_cache_expiration  = 15 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api.neutron_default_tenant_id  = default {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api.use_forwarded_for          = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api.use_neutron_default_nets   = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api.vendordata_dynamic_targets = [] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api.vendordata_jsonfile_path   = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cache.backend                  = dogpile.cache.memcached {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cache.backend_argument         = **** {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cache.config_prefix            = cache.oslo {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cache.dead_timeout             = 60.0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cache.debug_cache_backend      = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cache.enable_retry_client      = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cache.enable_socket_keepalive  = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cache.enabled                  = True {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cache.expiration_time          = 600 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cache.hashclient_retry_attempts = 2 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cache.memcache_dead_retry      = 300 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cache.memcache_password        =  {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cache.memcache_pool_maxsize    = 10 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cache.memcache_sasl_enabled    = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cache.memcache_username        =  {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cache.proxies                  = [] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cache.retry_attempts           = 2 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cache.retry_delay              = 0.0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cache.socket_keepalive_count   = 1 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cache.socket_keepalive_idle    = 1 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cache.socket_keepalive_interval = 1 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cache.tls_allowed_ciphers      = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cache.tls_cafile               = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cache.tls_certfile             = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cache.tls_enabled              = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cache.tls_keyfile              = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cinder.auth_section            = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cinder.auth_type               = password {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cinder.cafile                  = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cinder.certfile                = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cinder.collect_timing          = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cinder.cross_az_attach         = True {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cinder.debug                   = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cinder.endpoint_template       = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cinder.http_retries            = 3 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cinder.insecure                = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cinder.keyfile                 = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cinder.os_region_name          = RegionOne {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cinder.split_loggers           = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cinder.timeout                 = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] compute.cpu_dedicated_set      = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] compute.cpu_shared_set         = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] compute.image_type_exclude_list = [] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] compute.max_concurrent_disk_ops = 0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] compute.max_disk_devices_to_attach = -1 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] compute.resource_provider_association_refresh = 300 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] compute.shutdown_retry_interval = 10 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] conductor.workers              = 3 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] console.allowed_origins        = [] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] console.ssl_ciphers            = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] console.ssl_minimum_version    = default {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] consoleauth.token_ttl          = 600 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cyborg.cafile                  = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cyborg.certfile                = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cyborg.collect_timing          = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cyborg.connect_retries         = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cyborg.connect_retry_delay     = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cyborg.endpoint_override       = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cyborg.insecure                = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cyborg.keyfile                 = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cyborg.max_version             = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cyborg.min_version             = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cyborg.region_name             = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cyborg.service_name            = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cyborg.service_type            = accelerator {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cyborg.split_loggers           = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cyborg.status_code_retries     = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cyborg.status_code_retry_delay = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cyborg.timeout                 = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] cyborg.version                 = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] database.backend               = sqlalchemy {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] database.connection            = **** {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] database.connection_debug      = 0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] database.connection_parameters =  {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] database.connection_recycle_time = 3600 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] database.connection_trace      = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] database.db_inc_retry_interval = True {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] database.db_max_retries        = 20 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] database.db_max_retry_interval = 10 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] database.db_retry_interval     = 1 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] database.max_overflow          = 50 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] database.max_pool_size         = 5 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] database.max_retries           = 10 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] database.mysql_enable_ndb      = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] database.mysql_wsrep_sync_wait = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] database.pool_timeout          = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] database.retry_interval        = 10 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] database.slave_connection      = **** {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] database.sqlite_synchronous    = True {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api_database.backend           = sqlalchemy {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api_database.connection        = **** {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api_database.connection_debug  = 0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api_database.connection_parameters =  {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api_database.connection_recycle_time = 3600 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api_database.connection_trace  = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api_database.db_inc_retry_interval = True {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api_database.db_max_retries    = 20 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api_database.db_max_retry_interval = 10 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api_database.db_retry_interval = 1 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api_database.max_overflow      = 50 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api_database.max_pool_size     = 5 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api_database.max_retries       = 10 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api_database.mysql_enable_ndb  = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api_database.pool_timeout      = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api_database.retry_interval    = 10 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api_database.slave_connection  = **** {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] api_database.sqlite_synchronous = True {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] devices.enabled_mdev_types     = [] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] ephemeral_storage_encryption.enabled = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] glance.api_servers             = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] glance.cafile                  = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] glance.certfile                = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] glance.collect_timing          = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] glance.connect_retries         = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] glance.connect_retry_delay     = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] glance.debug                   = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] glance.default_trusted_certificate_ids = [] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] glance.enable_certificate_validation = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] glance.enable_rbd_download     = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] glance.endpoint_override       = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] glance.insecure                = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] glance.keyfile                 = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] glance.max_version             = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] glance.min_version             = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] glance.num_retries             = 3 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] glance.rbd_ceph_conf           =  {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] glance.rbd_connect_timeout     = 5 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] glance.rbd_pool                =  {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] glance.rbd_user                =  {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] glance.region_name             = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] glance.service_name            = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] glance.service_type            = image {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] glance.split_loggers           = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] glance.status_code_retries     = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] glance.status_code_retry_delay = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] glance.timeout                 = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] glance.verify_glance_signatures = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] glance.version                 = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] guestfs.debug                  = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] hyperv.config_drive_cdrom      = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] hyperv.config_drive_inject_password = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] hyperv.enable_instance_metrics_collection = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] hyperv.enable_remotefx         = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] hyperv.instances_path_share    =  {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] hyperv.iscsi_initiator_list    = [] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] hyperv.limit_cpu_features      = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] hyperv.power_state_check_timeframe = 60 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] hyperv.use_multipath_io        = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] hyperv.volume_attach_retry_count = 10 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] hyperv.vswitch_name            = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] mks.enabled                    = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] image_cache.manager_interval   = 2400 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] image_cache.precache_concurrency = 1 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] image_cache.remove_unused_base_images = True {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] image_cache.subdirectory_name  = _base {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] ironic.api_max_retries         = 60 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] ironic.api_retry_interval      = 2 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] ironic.auth_section            = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] ironic.auth_type               = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] ironic.cafile                  = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] ironic.certfile                = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] ironic.collect_timing          = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] ironic.connect_retries         = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] ironic.connect_retry_delay     = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] ironic.endpoint_override       = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] ironic.insecure                = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] ironic.keyfile                 = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] ironic.max_version             = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] ironic.min_version             = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] ironic.partition_key           = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] ironic.peer_list               = [] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] ironic.region_name             = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] ironic.serial_console_state_timeout = 10 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] ironic.service_name            = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] ironic.service_type            = baremetal {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] ironic.split_loggers           = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] ironic.status_code_retries     = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] ironic.status_code_retry_delay = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] ironic.timeout                 = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] ironic.version                 = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] key_manager.fixed_key          = **** {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] barbican.barbican_api_version  = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] barbican.barbican_endpoint     = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] barbican.barbican_endpoint_type = public {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] barbican.barbican_region_name  = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] barbican.cafile                = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] barbican.certfile              = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] barbican.collect_timing        = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] barbican.insecure              = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] barbican.keyfile               = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] barbican.number_of_retries     = 60 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] barbican.retry_delay           = 1 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] barbican.send_service_user_token = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] barbican.split_loggers         = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] barbican.timeout               = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] barbican.verify_ssl            = True {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] barbican.verify_ssl_path       = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] barbican_service_user.auth_section = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] barbican_service_user.auth_type = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] barbican_service_user.cafile   = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] barbican_service_user.certfile = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] barbican_service_user.collect_timing = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] barbican_service_user.insecure = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] barbican_service_user.keyfile  = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] barbican_service_user.split_loggers = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] barbican_service_user.timeout  = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vault.approle_role_id          = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vault.approle_secret_id        = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vault.cafile                   = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vault.certfile                 = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vault.collect_timing           = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vault.insecure                 = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vault.keyfile                  = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vault.kv_mountpoint            = secret {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vault.kv_version               = 2 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vault.namespace                = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vault.root_token_id            = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vault.split_loggers            = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vault.ssl_ca_crt_file          = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vault.timeout                  = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vault.use_ssl                  = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] keystone.cafile                = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] keystone.certfile              = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] keystone.collect_timing        = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] keystone.connect_retries       = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] keystone.connect_retry_delay   = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] keystone.endpoint_override     = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] keystone.insecure              = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] keystone.keyfile               = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] keystone.max_version           = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] keystone.min_version           = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] keystone.region_name           = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] keystone.service_name          = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] keystone.service_type          = identity {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] keystone.split_loggers         = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] keystone.status_code_retries   = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] keystone.status_code_retry_delay = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] keystone.timeout               = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] keystone.version               = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.connection_uri         =  {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.cpu_mode               = custom {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: WARNING oslo_config.cfg [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.cpu_power_governor_high = performance {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.cpu_power_governor_low = powersave {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.cpu_power_management   = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.device_detach_attempts = 8 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.device_detach_timeout  = 20 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.disk_cachemodes        = [] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.disk_prefix            = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.enabled_perf_events    = [] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.file_backed_memory     = 0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.gid_maps               = [] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.hw_disk_discard        = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.hw_machine_type        = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.images_rbd_glance_store_name =  {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.images_rbd_pool        = rbd {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.images_type            = default {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.images_volume_group    = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.inject_key             = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.inject_partition       = -2 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.inject_password        = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.iscsi_iface            = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.iser_use_multipath     = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.live_migration_bandwidth = 0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.live_migration_downtime = 500 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.live_migration_inbound_addr = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.live_migration_permit_post_copy = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.live_migration_scheme  = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.live_migration_timeout_action = abort {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.live_migration_tunnelled = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: WARNING oslo_config.cfg [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Apr 14 01:36:26 user nova-compute[71498]: live_migration_uri is deprecated for removal in favor of two other options that
Apr 14 01:36:26 user nova-compute[71498]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Apr 14 01:36:26 user nova-compute[71498]: and ``live_migration_inbound_addr`` respectively.
Apr 14 01:36:26 user nova-compute[71498]: ).  Its value may be silently ignored in the future.
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.live_migration_with_native_tls = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.max_queues             = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.nfs_mount_options      = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.num_memory_encrypted_guests = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.num_pcie_ports         = 0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.pmem_namespaces        = [] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.quobyte_client_cfg     = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.rbd_secret_uuid        = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.rbd_user               = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.remote_filesystem_transport = ssh {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.rescue_image_id        = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.rescue_kernel_id       = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.rescue_ramdisk_id      = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.rx_queue_size          = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.smbfs_mount_options    =  {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.snapshot_compression   = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.snapshot_image_format  = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.sparse_logical_volumes = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.swtpm_enabled          = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.swtpm_group            = tss {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.swtpm_user             = tss {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.sysinfo_serial         = unique {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.tx_queue_size          = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.uid_maps               = [] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.use_virtio_for_bridges = True {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.virt_type              = kvm {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.volume_clear           = zero {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.volume_clear_size      = 0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.volume_use_multipath   = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.vzstorage_cache_path   = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.vzstorage_mount_user   = stack {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] neutron.auth_section           = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] neutron.auth_type              = password {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] neutron.cafile                 = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] neutron.certfile               = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] neutron.collect_timing         = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] neutron.connect_retries        = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] neutron.connect_retry_delay    = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] neutron.default_floating_pool  = public {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] neutron.endpoint_override      = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] neutron.extension_sync_interval = 600 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] neutron.http_retries           = 3 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] neutron.insecure               = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] neutron.keyfile                = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] neutron.max_version            = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] neutron.min_version            = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] neutron.ovs_bridge             = br-int {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] neutron.physnets               = [] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] neutron.region_name            = RegionOne {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] neutron.service_metadata_proxy = True {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] neutron.service_name           = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] neutron.service_type           = network {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] neutron.split_loggers          = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] neutron.status_code_retries    = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] neutron.status_code_retry_delay = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] neutron.timeout                = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] neutron.version                = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] notifications.bdms_in_notifications = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] notifications.default_level    = INFO {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] notifications.notification_format = unversioned {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] notifications.notify_on_state_change = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] pci.alias                      = [] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] pci.device_spec                = [] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] pci.report_in_placement        = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.auth_section         = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.auth_type            = password {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.cafile               = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.certfile             = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.collect_timing       = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.connect_retries      = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.connect_retry_delay  = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.default_domain_id    = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.default_domain_name  = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.domain_id            = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.domain_name          = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.endpoint_override    = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.insecure             = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.keyfile              = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.max_version          = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.min_version          = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.password             = **** {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.project_domain_id    = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.project_domain_name  = Default {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.project_id           = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.project_name         = service {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.region_name          = RegionOne {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.service_name         = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.service_type         = placement {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.split_loggers        = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.status_code_retries  = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.status_code_retry_delay = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.system_scope         = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.timeout              = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.trust_id             = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.user_domain_id       = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.user_domain_name     = Default {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.user_id              = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.username             = placement {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] placement.version              = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] quota.cores                    = 20 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] quota.count_usage_from_placement = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] quota.injected_file_content_bytes = 10240 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] quota.injected_file_path_length = 255 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] quota.injected_files           = 5 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] quota.instances                = 10 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] quota.key_pairs                = 100 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] quota.metadata_items           = 128 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] quota.ram                      = 51200 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] quota.recheck_quota            = True {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] quota.server_group_members     = 10 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] quota.server_groups            = 10 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] rdp.enabled                    = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] scheduler.image_metadata_prefilter = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] scheduler.max_attempts         = 3 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] scheduler.max_placement_results = 1000 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] scheduler.query_placement_for_availability_zone = True {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] scheduler.query_placement_for_image_type_support = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] scheduler.workers              = 3 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] filter_scheduler.host_subset_size = 1 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] filter_scheduler.isolated_hosts = [] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] filter_scheduler.isolated_images = [] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] filter_scheduler.pci_in_placement = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] filter_scheduler.track_instance_changes = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] metrics.required               = True {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] metrics.weight_multiplier      = 1.0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] metrics.weight_setting         = [] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] serial_console.enabled         = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] serial_console.port_range      = 10000:20000 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] serial_console.serialproxy_port = 6083 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] service_user.auth_section      = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] service_user.auth_type         = password {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] service_user.cafile            = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] service_user.certfile          = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] service_user.collect_timing    = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] service_user.insecure          = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] service_user.keyfile           = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] service_user.send_service_user_token = True {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] service_user.split_loggers     = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] service_user.timeout           = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] spice.agent_enabled            = True {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] spice.enabled                  = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] spice.html5proxy_port          = 6082 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] spice.image_compression        = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] spice.jpeg_compression         = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] spice.playback_compression     = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] spice.server_listen            = 127.0.0.1 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] spice.streaming_mode           = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] spice.zlib_compression         = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] upgrade_levels.baseapi         = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] upgrade_levels.cert            = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] upgrade_levels.compute         = auto {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] upgrade_levels.conductor       = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] upgrade_levels.scheduler       = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vendordata_dynamic_auth.auth_section = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vendordata_dynamic_auth.auth_type = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vendordata_dynamic_auth.cafile = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vendordata_dynamic_auth.certfile = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vendordata_dynamic_auth.insecure = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vendordata_dynamic_auth.keyfile = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vendordata_dynamic_auth.timeout = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vmware.api_retry_count         = 10 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vmware.ca_file                 = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vmware.cache_prefix            = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vmware.cluster_name            = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vmware.connection_pool_size    = 10 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vmware.console_delay_seconds   = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vmware.datastore_regex         = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vmware.host_ip                 = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vmware.host_password           = **** {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vmware.host_port               = 443 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vmware.host_username           = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vmware.insecure                = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vmware.integration_bridge      = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vmware.maximum_objects         = 100 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vmware.pbm_default_policy      = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vmware.pbm_enabled             = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vmware.pbm_wsdl_location       = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vmware.serial_port_proxy_uri   = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vmware.serial_port_service_uri = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vmware.task_poll_interval      = 0.5 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vmware.use_linked_clone        = True {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vmware.vnc_keymap              = en-us {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vmware.vnc_port                = 5900 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vmware.vnc_port_total          = 10000 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vnc.auth_schemes               = ['none'] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vnc.enabled                    = True {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vnc.novncproxy_port            = 6080 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vnc.server_listen              = 0.0.0.0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vnc.vencrypt_ca_certs          = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vnc.vencrypt_client_cert       = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vnc.vencrypt_client_key        = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] workarounds.disable_rootwrap   = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] workarounds.enable_numa_live_migration = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] workarounds.libvirt_disable_apic = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] wsgi.client_socket_timeout     = 900 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] wsgi.default_pool_size         = 1000 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] wsgi.keep_alive                = True {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] wsgi.max_header_line           = 16384 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] wsgi.ssl_ca_file               = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] wsgi.ssl_cert_file             = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] wsgi.ssl_key_file              = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] wsgi.tcp_keepidle              = 600 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] zvm.ca_file                    = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] zvm.cloud_connector_url        = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] zvm.reachable_timeout          = 300 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_policy.enforce_new_defaults = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_policy.enforce_scope      = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_policy.policy_default_rule = default {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_policy.policy_file        = policy.yaml {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] profiler.connection_string     = messaging:// {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] profiler.enabled               = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] profiler.es_doc_type           = notification {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] profiler.es_scroll_size        = 10000 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] profiler.es_scroll_time        = 2m {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] profiler.filter_error_trace    = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] profiler.hmac_keys             = SECRET_KEY {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] profiler.sentinel_service_name = mymaster {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] profiler.socket_timeout        = 0.1 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] profiler.trace_sqlalchemy      = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] remote_debug.host              = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] remote_debug.port              = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_rabbit.ssl      = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_notifications.retry = -1 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_limit.auth_section        = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_limit.auth_type           = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_limit.cafile              = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_limit.certfile            = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_limit.collect_timing      = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_limit.connect_retries     = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_limit.connect_retry_delay = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_limit.endpoint_id         = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_limit.endpoint_override   = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_limit.insecure            = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_limit.keyfile             = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_limit.max_version         = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_limit.min_version         = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_limit.region_name         = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_limit.service_name        = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_limit.service_type        = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_limit.split_loggers       = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_limit.status_code_retries = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_limit.status_code_retry_delay = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_limit.timeout             = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_limit.valid_interfaces    = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_limit.version             = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_reports.file_event_handler = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] oslo_reports.log_dir           = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vif_plug_ovs_privileged.group  = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] vif_plug_ovs_privileged.user   = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] os_vif_linux_bridge.flat_interface = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] os_vif_ovs.isolate_vif         = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] os_vif_ovs.per_port_bridge     = False {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] os_brick.lock_path             = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] privsep_osbrick.capabilities   = [21] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] privsep_osbrick.group          = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] privsep_osbrick.helper_command = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] privsep_osbrick.user           = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] nova_sys_admin.group           = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] nova_sys_admin.helper_command  = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] nova_sys_admin.user            = None {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG oslo_service.service [None req-c255482d-23b3-4212-ab5b-b464f0f46dd8 None None] ******************************************************************************** {{(pid=71498) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Apr 14 01:36:26 user nova-compute[71498]: INFO nova.service [-] Starting compute node (version 0.0.0)
Apr 14 01:36:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Starting native event thread {{(pid=71498) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Starting green dispatch thread {{(pid=71498) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Starting connection event dispatch thread {{(pid=71498) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Connecting to libvirt: qemu:///system {{(pid=71498) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f51fd2ae650> {{(pid=71498) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Apr 14 01:36:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f51fd2ae650> {{(pid=71498) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Apr 14 01:36:26 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Connection event '1' reason 'None'
Apr 14 01:36:27 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 14 01:36:27 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.mount [None req-d0170308-0176-429c-b298-160fda25d12f None None] Initialising _HostMountState generation 0 {{(pid=71498) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Apr 14 01:36:35 user nova-compute[71498]: INFO nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Libvirt host capabilities <capabilities>
Apr 14 01:36:35 user nova-compute[71498]:   <host>
Apr 14 01:36:35 user nova-compute[71498]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Apr 14 01:36:35 user nova-compute[71498]:     <cpu>
Apr 14 01:36:35 user nova-compute[71498]:       <arch>x86_64</arch>
Apr 14 01:36:35 user nova-compute[71498]:       <model>IvyBridge-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <vendor>Intel</vendor>
Apr 14 01:36:35 user nova-compute[71498]:       <microcode version='1070'/>
Apr 14 01:36:35 user nova-compute[71498]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Apr 14 01:36:35 user nova-compute[71498]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature name='ss'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature name='vmx'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature name='pcid'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature name='osxsave'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature name='hypervisor'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature name='arat'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature name='tsc_adjust'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature name='md-clear'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature name='stibp'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature name='arch-capabilities'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature name='ssbd'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature name='invtsc'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature name='rsba'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature name='skip-l1dfl-vmentry'/>
Apr 14 01:36:35 user nova-compute[71498]:       <pages unit='KiB' size='4'/>
Apr 14 01:36:35 user nova-compute[71498]:       <pages unit='KiB' size='2048'/>
Apr 14 01:36:35 user nova-compute[71498]:     </cpu>
Apr 14 01:36:35 user nova-compute[71498]:     <power_management>
Apr 14 01:36:35 user nova-compute[71498]:       <suspend_mem/>
Apr 14 01:36:35 user nova-compute[71498]:       <suspend_disk/>
Apr 14 01:36:35 user nova-compute[71498]:       <suspend_hybrid/>
Apr 14 01:36:35 user nova-compute[71498]:     </power_management>
Apr 14 01:36:35 user nova-compute[71498]:     <iommu support='no'/>
Apr 14 01:36:35 user nova-compute[71498]:     <migration_features>
Apr 14 01:36:35 user nova-compute[71498]:       <live/>
Apr 14 01:36:35 user nova-compute[71498]:       <uri_transports>
Apr 14 01:36:35 user nova-compute[71498]:         <uri_transport>tcp</uri_transport>
Apr 14 01:36:35 user nova-compute[71498]:         <uri_transport>rdma</uri_transport>
Apr 14 01:36:35 user nova-compute[71498]:       </uri_transports>
Apr 14 01:36:35 user nova-compute[71498]:     </migration_features>
Apr 14 01:36:35 user nova-compute[71498]:     <topology>
Apr 14 01:36:35 user nova-compute[71498]:       <cells num='2'>
Apr 14 01:36:35 user nova-compute[71498]:         <cell id='0'>
Apr 14 01:36:35 user nova-compute[71498]:           <memory unit='KiB'>8152920</memory>
Apr 14 01:36:35 user nova-compute[71498]:           <pages unit='KiB' size='4'>2038230</pages>
Apr 14 01:36:35 user nova-compute[71498]:           <pages unit='KiB' size='2048'>0</pages>
Apr 14 01:36:35 user nova-compute[71498]:           <distances>
Apr 14 01:36:35 user nova-compute[71498]:             <sibling id='0' value='10'/>
Apr 14 01:36:35 user nova-compute[71498]:             <sibling id='1' value='20'/>
Apr 14 01:36:35 user nova-compute[71498]:           </distances>
Apr 14 01:36:35 user nova-compute[71498]:           <cpus num='6'>
Apr 14 01:36:35 user nova-compute[71498]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Apr 14 01:36:35 user nova-compute[71498]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Apr 14 01:36:35 user nova-compute[71498]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Apr 14 01:36:35 user nova-compute[71498]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Apr 14 01:36:35 user nova-compute[71498]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Apr 14 01:36:35 user nova-compute[71498]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Apr 14 01:36:35 user nova-compute[71498]:           </cpus>
Apr 14 01:36:35 user nova-compute[71498]:         </cell>
Apr 14 01:36:35 user nova-compute[71498]:         <cell id='1'>
Apr 14 01:36:35 user nova-compute[71498]:           <memory unit='KiB'>8255068</memory>
Apr 14 01:36:35 user nova-compute[71498]:           <pages unit='KiB' size='4'>2063767</pages>
Apr 14 01:36:35 user nova-compute[71498]:           <pages unit='KiB' size='2048'>0</pages>
Apr 14 01:36:35 user nova-compute[71498]:           <distances>
Apr 14 01:36:35 user nova-compute[71498]:             <sibling id='0' value='20'/>
Apr 14 01:36:35 user nova-compute[71498]:             <sibling id='1' value='10'/>
Apr 14 01:36:35 user nova-compute[71498]:           </distances>
Apr 14 01:36:35 user nova-compute[71498]:           <cpus num='6'>
Apr 14 01:36:35 user nova-compute[71498]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Apr 14 01:36:35 user nova-compute[71498]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Apr 14 01:36:35 user nova-compute[71498]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Apr 14 01:36:35 user nova-compute[71498]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Apr 14 01:36:35 user nova-compute[71498]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Apr 14 01:36:35 user nova-compute[71498]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Apr 14 01:36:35 user nova-compute[71498]:           </cpus>
Apr 14 01:36:35 user nova-compute[71498]:         </cell>
Apr 14 01:36:35 user nova-compute[71498]:       </cells>
Apr 14 01:36:35 user nova-compute[71498]:     </topology>
Apr 14 01:36:35 user nova-compute[71498]:     <cache>
Apr 14 01:36:35 user nova-compute[71498]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Apr 14 01:36:35 user nova-compute[71498]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Apr 14 01:36:35 user nova-compute[71498]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Apr 14 01:36:35 user nova-compute[71498]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Apr 14 01:36:35 user nova-compute[71498]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Apr 14 01:36:35 user nova-compute[71498]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Apr 14 01:36:35 user nova-compute[71498]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Apr 14 01:36:35 user nova-compute[71498]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Apr 14 01:36:35 user nova-compute[71498]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Apr 14 01:36:35 user nova-compute[71498]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Apr 14 01:36:35 user nova-compute[71498]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Apr 14 01:36:35 user nova-compute[71498]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Apr 14 01:36:35 user nova-compute[71498]:     </cache>
Apr 14 01:36:35 user nova-compute[71498]:     <secmodel>
Apr 14 01:36:35 user nova-compute[71498]:       <model>apparmor</model>
Apr 14 01:36:35 user nova-compute[71498]:       <doi>0</doi>
Apr 14 01:36:35 user nova-compute[71498]:     </secmodel>
Apr 14 01:36:35 user nova-compute[71498]:     <secmodel>
Apr 14 01:36:35 user nova-compute[71498]:       <model>dac</model>
Apr 14 01:36:35 user nova-compute[71498]:       <doi>0</doi>
Apr 14 01:36:35 user nova-compute[71498]:       <baselabel type='kvm'>+64055:+108</baselabel>
Apr 14 01:36:35 user nova-compute[71498]:       <baselabel type='qemu'>+64055:+108</baselabel>
Apr 14 01:36:35 user nova-compute[71498]:     </secmodel>
Apr 14 01:36:35 user nova-compute[71498]:   </host>
Apr 14 01:36:35 user nova-compute[71498]:   <guest>
Apr 14 01:36:35 user nova-compute[71498]:     <os_type>hvm</os_type>
Apr 14 01:36:35 user nova-compute[71498]:     <arch name='alpha'>
Apr 14 01:36:35 user nova-compute[71498]:       <wordsize>64</wordsize>
Apr 14 01:36:35 user nova-compute[71498]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='4'>clipper</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <domain type='qemu'/>
Apr 14 01:36:35 user nova-compute[71498]:     </arch>
Apr 14 01:36:35 user nova-compute[71498]:     <features>
Apr 14 01:36:35 user nova-compute[71498]:       <cpuselection/>
Apr 14 01:36:35 user nova-compute[71498]:       <deviceboot/>
Apr 14 01:36:35 user nova-compute[71498]:       <disksnapshot default='on' toggle='no'/>
Apr 14 01:36:35 user nova-compute[71498]:     </features>
Apr 14 01:36:35 user nova-compute[71498]:   </guest>
Apr 14 01:36:35 user nova-compute[71498]:   <guest>
Apr 14 01:36:35 user nova-compute[71498]:     <os_type>hvm</os_type>
Apr 14 01:36:35 user nova-compute[71498]:     <arch name='armv6l'>
Apr 14 01:36:35 user nova-compute[71498]:       <wordsize>32</wordsize>
Apr 14 01:36:35 user nova-compute[71498]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>integratorcp</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>borzoi</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>spitz</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>nuri</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>musca-b1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>versatileab</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>kzm</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>musca-a</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>smdkc210</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>sx1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>z2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>tosa</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='4'>sabrelite</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>realview-eb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>n810</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>n800</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>versatilepb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>terrier</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>mainstone</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='4'>midway</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>musicpal</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>microbit</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>cubieboard</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>verdex</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>netduino2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='4'>raspi2b</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>cheetah</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='4'>highbank</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>akita</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>connex</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>collie</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>raspi0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <domain type='qemu'/>
Apr 14 01:36:35 user nova-compute[71498]:     </arch>
Apr 14 01:36:35 user nova-compute[71498]:     <features>
Apr 14 01:36:35 user nova-compute[71498]:       <cpuselection/>
Apr 14 01:36:35 user nova-compute[71498]:       <deviceboot/>
Apr 14 01:36:35 user nova-compute[71498]:       <disksnapshot default='on' toggle='no'/>
Apr 14 01:36:35 user nova-compute[71498]:     </features>
Apr 14 01:36:35 user nova-compute[71498]:   </guest>
Apr 14 01:36:35 user nova-compute[71498]:   <guest>
Apr 14 01:36:35 user nova-compute[71498]:     <os_type>hvm</os_type>
Apr 14 01:36:35 user nova-compute[71498]:     <arch name='armv7l'>
Apr 14 01:36:35 user nova-compute[71498]:       <wordsize>32</wordsize>
Apr 14 01:36:35 user nova-compute[71498]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>integratorcp</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>borzoi</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>spitz</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>nuri</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>musca-b1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>versatileab</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>kzm</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>musca-a</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>smdkc210</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>sx1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>z2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>tosa</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='4'>sabrelite</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>realview-eb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>n810</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>n800</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>versatilepb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>terrier</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>mainstone</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='4'>midway</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>musicpal</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>microbit</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>cubieboard</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>verdex</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>netduino2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='4'>raspi2b</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>cheetah</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='4'>highbank</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>akita</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>connex</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>collie</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>raspi0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <domain type='qemu'/>
Apr 14 01:36:35 user nova-compute[71498]:     </arch>
Apr 14 01:36:35 user nova-compute[71498]:     <features>
Apr 14 01:36:35 user nova-compute[71498]:       <cpuselection/>
Apr 14 01:36:35 user nova-compute[71498]:       <deviceboot/>
Apr 14 01:36:35 user nova-compute[71498]:       <disksnapshot default='on' toggle='no'/>
Apr 14 01:36:35 user nova-compute[71498]:     </features>
Apr 14 01:36:35 user nova-compute[71498]:   </guest>
Apr 14 01:36:35 user nova-compute[71498]:   <guest>
Apr 14 01:36:35 user nova-compute[71498]:     <os_type>hvm</os_type>
Apr 14 01:36:35 user nova-compute[71498]:     <arch name='aarch64'>
Apr 14 01:36:35 user nova-compute[71498]:       <wordsize>64</wordsize>
Apr 14 01:36:35 user nova-compute[71498]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>integratorcp</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>borzoi</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>spitz</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>nuri</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>musca-b1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>versatileab</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>kzm</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>musca-a</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>smdkc210</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>sx1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>z2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>tosa</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='4'>sabrelite</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>realview-eb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='512'>sbsa-ref</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>n810</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>n800</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>versatilepb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>terrier</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>mainstone</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='4'>midway</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>musicpal</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>microbit</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='4'>raspi3ap</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>cubieboard</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>verdex</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>netduino2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='4'>raspi3b</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='4'>raspi2b</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>cheetah</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='4'>highbank</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>akita</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>connex</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>collie</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>raspi0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <domain type='qemu'/>
Apr 14 01:36:35 user nova-compute[71498]:     </arch>
Apr 14 01:36:35 user nova-compute[71498]:     <features>
Apr 14 01:36:35 user nova-compute[71498]:       <acpi default='on' toggle='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:       <cpuselection/>
Apr 14 01:36:35 user nova-compute[71498]:       <deviceboot/>
Apr 14 01:36:35 user nova-compute[71498]:       <disksnapshot default='on' toggle='no'/>
Apr 14 01:36:35 user nova-compute[71498]:     </features>
Apr 14 01:36:35 user nova-compute[71498]:   </guest>
Apr 14 01:36:35 user nova-compute[71498]:   <guest>
Apr 14 01:36:35 user nova-compute[71498]:     <os_type>hvm</os_type>
Apr 14 01:36:35 user nova-compute[71498]:     <arch name='cris'>
Apr 14 01:36:35 user nova-compute[71498]:       <wordsize>32</wordsize>
Apr 14 01:36:35 user nova-compute[71498]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>axis-dev88</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <domain type='qemu'/>
Apr 14 01:36:35 user nova-compute[71498]:     </arch>
Apr 14 01:36:35 user nova-compute[71498]:     <features>
Apr 14 01:36:35 user nova-compute[71498]:       <cpuselection/>
Apr 14 01:36:35 user nova-compute[71498]:       <deviceboot/>
Apr 14 01:36:35 user nova-compute[71498]:       <disksnapshot default='on' toggle='no'/>
Apr 14 01:36:35 user nova-compute[71498]:     </features>
Apr 14 01:36:35 user nova-compute[71498]:   </guest>
Apr 14 01:36:35 user nova-compute[71498]:   <guest>
Apr 14 01:36:35 user nova-compute[71498]:     <os_type>hvm</os_type>
Apr 14 01:36:35 user nova-compute[71498]:     <arch name='i686'>
Apr 14 01:36:35 user nova-compute[71498]:       <wordsize>32</wordsize>
Apr 14 01:36:35 user nova-compute[71498]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>x-remote</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>isapc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>microvm</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <domain type='qemu'/>
Apr 14 01:36:35 user nova-compute[71498]:       <domain type='kvm'/>
Apr 14 01:36:35 user nova-compute[71498]:     </arch>
Apr 14 01:36:35 user nova-compute[71498]:     <features>
Apr 14 01:36:35 user nova-compute[71498]:       <pae/>
Apr 14 01:36:35 user nova-compute[71498]:       <nonpae/>
Apr 14 01:36:35 user nova-compute[71498]:       <acpi default='on' toggle='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:       <apic default='on' toggle='no'/>
Apr 14 01:36:35 user nova-compute[71498]:       <cpuselection/>
Apr 14 01:36:35 user nova-compute[71498]:       <deviceboot/>
Apr 14 01:36:35 user nova-compute[71498]:       <disksnapshot default='on' toggle='no'/>
Apr 14 01:36:35 user nova-compute[71498]:     </features>
Apr 14 01:36:35 user nova-compute[71498]:   </guest>
Apr 14 01:36:35 user nova-compute[71498]:   <guest>
Apr 14 01:36:35 user nova-compute[71498]:     <os_type>hvm</os_type>
Apr 14 01:36:35 user nova-compute[71498]:     <arch name='m68k'>
Apr 14 01:36:35 user nova-compute[71498]:       <wordsize>32</wordsize>
Apr 14 01:36:35 user nova-compute[71498]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>mcf5208evb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>an5206</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>virt-6.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>q800</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>virt-6.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>next-cube</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>virt-6.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <domain type='qemu'/>
Apr 14 01:36:35 user nova-compute[71498]:     </arch>
Apr 14 01:36:35 user nova-compute[71498]:     <features>
Apr 14 01:36:35 user nova-compute[71498]:       <cpuselection/>
Apr 14 01:36:35 user nova-compute[71498]:       <deviceboot/>
Apr 14 01:36:35 user nova-compute[71498]:       <disksnapshot default='on' toggle='no'/>
Apr 14 01:36:35 user nova-compute[71498]:     </features>
Apr 14 01:36:35 user nova-compute[71498]:   </guest>
Apr 14 01:36:35 user nova-compute[71498]:   <guest>
Apr 14 01:36:35 user nova-compute[71498]:     <os_type>hvm</os_type>
Apr 14 01:36:35 user nova-compute[71498]:     <arch name='microblaze'>
Apr 14 01:36:35 user nova-compute[71498]:       <wordsize>32</wordsize>
Apr 14 01:36:35 user nova-compute[71498]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <domain type='qemu'/>
Apr 14 01:36:35 user nova-compute[71498]:     </arch>
Apr 14 01:36:35 user nova-compute[71498]:     <features>
Apr 14 01:36:35 user nova-compute[71498]:       <cpuselection/>
Apr 14 01:36:35 user nova-compute[71498]:       <deviceboot/>
Apr 14 01:36:35 user nova-compute[71498]:       <disksnapshot default='on' toggle='no'/>
Apr 14 01:36:35 user nova-compute[71498]:     </features>
Apr 14 01:36:35 user nova-compute[71498]:   </guest>
Apr 14 01:36:35 user nova-compute[71498]:   <guest>
Apr 14 01:36:35 user nova-compute[71498]:     <os_type>hvm</os_type>
Apr 14 01:36:35 user nova-compute[71498]:     <arch name='microblazeel'>
Apr 14 01:36:35 user nova-compute[71498]:       <wordsize>32</wordsize>
Apr 14 01:36:35 user nova-compute[71498]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <domain type='qemu'/>
Apr 14 01:36:35 user nova-compute[71498]:     </arch>
Apr 14 01:36:35 user nova-compute[71498]:     <features>
Apr 14 01:36:35 user nova-compute[71498]:       <cpuselection/>
Apr 14 01:36:35 user nova-compute[71498]:       <deviceboot/>
Apr 14 01:36:35 user nova-compute[71498]:       <disksnapshot default='on' toggle='no'/>
Apr 14 01:36:35 user nova-compute[71498]:     </features>
Apr 14 01:36:35 user nova-compute[71498]:   </guest>
Apr 14 01:36:35 user nova-compute[71498]:   <guest>
Apr 14 01:36:35 user nova-compute[71498]:     <os_type>hvm</os_type>
Apr 14 01:36:35 user nova-compute[71498]:     <arch name='mips'>
Apr 14 01:36:35 user nova-compute[71498]:       <wordsize>32</wordsize>
Apr 14 01:36:35 user nova-compute[71498]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='16'>malta</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <domain type='qemu'/>
Apr 14 01:36:35 user nova-compute[71498]:     </arch>
Apr 14 01:36:35 user nova-compute[71498]:     <features>
Apr 14 01:36:35 user nova-compute[71498]:       <cpuselection/>
Apr 14 01:36:35 user nova-compute[71498]:       <deviceboot/>
Apr 14 01:36:35 user nova-compute[71498]:       <disksnapshot default='on' toggle='no'/>
Apr 14 01:36:35 user nova-compute[71498]:     </features>
Apr 14 01:36:35 user nova-compute[71498]:   </guest>
Apr 14 01:36:35 user nova-compute[71498]:   <guest>
Apr 14 01:36:35 user nova-compute[71498]:     <os_type>hvm</os_type>
Apr 14 01:36:35 user nova-compute[71498]:     <arch name='mipsel'>
Apr 14 01:36:35 user nova-compute[71498]:       <wordsize>32</wordsize>
Apr 14 01:36:35 user nova-compute[71498]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='16'>malta</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <domain type='qemu'/>
Apr 14 01:36:35 user nova-compute[71498]:     </arch>
Apr 14 01:36:35 user nova-compute[71498]:     <features>
Apr 14 01:36:35 user nova-compute[71498]:       <cpuselection/>
Apr 14 01:36:35 user nova-compute[71498]:       <deviceboot/>
Apr 14 01:36:35 user nova-compute[71498]:       <disksnapshot default='on' toggle='no'/>
Apr 14 01:36:35 user nova-compute[71498]:     </features>
Apr 14 01:36:35 user nova-compute[71498]:   </guest>
Apr 14 01:36:35 user nova-compute[71498]:   <guest>
Apr 14 01:36:35 user nova-compute[71498]:     <os_type>hvm</os_type>
Apr 14 01:36:35 user nova-compute[71498]:     <arch name='mips64'>
Apr 14 01:36:35 user nova-compute[71498]:       <wordsize>64</wordsize>
Apr 14 01:36:35 user nova-compute[71498]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='16'>malta</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>pica61</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>magnum</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <domain type='qemu'/>
Apr 14 01:36:35 user nova-compute[71498]:     </arch>
Apr 14 01:36:35 user nova-compute[71498]:     <features>
Apr 14 01:36:35 user nova-compute[71498]:       <cpuselection/>
Apr 14 01:36:35 user nova-compute[71498]:       <deviceboot/>
Apr 14 01:36:35 user nova-compute[71498]:       <disksnapshot default='on' toggle='no'/>
Apr 14 01:36:35 user nova-compute[71498]:     </features>
Apr 14 01:36:35 user nova-compute[71498]:   </guest>
Apr 14 01:36:35 user nova-compute[71498]:   <guest>
Apr 14 01:36:35 user nova-compute[71498]:     <os_type>hvm</os_type>
Apr 14 01:36:35 user nova-compute[71498]:     <arch name='mips64el'>
Apr 14 01:36:35 user nova-compute[71498]:       <wordsize>64</wordsize>
Apr 14 01:36:35 user nova-compute[71498]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='16'>malta</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='16'>loongson3-virt</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>pica61</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>magnum</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='16'>boston</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>fuloong2e</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <domain type='qemu'/>
Apr 14 01:36:35 user nova-compute[71498]:     </arch>
Apr 14 01:36:35 user nova-compute[71498]:     <features>
Apr 14 01:36:35 user nova-compute[71498]:       <cpuselection/>
Apr 14 01:36:35 user nova-compute[71498]:       <deviceboot/>
Apr 14 01:36:35 user nova-compute[71498]:       <disksnapshot default='on' toggle='no'/>
Apr 14 01:36:35 user nova-compute[71498]:     </features>
Apr 14 01:36:35 user nova-compute[71498]:   </guest>
Apr 14 01:36:35 user nova-compute[71498]:   <guest>
Apr 14 01:36:35 user nova-compute[71498]:     <os_type>hvm</os_type>
Apr 14 01:36:35 user nova-compute[71498]:     <arch name='ppc'>
Apr 14 01:36:35 user nova-compute[71498]:       <wordsize>32</wordsize>
Apr 14 01:36:35 user nova-compute[71498]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>g3beige</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>mac99</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='32'>ppce500</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>pegasos2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>sam460ex</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>bamboo</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>40p</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>ref405ep</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>taihu</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <domain type='qemu'/>
Apr 14 01:36:35 user nova-compute[71498]:     </arch>
Apr 14 01:36:35 user nova-compute[71498]:     <features>
Apr 14 01:36:35 user nova-compute[71498]:       <cpuselection/>
Apr 14 01:36:35 user nova-compute[71498]:       <deviceboot/>
Apr 14 01:36:35 user nova-compute[71498]:       <disksnapshot default='on' toggle='no'/>
Apr 14 01:36:35 user nova-compute[71498]:     </features>
Apr 14 01:36:35 user nova-compute[71498]:   </guest>
Apr 14 01:36:35 user nova-compute[71498]:   <guest>
Apr 14 01:36:35 user nova-compute[71498]:     <os_type>hvm</os_type>
Apr 14 01:36:35 user nova-compute[71498]:     <arch name='ppc64'>
Apr 14 01:36:35 user nova-compute[71498]:       <wordsize>64</wordsize>
Apr 14 01:36:35 user nova-compute[71498]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2048'>powernv9</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>taihu</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2048'>powernv10</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='32'>ppce500</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>40p</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>pegasos2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>bamboo</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>g3beige</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>mac99</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>sam460ex</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>ref405ep</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2048'>powernv8</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <domain type='qemu'/>
Apr 14 01:36:35 user nova-compute[71498]:     </arch>
Apr 14 01:36:35 user nova-compute[71498]:     <features>
Apr 14 01:36:35 user nova-compute[71498]:       <cpuselection/>
Apr 14 01:36:35 user nova-compute[71498]:       <deviceboot/>
Apr 14 01:36:35 user nova-compute[71498]:       <disksnapshot default='on' toggle='no'/>
Apr 14 01:36:35 user nova-compute[71498]:     </features>
Apr 14 01:36:35 user nova-compute[71498]:   </guest>
Apr 14 01:36:35 user nova-compute[71498]:   <guest>
Apr 14 01:36:35 user nova-compute[71498]:     <os_type>hvm</os_type>
Apr 14 01:36:35 user nova-compute[71498]:     <arch name='ppc64le'>
Apr 14 01:36:35 user nova-compute[71498]:       <wordsize>64</wordsize>
Apr 14 01:36:35 user nova-compute[71498]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2048'>powernv9</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>taihu</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2048'>powernv10</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='32'>ppce500</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>40p</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>pegasos2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>bamboo</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>g3beige</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>mac99</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>sam460ex</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>ref405ep</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2048'>powernv8</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <domain type='qemu'/>
Apr 14 01:36:35 user nova-compute[71498]:     </arch>
Apr 14 01:36:35 user nova-compute[71498]:     <features>
Apr 14 01:36:35 user nova-compute[71498]:       <cpuselection/>
Apr 14 01:36:35 user nova-compute[71498]:       <deviceboot/>
Apr 14 01:36:35 user nova-compute[71498]:       <disksnapshot default='on' toggle='no'/>
Apr 14 01:36:35 user nova-compute[71498]:     </features>
Apr 14 01:36:35 user nova-compute[71498]:   </guest>
Apr 14 01:36:35 user nova-compute[71498]:   <guest>
Apr 14 01:36:35 user nova-compute[71498]:     <os_type>hvm</os_type>
Apr 14 01:36:35 user nova-compute[71498]:     <arch name='riscv32'>
Apr 14 01:36:35 user nova-compute[71498]:       <wordsize>32</wordsize>
Apr 14 01:36:35 user nova-compute[71498]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='8'>spike</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>opentitan</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='5'>sifive_u</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>sifive_e</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='8'>virt</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <domain type='qemu'/>
Apr 14 01:36:35 user nova-compute[71498]:     </arch>
Apr 14 01:36:35 user nova-compute[71498]:     <features>
Apr 14 01:36:35 user nova-compute[71498]:       <cpuselection/>
Apr 14 01:36:35 user nova-compute[71498]:       <deviceboot/>
Apr 14 01:36:35 user nova-compute[71498]:       <disksnapshot default='on' toggle='no'/>
Apr 14 01:36:35 user nova-compute[71498]:     </features>
Apr 14 01:36:35 user nova-compute[71498]:   </guest>
Apr 14 01:36:35 user nova-compute[71498]:   <guest>
Apr 14 01:36:35 user nova-compute[71498]:     <os_type>hvm</os_type>
Apr 14 01:36:35 user nova-compute[71498]:     <arch name='riscv64'>
Apr 14 01:36:35 user nova-compute[71498]:       <wordsize>64</wordsize>
Apr 14 01:36:35 user nova-compute[71498]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='8'>spike</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='5'>sifive_u</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>shakti_c</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>sifive_e</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='8'>virt</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <domain type='qemu'/>
Apr 14 01:36:35 user nova-compute[71498]:     </arch>
Apr 14 01:36:35 user nova-compute[71498]:     <features>
Apr 14 01:36:35 user nova-compute[71498]:       <cpuselection/>
Apr 14 01:36:35 user nova-compute[71498]:       <deviceboot/>
Apr 14 01:36:35 user nova-compute[71498]:       <disksnapshot default='on' toggle='no'/>
Apr 14 01:36:35 user nova-compute[71498]:     </features>
Apr 14 01:36:35 user nova-compute[71498]:   </guest>
Apr 14 01:36:35 user nova-compute[71498]:   <guest>
Apr 14 01:36:35 user nova-compute[71498]:     <os_type>hvm</os_type>
Apr 14 01:36:35 user nova-compute[71498]:     <arch name='s390x'>
Apr 14 01:36:35 user nova-compute[71498]:       <wordsize>64</wordsize>
Apr 14 01:36:35 user nova-compute[71498]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <domain type='qemu'/>
Apr 14 01:36:35 user nova-compute[71498]:     </arch>
Apr 14 01:36:35 user nova-compute[71498]:     <features>
Apr 14 01:36:35 user nova-compute[71498]:       <cpuselection/>
Apr 14 01:36:35 user nova-compute[71498]:       <deviceboot/>
Apr 14 01:36:35 user nova-compute[71498]:       <disksnapshot default='on' toggle='no'/>
Apr 14 01:36:35 user nova-compute[71498]:     </features>
Apr 14 01:36:35 user nova-compute[71498]:   </guest>
Apr 14 01:36:35 user nova-compute[71498]:   <guest>
Apr 14 01:36:35 user nova-compute[71498]:     <os_type>hvm</os_type>
Apr 14 01:36:35 user nova-compute[71498]:     <arch name='sh4'>
Apr 14 01:36:35 user nova-compute[71498]:       <wordsize>32</wordsize>
Apr 14 01:36:35 user nova-compute[71498]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>shix</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>r2d</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <domain type='qemu'/>
Apr 14 01:36:35 user nova-compute[71498]:     </arch>
Apr 14 01:36:35 user nova-compute[71498]:     <features>
Apr 14 01:36:35 user nova-compute[71498]:       <cpuselection/>
Apr 14 01:36:35 user nova-compute[71498]:       <deviceboot/>
Apr 14 01:36:35 user nova-compute[71498]:       <disksnapshot default='on' toggle='no'/>
Apr 14 01:36:35 user nova-compute[71498]:     </features>
Apr 14 01:36:35 user nova-compute[71498]:   </guest>
Apr 14 01:36:35 user nova-compute[71498]:   <guest>
Apr 14 01:36:35 user nova-compute[71498]:     <os_type>hvm</os_type>
Apr 14 01:36:35 user nova-compute[71498]:     <arch name='sh4eb'>
Apr 14 01:36:35 user nova-compute[71498]:       <wordsize>64</wordsize>
Apr 14 01:36:35 user nova-compute[71498]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>shix</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>r2d</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <domain type='qemu'/>
Apr 14 01:36:35 user nova-compute[71498]:     </arch>
Apr 14 01:36:35 user nova-compute[71498]:     <features>
Apr 14 01:36:35 user nova-compute[71498]:       <cpuselection/>
Apr 14 01:36:35 user nova-compute[71498]:       <deviceboot/>
Apr 14 01:36:35 user nova-compute[71498]:       <disksnapshot default='on' toggle='no'/>
Apr 14 01:36:35 user nova-compute[71498]:     </features>
Apr 14 01:36:35 user nova-compute[71498]:   </guest>
Apr 14 01:36:35 user nova-compute[71498]:   <guest>
Apr 14 01:36:35 user nova-compute[71498]:     <os_type>hvm</os_type>
Apr 14 01:36:35 user nova-compute[71498]:     <arch name='sparc'>
Apr 14 01:36:35 user nova-compute[71498]:       <wordsize>32</wordsize>
Apr 14 01:36:35 user nova-compute[71498]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>SS-5</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='4'>SS-20</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>LX</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>SPARCClassic</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>leon3_generic</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>SPARCbook</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>SS-4</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='4'>SS-600MP</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='4'>SS-10</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>Voyager</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <domain type='qemu'/>
Apr 14 01:36:35 user nova-compute[71498]:     </arch>
Apr 14 01:36:35 user nova-compute[71498]:     <features>
Apr 14 01:36:35 user nova-compute[71498]:       <cpuselection/>
Apr 14 01:36:35 user nova-compute[71498]:       <deviceboot/>
Apr 14 01:36:35 user nova-compute[71498]:       <disksnapshot default='on' toggle='no'/>
Apr 14 01:36:35 user nova-compute[71498]:     </features>
Apr 14 01:36:35 user nova-compute[71498]:   </guest>
Apr 14 01:36:35 user nova-compute[71498]:   <guest>
Apr 14 01:36:35 user nova-compute[71498]:     <os_type>hvm</os_type>
Apr 14 01:36:35 user nova-compute[71498]:     <arch name='sparc64'>
Apr 14 01:36:35 user nova-compute[71498]:       <wordsize>64</wordsize>
Apr 14 01:36:35 user nova-compute[71498]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>sun4u</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>niagara</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>sun4v</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <domain type='qemu'/>
Apr 14 01:36:35 user nova-compute[71498]:     </arch>
Apr 14 01:36:35 user nova-compute[71498]:     <features>
Apr 14 01:36:35 user nova-compute[71498]:       <cpuselection/>
Apr 14 01:36:35 user nova-compute[71498]:       <deviceboot/>
Apr 14 01:36:35 user nova-compute[71498]:       <disksnapshot default='on' toggle='no'/>
Apr 14 01:36:35 user nova-compute[71498]:     </features>
Apr 14 01:36:35 user nova-compute[71498]:   </guest>
Apr 14 01:36:35 user nova-compute[71498]:   <guest>
Apr 14 01:36:35 user nova-compute[71498]:     <os_type>hvm</os_type>
Apr 14 01:36:35 user nova-compute[71498]:     <arch name='x86_64'>
Apr 14 01:36:35 user nova-compute[71498]:       <wordsize>64</wordsize>
Apr 14 01:36:35 user nova-compute[71498]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>x-remote</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='1'>isapc</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>microvm</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <domain type='qemu'/>
Apr 14 01:36:35 user nova-compute[71498]:       <domain type='kvm'/>
Apr 14 01:36:35 user nova-compute[71498]:     </arch>
Apr 14 01:36:35 user nova-compute[71498]:     <features>
Apr 14 01:36:35 user nova-compute[71498]:       <acpi default='on' toggle='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:       <apic default='on' toggle='no'/>
Apr 14 01:36:35 user nova-compute[71498]:       <cpuselection/>
Apr 14 01:36:35 user nova-compute[71498]:       <deviceboot/>
Apr 14 01:36:35 user nova-compute[71498]:       <disksnapshot default='on' toggle='no'/>
Apr 14 01:36:35 user nova-compute[71498]:     </features>
Apr 14 01:36:35 user nova-compute[71498]:   </guest>
Apr 14 01:36:35 user nova-compute[71498]:   <guest>
Apr 14 01:36:35 user nova-compute[71498]:     <os_type>hvm</os_type>
Apr 14 01:36:35 user nova-compute[71498]:     <arch name='xtensa'>
Apr 14 01:36:35 user nova-compute[71498]:       <wordsize>32</wordsize>
Apr 14 01:36:35 user nova-compute[71498]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='4'>sim</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='32'>kc705</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='32'>ml605</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='32'>virt</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='32'>lx200</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='32'>lx60</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <domain type='qemu'/>
Apr 14 01:36:35 user nova-compute[71498]:     </arch>
Apr 14 01:36:35 user nova-compute[71498]:     <features>
Apr 14 01:36:35 user nova-compute[71498]:       <cpuselection/>
Apr 14 01:36:35 user nova-compute[71498]:       <deviceboot/>
Apr 14 01:36:35 user nova-compute[71498]:       <disksnapshot default='on' toggle='no'/>
Apr 14 01:36:35 user nova-compute[71498]:     </features>
Apr 14 01:36:35 user nova-compute[71498]:   </guest>
Apr 14 01:36:35 user nova-compute[71498]:   <guest>
Apr 14 01:36:35 user nova-compute[71498]:     <os_type>hvm</os_type>
Apr 14 01:36:35 user nova-compute[71498]:     <arch name='xtensaeb'>
Apr 14 01:36:35 user nova-compute[71498]:       <wordsize>32</wordsize>
Apr 14 01:36:35 user nova-compute[71498]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='4'>sim</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='32'>kc705</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='32'>ml605</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='32'>virt</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='32'>lx200</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='32'>lx60</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 14 01:36:35 user nova-compute[71498]:       <domain type='qemu'/>
Apr 14 01:36:35 user nova-compute[71498]:     </arch>
Apr 14 01:36:35 user nova-compute[71498]:     <features>
Apr 14 01:36:35 user nova-compute[71498]:       <cpuselection/>
Apr 14 01:36:35 user nova-compute[71498]:       <deviceboot/>
Apr 14 01:36:35 user nova-compute[71498]:       <disksnapshot default='on' toggle='no'/>
Apr 14 01:36:35 user nova-compute[71498]:     </features>
Apr 14 01:36:35 user nova-compute[71498]:   </guest>
Apr 14 01:36:35 user nova-compute[71498]: </capabilities>
Apr 14 01:36:35 user nova-compute[71498]: 
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=71498) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=71498) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=71498) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71498) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71498) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=71498) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71498) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=71498) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=71498) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Getting domain capabilities for cris via machine types: {None} {{(pid=71498) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=71498) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'q35', 'ubuntu', 'pc'} {{(pid=71498) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Apr 14 01:36:35 user nova-compute[71498]: <domainCapabilities>
Apr 14 01:36:35 user nova-compute[71498]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 01:36:35 user nova-compute[71498]:   <domain>kvm</domain>
Apr 14 01:36:35 user nova-compute[71498]:   <machine>pc-q35-jammy</machine>
Apr 14 01:36:35 user nova-compute[71498]:   <arch>i686</arch>
Apr 14 01:36:35 user nova-compute[71498]:   <vcpu max='288'/>
Apr 14 01:36:35 user nova-compute[71498]:   <iothreads supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:   <os supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:     <enum name='firmware'/>
Apr 14 01:36:35 user nova-compute[71498]:     <loader supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='type'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>rom</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>pflash</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='readonly'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>yes</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>no</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='secure'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>no</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </loader>
Apr 14 01:36:35 user nova-compute[71498]:   </os>
Apr 14 01:36:35 user nova-compute[71498]:   <cpu>
Apr 14 01:36:35 user nova-compute[71498]:     <mode name='host-passthrough' supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='hostPassthroughMigratable'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>off</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </mode>
Apr 14 01:36:35 user nova-compute[71498]:     <mode name='maximum' supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='maximumMigratable'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>on</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>off</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </mode>
Apr 14 01:36:35 user nova-compute[71498]:     <mode name='host-model' supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <vendor>Intel</vendor>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='ss'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='vmx'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='pcid'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='hypervisor'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='arat'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='umip'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='md-clear'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='stibp'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='ssbd'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='ibpb'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='ibrs'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='amd-stibp'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='disable' name='erms'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='disable' name='lm'/>
Apr 14 01:36:35 user nova-compute[71498]:     </mode>
Apr 14 01:36:35 user nova-compute[71498]:     <mode name='custom' supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>qemu64</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>qemu32</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>phenom</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>pentium3</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>pentium2</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>pentium</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>n270</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>kvm64</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>kvm32</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>coreduo</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>core2duo</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>athlon</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Westmere</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Snowridge</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Server</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Client</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>SandyBridge</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Penryn</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G5</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G4</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G3</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G2</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G1</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Nehalem</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>IvyBridge</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Icelake-Server</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Haswell</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>EPYC-Rome</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>EPYC-Milan</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>EPYC</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Dhyana</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Cooperlake</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Conroe</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Broadwell</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>486</model>
Apr 14 01:36:35 user nova-compute[71498]:     </mode>
Apr 14 01:36:35 user nova-compute[71498]:   </cpu>
Apr 14 01:36:35 user nova-compute[71498]:   <memoryBacking supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:     <enum name='sourceType'>
Apr 14 01:36:35 user nova-compute[71498]:       <value>file</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>anonymous</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>memfd</value>
Apr 14 01:36:35 user nova-compute[71498]:     </enum>
Apr 14 01:36:35 user nova-compute[71498]:   </memoryBacking>
Apr 14 01:36:35 user nova-compute[71498]:   <devices>
Apr 14 01:36:35 user nova-compute[71498]:     <disk supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='diskDevice'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>disk</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>cdrom</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>floppy</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>lun</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='bus'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>fdc</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>scsi</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>usb</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>sata</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='model'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio-transitional</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio-non-transitional</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </disk>
Apr 14 01:36:35 user nova-compute[71498]:     <graphics supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='type'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>sdl</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>vnc</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>spice</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>egl-headless</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </graphics>
Apr 14 01:36:35 user nova-compute[71498]:     <video supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='modelType'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>vga</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>cirrus</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>vmvga</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>qxl</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>none</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>bochs</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>ramfb</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </video>
Apr 14 01:36:35 user nova-compute[71498]:     <hostdev supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='mode'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>subsystem</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='startupPolicy'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>default</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>mandatory</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>requisite</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>optional</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='subsysType'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>usb</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>pci</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>scsi</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='capsType'/>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='pciBackend'/>
Apr 14 01:36:35 user nova-compute[71498]:     </hostdev>
Apr 14 01:36:35 user nova-compute[71498]:     <rng supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='model'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio-transitional</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio-non-transitional</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='backendModel'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>random</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>egd</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>builtin</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </rng>
Apr 14 01:36:35 user nova-compute[71498]:     <filesystem supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='driverType'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>path</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>handle</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtiofs</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </filesystem>
Apr 14 01:36:35 user nova-compute[71498]:     <tpm supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='model'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>tpm-tis</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>tpm-crb</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='backendModel'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>passthrough</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>emulator</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </tpm>
Apr 14 01:36:35 user nova-compute[71498]:   </devices>
Apr 14 01:36:35 user nova-compute[71498]:   <features>
Apr 14 01:36:35 user nova-compute[71498]:     <gic supported='no'/>
Apr 14 01:36:35 user nova-compute[71498]:     <vmcoreinfo supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:     <genid supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:     <backingStoreInput supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:     <backup supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:     <sev supported='no'/>
Apr 14 01:36:35 user nova-compute[71498]:   </features>
Apr 14 01:36:35 user nova-compute[71498]: </domainCapabilities>
Apr 14 01:36:35 user nova-compute[71498]:  {{(pid=71498) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Apr 14 01:36:35 user nova-compute[71498]: <domainCapabilities>
Apr 14 01:36:35 user nova-compute[71498]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 01:36:35 user nova-compute[71498]:   <domain>kvm</domain>
Apr 14 01:36:35 user nova-compute[71498]:   <machine>pc-q35-6.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:   <arch>i686</arch>
Apr 14 01:36:35 user nova-compute[71498]:   <vcpu max='288'/>
Apr 14 01:36:35 user nova-compute[71498]:   <iothreads supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:   <os supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:     <enum name='firmware'/>
Apr 14 01:36:35 user nova-compute[71498]:     <loader supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='type'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>rom</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>pflash</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='readonly'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>yes</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>no</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='secure'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>no</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </loader>
Apr 14 01:36:35 user nova-compute[71498]:   </os>
Apr 14 01:36:35 user nova-compute[71498]:   <cpu>
Apr 14 01:36:35 user nova-compute[71498]:     <mode name='host-passthrough' supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='hostPassthroughMigratable'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>off</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </mode>
Apr 14 01:36:35 user nova-compute[71498]:     <mode name='maximum' supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='maximumMigratable'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>on</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>off</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </mode>
Apr 14 01:36:35 user nova-compute[71498]:     <mode name='host-model' supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <vendor>Intel</vendor>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='ss'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='vmx'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='pcid'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='hypervisor'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='arat'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='umip'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='md-clear'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='stibp'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='ssbd'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='ibpb'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='ibrs'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='amd-stibp'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='disable' name='erms'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='disable' name='lm'/>
Apr 14 01:36:35 user nova-compute[71498]:     </mode>
Apr 14 01:36:35 user nova-compute[71498]:     <mode name='custom' supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>qemu64</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>qemu32</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>phenom</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>pentium3</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>pentium2</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>pentium</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>n270</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>kvm64</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>kvm32</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>coreduo</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>core2duo</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>athlon</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Westmere</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Snowridge</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Server</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Client</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>SandyBridge</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Penryn</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G5</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G4</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G3</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G2</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G1</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Nehalem</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>IvyBridge</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Icelake-Server</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Haswell</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>EPYC-Rome</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>EPYC-Milan</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>EPYC</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Dhyana</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Cooperlake</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Conroe</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Broadwell</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>486</model>
Apr 14 01:36:35 user nova-compute[71498]:     </mode>
Apr 14 01:36:35 user nova-compute[71498]:   </cpu>
Apr 14 01:36:35 user nova-compute[71498]:   <memoryBacking supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:     <enum name='sourceType'>
Apr 14 01:36:35 user nova-compute[71498]:       <value>file</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>anonymous</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>memfd</value>
Apr 14 01:36:35 user nova-compute[71498]:     </enum>
Apr 14 01:36:35 user nova-compute[71498]:   </memoryBacking>
Apr 14 01:36:35 user nova-compute[71498]:   <devices>
Apr 14 01:36:35 user nova-compute[71498]:     <disk supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='diskDevice'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>disk</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>cdrom</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>floppy</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>lun</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='bus'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>fdc</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>scsi</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>usb</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>sata</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='model'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio-transitional</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio-non-transitional</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </disk>
Apr 14 01:36:35 user nova-compute[71498]:     <graphics supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='type'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>sdl</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>vnc</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>spice</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>egl-headless</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </graphics>
Apr 14 01:36:35 user nova-compute[71498]:     <video supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='modelType'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>vga</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>cirrus</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>vmvga</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>qxl</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>none</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>bochs</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>ramfb</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </video>
Apr 14 01:36:35 user nova-compute[71498]:     <hostdev supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='mode'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>subsystem</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='startupPolicy'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>default</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>mandatory</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>requisite</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>optional</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='subsysType'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>usb</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>pci</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>scsi</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='capsType'/>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='pciBackend'/>
Apr 14 01:36:35 user nova-compute[71498]:     </hostdev>
Apr 14 01:36:35 user nova-compute[71498]:     <rng supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='model'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio-transitional</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio-non-transitional</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='backendModel'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>random</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>egd</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>builtin</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </rng>
Apr 14 01:36:35 user nova-compute[71498]:     <filesystem supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='driverType'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>path</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>handle</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtiofs</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </filesystem>
Apr 14 01:36:35 user nova-compute[71498]:     <tpm supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='model'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>tpm-tis</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>tpm-crb</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='backendModel'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>passthrough</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>emulator</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </tpm>
Apr 14 01:36:35 user nova-compute[71498]:   </devices>
Apr 14 01:36:35 user nova-compute[71498]:   <features>
Apr 14 01:36:35 user nova-compute[71498]:     <gic supported='no'/>
Apr 14 01:36:35 user nova-compute[71498]:     <vmcoreinfo supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:     <genid supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:     <backingStoreInput supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:     <backup supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:     <sev supported='no'/>
Apr 14 01:36:35 user nova-compute[71498]:   </features>
Apr 14 01:36:35 user nova-compute[71498]: </domainCapabilities>
Apr 14 01:36:35 user nova-compute[71498]:  {{(pid=71498) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Apr 14 01:36:35 user nova-compute[71498]: <domainCapabilities>
Apr 14 01:36:35 user nova-compute[71498]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 01:36:35 user nova-compute[71498]:   <domain>kvm</domain>
Apr 14 01:36:35 user nova-compute[71498]:   <machine>pc-i440fx-jammy</machine>
Apr 14 01:36:35 user nova-compute[71498]:   <arch>i686</arch>
Apr 14 01:36:35 user nova-compute[71498]:   <vcpu max='255'/>
Apr 14 01:36:35 user nova-compute[71498]:   <iothreads supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:   <os supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:     <enum name='firmware'/>
Apr 14 01:36:35 user nova-compute[71498]:     <loader supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='type'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>rom</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>pflash</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='readonly'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>yes</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>no</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='secure'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>no</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </loader>
Apr 14 01:36:35 user nova-compute[71498]:   </os>
Apr 14 01:36:35 user nova-compute[71498]:   <cpu>
Apr 14 01:36:35 user nova-compute[71498]:     <mode name='host-passthrough' supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='hostPassthroughMigratable'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>off</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </mode>
Apr 14 01:36:35 user nova-compute[71498]:     <mode name='maximum' supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='maximumMigratable'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>on</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>off</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </mode>
Apr 14 01:36:35 user nova-compute[71498]:     <mode name='host-model' supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <vendor>Intel</vendor>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='ss'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='vmx'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='pcid'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='hypervisor'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='arat'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='umip'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='md-clear'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='stibp'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='ssbd'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='ibpb'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='ibrs'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='amd-stibp'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='disable' name='erms'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='disable' name='lm'/>
Apr 14 01:36:35 user nova-compute[71498]:     </mode>
Apr 14 01:36:35 user nova-compute[71498]:     <mode name='custom' supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>qemu64</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>qemu32</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>phenom</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>pentium3</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>pentium2</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>pentium</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>n270</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>kvm64</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>kvm32</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>coreduo</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>core2duo</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>athlon</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Westmere</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Snowridge</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Server</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Client</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>SandyBridge</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Penryn</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G5</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G4</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G3</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G2</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G1</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Nehalem</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>IvyBridge</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Icelake-Server</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Haswell</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>EPYC-Rome</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>EPYC-Milan</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>EPYC</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Dhyana</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Cooperlake</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Conroe</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Broadwell</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>486</model>
Apr 14 01:36:35 user nova-compute[71498]:     </mode>
Apr 14 01:36:35 user nova-compute[71498]:   </cpu>
Apr 14 01:36:35 user nova-compute[71498]:   <memoryBacking supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:     <enum name='sourceType'>
Apr 14 01:36:35 user nova-compute[71498]:       <value>file</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>anonymous</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>memfd</value>
Apr 14 01:36:35 user nova-compute[71498]:     </enum>
Apr 14 01:36:35 user nova-compute[71498]:   </memoryBacking>
Apr 14 01:36:35 user nova-compute[71498]:   <devices>
Apr 14 01:36:35 user nova-compute[71498]:     <disk supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='diskDevice'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>disk</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>cdrom</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>floppy</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>lun</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='bus'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>ide</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>fdc</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>scsi</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>usb</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>sata</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='model'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio-transitional</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio-non-transitional</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </disk>
Apr 14 01:36:35 user nova-compute[71498]:     <graphics supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='type'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>sdl</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>vnc</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>spice</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>egl-headless</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </graphics>
Apr 14 01:36:35 user nova-compute[71498]:     <video supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='modelType'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>vga</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>cirrus</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>vmvga</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>qxl</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>none</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>bochs</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>ramfb</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </video>
Apr 14 01:36:35 user nova-compute[71498]:     <hostdev supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='mode'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>subsystem</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='startupPolicy'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>default</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>mandatory</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>requisite</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>optional</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='subsysType'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>usb</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>pci</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>scsi</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='capsType'/>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='pciBackend'/>
Apr 14 01:36:35 user nova-compute[71498]:     </hostdev>
Apr 14 01:36:35 user nova-compute[71498]:     <rng supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='model'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio-transitional</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio-non-transitional</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='backendModel'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>random</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>egd</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>builtin</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </rng>
Apr 14 01:36:35 user nova-compute[71498]:     <filesystem supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='driverType'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>path</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>handle</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtiofs</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </filesystem>
Apr 14 01:36:35 user nova-compute[71498]:     <tpm supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='model'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>tpm-tis</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>tpm-crb</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='backendModel'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>passthrough</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>emulator</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </tpm>
Apr 14 01:36:35 user nova-compute[71498]:   </devices>
Apr 14 01:36:35 user nova-compute[71498]:   <features>
Apr 14 01:36:35 user nova-compute[71498]:     <gic supported='no'/>
Apr 14 01:36:35 user nova-compute[71498]:     <vmcoreinfo supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:     <genid supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:     <backingStoreInput supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:     <backup supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:     <sev supported='no'/>
Apr 14 01:36:35 user nova-compute[71498]:   </features>
Apr 14 01:36:35 user nova-compute[71498]: </domainCapabilities>
Apr 14 01:36:35 user nova-compute[71498]:  {{(pid=71498) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Apr 14 01:36:35 user nova-compute[71498]: <domainCapabilities>
Apr 14 01:36:35 user nova-compute[71498]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 01:36:35 user nova-compute[71498]:   <domain>kvm</domain>
Apr 14 01:36:35 user nova-compute[71498]:   <machine>pc-i440fx-6.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:   <arch>i686</arch>
Apr 14 01:36:35 user nova-compute[71498]:   <vcpu max='255'/>
Apr 14 01:36:35 user nova-compute[71498]:   <iothreads supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:   <os supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:     <enum name='firmware'/>
Apr 14 01:36:35 user nova-compute[71498]:     <loader supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='type'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>rom</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>pflash</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='readonly'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>yes</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>no</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='secure'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>no</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </loader>
Apr 14 01:36:35 user nova-compute[71498]:   </os>
Apr 14 01:36:35 user nova-compute[71498]:   <cpu>
Apr 14 01:36:35 user nova-compute[71498]:     <mode name='host-passthrough' supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='hostPassthroughMigratable'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>off</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </mode>
Apr 14 01:36:35 user nova-compute[71498]:     <mode name='maximum' supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='maximumMigratable'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>on</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>off</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </mode>
Apr 14 01:36:35 user nova-compute[71498]:     <mode name='host-model' supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <vendor>Intel</vendor>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='ss'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='vmx'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='pcid'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='hypervisor'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='arat'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='umip'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='md-clear'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='stibp'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='ssbd'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='ibpb'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='ibrs'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='amd-stibp'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='disable' name='erms'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='disable' name='lm'/>
Apr 14 01:36:35 user nova-compute[71498]:     </mode>
Apr 14 01:36:35 user nova-compute[71498]:     <mode name='custom' supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>qemu64</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>qemu32</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>phenom</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>pentium3</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>pentium2</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>pentium</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>n270</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>kvm64</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>kvm32</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>coreduo</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>core2duo</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>athlon</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Westmere</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Snowridge</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Server</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Client</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>SandyBridge</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Penryn</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G5</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G4</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G3</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G2</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G1</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Nehalem</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>IvyBridge</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Icelake-Server</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Haswell</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>EPYC-Rome</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>EPYC-Milan</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>EPYC</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Dhyana</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Cooperlake</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Conroe</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Broadwell</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>486</model>
Apr 14 01:36:35 user nova-compute[71498]:     </mode>
Apr 14 01:36:35 user nova-compute[71498]:   </cpu>
Apr 14 01:36:35 user nova-compute[71498]:   <memoryBacking supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:     <enum name='sourceType'>
Apr 14 01:36:35 user nova-compute[71498]:       <value>file</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>anonymous</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>memfd</value>
Apr 14 01:36:35 user nova-compute[71498]:     </enum>
Apr 14 01:36:35 user nova-compute[71498]:   </memoryBacking>
Apr 14 01:36:35 user nova-compute[71498]:   <devices>
Apr 14 01:36:35 user nova-compute[71498]:     <disk supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='diskDevice'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>disk</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>cdrom</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>floppy</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>lun</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='bus'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>ide</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>fdc</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>scsi</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>usb</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>sata</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='model'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio-transitional</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio-non-transitional</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </disk>
Apr 14 01:36:35 user nova-compute[71498]:     <graphics supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='type'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>sdl</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>vnc</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>spice</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>egl-headless</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </graphics>
Apr 14 01:36:35 user nova-compute[71498]:     <video supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='modelType'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>vga</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>cirrus</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>vmvga</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>qxl</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>none</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>bochs</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>ramfb</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </video>
Apr 14 01:36:35 user nova-compute[71498]:     <hostdev supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='mode'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>subsystem</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='startupPolicy'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>default</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>mandatory</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>requisite</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>optional</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='subsysType'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>usb</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>pci</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>scsi</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='capsType'/>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='pciBackend'/>
Apr 14 01:36:35 user nova-compute[71498]:     </hostdev>
Apr 14 01:36:35 user nova-compute[71498]:     <rng supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='model'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio-transitional</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio-non-transitional</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='backendModel'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>random</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>egd</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>builtin</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </rng>
Apr 14 01:36:35 user nova-compute[71498]:     <filesystem supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='driverType'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>path</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>handle</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtiofs</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </filesystem>
Apr 14 01:36:35 user nova-compute[71498]:     <tpm supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='model'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>tpm-tis</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>tpm-crb</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='backendModel'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>passthrough</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>emulator</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </tpm>
Apr 14 01:36:35 user nova-compute[71498]:   </devices>
Apr 14 01:36:35 user nova-compute[71498]:   <features>
Apr 14 01:36:35 user nova-compute[71498]:     <gic supported='no'/>
Apr 14 01:36:35 user nova-compute[71498]:     <vmcoreinfo supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:     <genid supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:     <backingStoreInput supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:     <backup supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:     <sev supported='no'/>
Apr 14 01:36:35 user nova-compute[71498]:   </features>
Apr 14 01:36:35 user nova-compute[71498]: </domainCapabilities>
Apr 14 01:36:35 user nova-compute[71498]:  {{(pid=71498) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=71498) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71498) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71498) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=71498) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=71498) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=71498) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=71498) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Getting domain capabilities for mips via machine types: {None} {{(pid=71498) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=71498) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=71498) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=71498) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=71498) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=71498) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=71498) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=71498) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=71498) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=71498) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=71498) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71498) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71498) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71498) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=71498) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71498) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71498) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=71498) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=71498) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=71498) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=71498) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=71498) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=71498) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=71498) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=71498) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=71498) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=71498) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=71498) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=71498) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=71498) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=71498) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'q35', 'ubuntu', 'pc'} {{(pid=71498) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Apr 14 01:36:35 user nova-compute[71498]: <domainCapabilities>
Apr 14 01:36:35 user nova-compute[71498]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 01:36:35 user nova-compute[71498]:   <domain>kvm</domain>
Apr 14 01:36:35 user nova-compute[71498]:   <machine>pc-q35-jammy</machine>
Apr 14 01:36:35 user nova-compute[71498]:   <arch>x86_64</arch>
Apr 14 01:36:35 user nova-compute[71498]:   <vcpu max='288'/>
Apr 14 01:36:35 user nova-compute[71498]:   <iothreads supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:   <os supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:     <enum name='firmware'>
Apr 14 01:36:35 user nova-compute[71498]:       <value>efi</value>
Apr 14 01:36:35 user nova-compute[71498]:     </enum>
Apr 14 01:36:35 user nova-compute[71498]:     <loader supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='type'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>rom</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>pflash</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='readonly'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>yes</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>no</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='secure'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>yes</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>no</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </loader>
Apr 14 01:36:35 user nova-compute[71498]:   </os>
Apr 14 01:36:35 user nova-compute[71498]:   <cpu>
Apr 14 01:36:35 user nova-compute[71498]:     <mode name='host-passthrough' supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='hostPassthroughMigratable'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>on</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>off</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </mode>
Apr 14 01:36:35 user nova-compute[71498]:     <mode name='maximum' supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='maximumMigratable'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>on</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>off</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </mode>
Apr 14 01:36:35 user nova-compute[71498]:     <mode name='host-model' supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <vendor>Intel</vendor>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='ss'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='vmx'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='pcid'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='hypervisor'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='arat'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='umip'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='md-clear'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='stibp'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='ssbd'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='invtsc'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='ibpb'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='ibrs'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='amd-stibp'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='rsba'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='disable' name='erms'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 01:36:35 user nova-compute[71498]:     </mode>
Apr 14 01:36:35 user nova-compute[71498]:     <mode name='custom' supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>qemu64</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>qemu32</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>phenom</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>pentium3</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>pentium2</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>pentium</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>n270</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>kvm64</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>kvm32</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>coreduo</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>core2duo</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>athlon</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>Westmere</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Snowridge</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Server</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Client</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>SandyBridge</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>Penryn</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G5</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G4</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G3</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G2</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>Opteron_G1</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>Nehalem</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>IvyBridge</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Icelake-Server</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Haswell</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>EPYC-Rome</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>EPYC-Milan</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>EPYC</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Dhyana</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Cooperlake</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>Conroe</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Broadwell</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>486</model>
Apr 14 01:36:35 user nova-compute[71498]:     </mode>
Apr 14 01:36:35 user nova-compute[71498]:   </cpu>
Apr 14 01:36:35 user nova-compute[71498]:   <memoryBacking supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:     <enum name='sourceType'>
Apr 14 01:36:35 user nova-compute[71498]:       <value>file</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>anonymous</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>memfd</value>
Apr 14 01:36:35 user nova-compute[71498]:     </enum>
Apr 14 01:36:35 user nova-compute[71498]:   </memoryBacking>
Apr 14 01:36:35 user nova-compute[71498]:   <devices>
Apr 14 01:36:35 user nova-compute[71498]:     <disk supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='diskDevice'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>disk</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>cdrom</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>floppy</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>lun</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='bus'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>fdc</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>scsi</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>usb</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>sata</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='model'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio-transitional</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio-non-transitional</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </disk>
Apr 14 01:36:35 user nova-compute[71498]:     <graphics supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='type'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>sdl</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>vnc</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>spice</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>egl-headless</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </graphics>
Apr 14 01:36:35 user nova-compute[71498]:     <video supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='modelType'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>vga</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>cirrus</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>vmvga</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>qxl</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>none</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>bochs</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>ramfb</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </video>
Apr 14 01:36:35 user nova-compute[71498]:     <hostdev supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='mode'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>subsystem</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='startupPolicy'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>default</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>mandatory</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>requisite</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>optional</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='subsysType'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>usb</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>pci</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>scsi</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='capsType'/>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='pciBackend'/>
Apr 14 01:36:35 user nova-compute[71498]:     </hostdev>
Apr 14 01:36:35 user nova-compute[71498]:     <rng supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='model'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio-transitional</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio-non-transitional</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='backendModel'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>random</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>egd</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>builtin</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </rng>
Apr 14 01:36:35 user nova-compute[71498]:     <filesystem supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='driverType'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>path</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>handle</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtiofs</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </filesystem>
Apr 14 01:36:35 user nova-compute[71498]:     <tpm supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='model'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>tpm-tis</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>tpm-crb</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='backendModel'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>passthrough</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>emulator</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </tpm>
Apr 14 01:36:35 user nova-compute[71498]:   </devices>
Apr 14 01:36:35 user nova-compute[71498]:   <features>
Apr 14 01:36:35 user nova-compute[71498]:     <gic supported='no'/>
Apr 14 01:36:35 user nova-compute[71498]:     <vmcoreinfo supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:     <genid supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:     <backingStoreInput supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:     <backup supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:     <sev supported='no'/>
Apr 14 01:36:35 user nova-compute[71498]:   </features>
Apr 14 01:36:35 user nova-compute[71498]: </domainCapabilities>
Apr 14 01:36:35 user nova-compute[71498]:  {{(pid=71498) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Apr 14 01:36:35 user nova-compute[71498]: <domainCapabilities>
Apr 14 01:36:35 user nova-compute[71498]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 01:36:35 user nova-compute[71498]:   <domain>kvm</domain>
Apr 14 01:36:35 user nova-compute[71498]:   <machine>pc-q35-6.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:   <arch>x86_64</arch>
Apr 14 01:36:35 user nova-compute[71498]:   <vcpu max='288'/>
Apr 14 01:36:35 user nova-compute[71498]:   <iothreads supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:   <os supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:     <enum name='firmware'>
Apr 14 01:36:35 user nova-compute[71498]:       <value>efi</value>
Apr 14 01:36:35 user nova-compute[71498]:     </enum>
Apr 14 01:36:35 user nova-compute[71498]:     <loader supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='type'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>rom</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>pflash</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='readonly'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>yes</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>no</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='secure'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>yes</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>no</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </loader>
Apr 14 01:36:35 user nova-compute[71498]:   </os>
Apr 14 01:36:35 user nova-compute[71498]:   <cpu>
Apr 14 01:36:35 user nova-compute[71498]:     <mode name='host-passthrough' supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='hostPassthroughMigratable'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>on</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>off</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </mode>
Apr 14 01:36:35 user nova-compute[71498]:     <mode name='maximum' supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='maximumMigratable'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>on</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>off</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </mode>
Apr 14 01:36:35 user nova-compute[71498]:     <mode name='host-model' supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <vendor>Intel</vendor>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='ss'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='vmx'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='pcid'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='hypervisor'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='arat'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='umip'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='md-clear'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='stibp'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='ssbd'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='invtsc'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='ibpb'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='ibrs'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='amd-stibp'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='rsba'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='disable' name='erms'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 01:36:35 user nova-compute[71498]:     </mode>
Apr 14 01:36:35 user nova-compute[71498]:     <mode name='custom' supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>qemu64</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>qemu32</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>phenom</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>pentium3</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>pentium2</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>pentium</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>n270</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>kvm64</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>kvm32</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>coreduo</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>core2duo</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>athlon</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>Westmere</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Snowridge</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Server</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Client</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>SandyBridge</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>Penryn</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G5</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G4</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G3</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G2</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>Opteron_G1</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>Nehalem</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>IvyBridge</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Icelake-Server</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Haswell</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>EPYC-Rome</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>EPYC-Milan</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>EPYC</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Dhyana</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Cooperlake</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>Conroe</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Broadwell</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>486</model>
Apr 14 01:36:35 user nova-compute[71498]:     </mode>
Apr 14 01:36:35 user nova-compute[71498]:   </cpu>
Apr 14 01:36:35 user nova-compute[71498]:   <memoryBacking supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:     <enum name='sourceType'>
Apr 14 01:36:35 user nova-compute[71498]:       <value>file</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>anonymous</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>memfd</value>
Apr 14 01:36:35 user nova-compute[71498]:     </enum>
Apr 14 01:36:35 user nova-compute[71498]:   </memoryBacking>
Apr 14 01:36:35 user nova-compute[71498]:   <devices>
Apr 14 01:36:35 user nova-compute[71498]:     <disk supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='diskDevice'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>disk</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>cdrom</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>floppy</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>lun</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='bus'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>fdc</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>scsi</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>usb</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>sata</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='model'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio-transitional</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio-non-transitional</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </disk>
Apr 14 01:36:35 user nova-compute[71498]:     <graphics supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='type'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>sdl</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>vnc</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>spice</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>egl-headless</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </graphics>
Apr 14 01:36:35 user nova-compute[71498]:     <video supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='modelType'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>vga</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>cirrus</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>vmvga</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>qxl</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>none</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>bochs</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>ramfb</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </video>
Apr 14 01:36:35 user nova-compute[71498]:     <hostdev supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='mode'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>subsystem</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='startupPolicy'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>default</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>mandatory</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>requisite</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>optional</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='subsysType'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>usb</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>pci</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>scsi</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='capsType'/>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='pciBackend'/>
Apr 14 01:36:35 user nova-compute[71498]:     </hostdev>
Apr 14 01:36:35 user nova-compute[71498]:     <rng supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='model'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio-transitional</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio-non-transitional</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='backendModel'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>random</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>egd</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>builtin</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </rng>
Apr 14 01:36:35 user nova-compute[71498]:     <filesystem supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='driverType'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>path</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>handle</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtiofs</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </filesystem>
Apr 14 01:36:35 user nova-compute[71498]:     <tpm supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='model'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>tpm-tis</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>tpm-crb</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='backendModel'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>passthrough</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>emulator</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </tpm>
Apr 14 01:36:35 user nova-compute[71498]:   </devices>
Apr 14 01:36:35 user nova-compute[71498]:   <features>
Apr 14 01:36:35 user nova-compute[71498]:     <gic supported='no'/>
Apr 14 01:36:35 user nova-compute[71498]:     <vmcoreinfo supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:     <genid supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:     <backingStoreInput supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:     <backup supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:     <sev supported='no'/>
Apr 14 01:36:35 user nova-compute[71498]:   </features>
Apr 14 01:36:35 user nova-compute[71498]: </domainCapabilities>
Apr 14 01:36:35 user nova-compute[71498]:  {{(pid=71498) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Apr 14 01:36:35 user nova-compute[71498]: <domainCapabilities>
Apr 14 01:36:35 user nova-compute[71498]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 01:36:35 user nova-compute[71498]:   <domain>kvm</domain>
Apr 14 01:36:35 user nova-compute[71498]:   <machine>pc-i440fx-jammy</machine>
Apr 14 01:36:35 user nova-compute[71498]:   <arch>x86_64</arch>
Apr 14 01:36:35 user nova-compute[71498]:   <vcpu max='255'/>
Apr 14 01:36:35 user nova-compute[71498]:   <iothreads supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:   <os supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:     <enum name='firmware'>
Apr 14 01:36:35 user nova-compute[71498]:       <value>efi</value>
Apr 14 01:36:35 user nova-compute[71498]:     </enum>
Apr 14 01:36:35 user nova-compute[71498]:     <loader supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='type'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>rom</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>pflash</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='readonly'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>yes</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>no</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='secure'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>no</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </loader>
Apr 14 01:36:35 user nova-compute[71498]:   </os>
Apr 14 01:36:35 user nova-compute[71498]:   <cpu>
Apr 14 01:36:35 user nova-compute[71498]:     <mode name='host-passthrough' supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='hostPassthroughMigratable'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>on</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>off</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </mode>
Apr 14 01:36:35 user nova-compute[71498]:     <mode name='maximum' supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='maximumMigratable'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>on</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>off</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </mode>
Apr 14 01:36:35 user nova-compute[71498]:     <mode name='host-model' supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <vendor>Intel</vendor>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='ss'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='vmx'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='pcid'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='hypervisor'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='arat'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='umip'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='md-clear'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='stibp'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='ssbd'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='invtsc'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='ibpb'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='ibrs'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='amd-stibp'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='rsba'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='disable' name='erms'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 01:36:35 user nova-compute[71498]:     </mode>
Apr 14 01:36:35 user nova-compute[71498]:     <mode name='custom' supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>qemu64</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>qemu32</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>phenom</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>pentium3</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>pentium2</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>pentium</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>n270</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>kvm64</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>kvm32</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>coreduo</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>core2duo</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>athlon</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>Westmere</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Snowridge</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Server</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Client</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>SandyBridge</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>Penryn</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G5</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G4</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G3</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G2</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>Opteron_G1</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>Nehalem</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>IvyBridge</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Icelake-Server</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Haswell</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>EPYC-Rome</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>EPYC-Milan</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>EPYC</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Dhyana</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Cooperlake</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>Conroe</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Broadwell</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>486</model>
Apr 14 01:36:35 user nova-compute[71498]:     </mode>
Apr 14 01:36:35 user nova-compute[71498]:   </cpu>
Apr 14 01:36:35 user nova-compute[71498]:   <memoryBacking supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:     <enum name='sourceType'>
Apr 14 01:36:35 user nova-compute[71498]:       <value>file</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>anonymous</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>memfd</value>
Apr 14 01:36:35 user nova-compute[71498]:     </enum>
Apr 14 01:36:35 user nova-compute[71498]:   </memoryBacking>
Apr 14 01:36:35 user nova-compute[71498]:   <devices>
Apr 14 01:36:35 user nova-compute[71498]:     <disk supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='diskDevice'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>disk</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>cdrom</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>floppy</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>lun</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='bus'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>ide</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>fdc</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>scsi</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>usb</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>sata</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='model'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio-transitional</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio-non-transitional</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </disk>
Apr 14 01:36:35 user nova-compute[71498]:     <graphics supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='type'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>sdl</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>vnc</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>spice</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>egl-headless</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </graphics>
Apr 14 01:36:35 user nova-compute[71498]:     <video supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='modelType'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>vga</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>cirrus</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>vmvga</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>qxl</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>none</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>bochs</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>ramfb</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </video>
Apr 14 01:36:35 user nova-compute[71498]:     <hostdev supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='mode'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>subsystem</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='startupPolicy'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>default</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>mandatory</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>requisite</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>optional</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='subsysType'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>usb</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>pci</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>scsi</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='capsType'/>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='pciBackend'/>
Apr 14 01:36:35 user nova-compute[71498]:     </hostdev>
Apr 14 01:36:35 user nova-compute[71498]:     <rng supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='model'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio-transitional</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio-non-transitional</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='backendModel'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>random</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>egd</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>builtin</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </rng>
Apr 14 01:36:35 user nova-compute[71498]:     <filesystem supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='driverType'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>path</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>handle</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtiofs</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </filesystem>
Apr 14 01:36:35 user nova-compute[71498]:     <tpm supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='model'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>tpm-tis</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>tpm-crb</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='backendModel'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>passthrough</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>emulator</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </tpm>
Apr 14 01:36:35 user nova-compute[71498]:   </devices>
Apr 14 01:36:35 user nova-compute[71498]:   <features>
Apr 14 01:36:35 user nova-compute[71498]:     <gic supported='no'/>
Apr 14 01:36:35 user nova-compute[71498]:     <vmcoreinfo supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:     <genid supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:     <backingStoreInput supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:     <backup supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:     <sev supported='no'/>
Apr 14 01:36:35 user nova-compute[71498]:   </features>
Apr 14 01:36:35 user nova-compute[71498]: </domainCapabilities>
Apr 14 01:36:35 user nova-compute[71498]:  {{(pid=71498) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Apr 14 01:36:35 user nova-compute[71498]: <domainCapabilities>
Apr 14 01:36:35 user nova-compute[71498]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 01:36:35 user nova-compute[71498]:   <domain>kvm</domain>
Apr 14 01:36:35 user nova-compute[71498]:   <machine>pc-i440fx-6.2</machine>
Apr 14 01:36:35 user nova-compute[71498]:   <arch>x86_64</arch>
Apr 14 01:36:35 user nova-compute[71498]:   <vcpu max='255'/>
Apr 14 01:36:35 user nova-compute[71498]:   <iothreads supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:   <os supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:     <enum name='firmware'>
Apr 14 01:36:35 user nova-compute[71498]:       <value>efi</value>
Apr 14 01:36:35 user nova-compute[71498]:     </enum>
Apr 14 01:36:35 user nova-compute[71498]:     <loader supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='type'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>rom</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>pflash</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='readonly'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>yes</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>no</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='secure'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>no</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </loader>
Apr 14 01:36:35 user nova-compute[71498]:   </os>
Apr 14 01:36:35 user nova-compute[71498]:   <cpu>
Apr 14 01:36:35 user nova-compute[71498]:     <mode name='host-passthrough' supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='hostPassthroughMigratable'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>on</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>off</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </mode>
Apr 14 01:36:35 user nova-compute[71498]:     <mode name='maximum' supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='maximumMigratable'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>on</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>off</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </mode>
Apr 14 01:36:35 user nova-compute[71498]:     <mode name='host-model' supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <vendor>Intel</vendor>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='ss'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='vmx'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='pcid'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='hypervisor'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='arat'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='umip'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='md-clear'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='stibp'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='ssbd'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='invtsc'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='ibpb'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='ibrs'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='amd-stibp'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='rsba'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='disable' name='erms'/>
Apr 14 01:36:35 user nova-compute[71498]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 01:36:35 user nova-compute[71498]:     </mode>
Apr 14 01:36:35 user nova-compute[71498]:     <mode name='custom' supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>qemu64</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>qemu32</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>phenom</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>pentium3</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>pentium2</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>pentium</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>n270</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>kvm64</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>kvm32</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>coreduo</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>core2duo</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>athlon</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>Westmere</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Snowridge</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Server</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Skylake-Client</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>SandyBridge</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>Penryn</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G5</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G4</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G3</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Opteron_G2</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>Opteron_G1</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>Nehalem</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>IvyBridge</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Icelake-Server</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Haswell</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>EPYC-Rome</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>EPYC-Milan</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>EPYC</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Dhyana</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Cooperlake</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>Conroe</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='no'>Broadwell</model>
Apr 14 01:36:35 user nova-compute[71498]:       <model usable='yes'>486</model>
Apr 14 01:36:35 user nova-compute[71498]:     </mode>
Apr 14 01:36:35 user nova-compute[71498]:   </cpu>
Apr 14 01:36:35 user nova-compute[71498]:   <memoryBacking supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:     <enum name='sourceType'>
Apr 14 01:36:35 user nova-compute[71498]:       <value>file</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>anonymous</value>
Apr 14 01:36:35 user nova-compute[71498]:       <value>memfd</value>
Apr 14 01:36:35 user nova-compute[71498]:     </enum>
Apr 14 01:36:35 user nova-compute[71498]:   </memoryBacking>
Apr 14 01:36:35 user nova-compute[71498]:   <devices>
Apr 14 01:36:35 user nova-compute[71498]:     <disk supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='diskDevice'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>disk</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>cdrom</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>floppy</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>lun</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='bus'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>ide</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>fdc</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>scsi</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>usb</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>sata</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='model'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio-transitional</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio-non-transitional</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </disk>
Apr 14 01:36:35 user nova-compute[71498]:     <graphics supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='type'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>sdl</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>vnc</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>spice</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>egl-headless</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </graphics>
Apr 14 01:36:35 user nova-compute[71498]:     <video supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='modelType'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>vga</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>cirrus</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>vmvga</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>qxl</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>none</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>bochs</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>ramfb</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </video>
Apr 14 01:36:35 user nova-compute[71498]:     <hostdev supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='mode'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>subsystem</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='startupPolicy'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>default</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>mandatory</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>requisite</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>optional</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='subsysType'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>usb</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>pci</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>scsi</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='capsType'/>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='pciBackend'/>
Apr 14 01:36:35 user nova-compute[71498]:     </hostdev>
Apr 14 01:36:35 user nova-compute[71498]:     <rng supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='model'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio-transitional</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtio-non-transitional</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='backendModel'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>random</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>egd</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>builtin</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </rng>
Apr 14 01:36:35 user nova-compute[71498]:     <filesystem supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='driverType'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>path</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>handle</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>virtiofs</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </filesystem>
Apr 14 01:36:35 user nova-compute[71498]:     <tpm supported='yes'>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='model'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>tpm-tis</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>tpm-crb</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:       <enum name='backendModel'>
Apr 14 01:36:35 user nova-compute[71498]:         <value>passthrough</value>
Apr 14 01:36:35 user nova-compute[71498]:         <value>emulator</value>
Apr 14 01:36:35 user nova-compute[71498]:       </enum>
Apr 14 01:36:35 user nova-compute[71498]:     </tpm>
Apr 14 01:36:35 user nova-compute[71498]:   </devices>
Apr 14 01:36:35 user nova-compute[71498]:   <features>
Apr 14 01:36:35 user nova-compute[71498]:     <gic supported='no'/>
Apr 14 01:36:35 user nova-compute[71498]:     <vmcoreinfo supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:     <genid supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:     <backingStoreInput supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:     <backup supported='yes'/>
Apr 14 01:36:35 user nova-compute[71498]:     <sev supported='no'/>
Apr 14 01:36:35 user nova-compute[71498]:   </features>
Apr 14 01:36:35 user nova-compute[71498]: </domainCapabilities>
Apr 14 01:36:35 user nova-compute[71498]:  {{(pid=71498) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=71498) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=71498) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=71498) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=71498) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Checking secure boot support for host arch (x86_64) {{(pid=71498) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 14 01:36:35 user nova-compute[71498]: INFO nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Secure Boot support detected
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] cpu compare xml: <cpu match="exact">
Apr 14 01:36:35 user nova-compute[71498]:   <model>Nehalem</model>
Apr 14 01:36:35 user nova-compute[71498]: </cpu>
Apr 14 01:36:35 user nova-compute[71498]:  {{(pid=71498) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:9996}}
Apr 14 01:36:35 user nova-compute[71498]: INFO nova.virt.node [None req-d0170308-0176-429c-b298-160fda25d12f None None] Generated node identity 5d1e0d73-5203-4561-b5ca-56519acd0ff4
Apr 14 01:36:35 user nova-compute[71498]: INFO nova.virt.node [None req-d0170308-0176-429c-b298-160fda25d12f None None] Wrote node identity 5d1e0d73-5203-4561-b5ca-56519acd0ff4 to /opt/stack/data/nova/compute_id
Apr 14 01:36:35 user nova-compute[71498]: WARNING nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] Compute nodes ['5d1e0d73-5203-4561-b5ca-56519acd0ff4'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Apr 14 01:36:35 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Apr 14 01:36:35 user nova-compute[71498]: WARNING nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 14 01:36:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d0170308-0176-429c-b298-160fda25d12f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d0170308-0176-429c-b298-160fda25d12f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d0170308-0176-429c-b298-160fda25d12f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d0170308-0176-429c-b298-160fda25d12f None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 01:36:35 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:36:35 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d0170308-0176-429c-b298-160fda25d12f None None] Hypervisor/Node resource view: name=user free_ram=10880MB free_disk=27.1236572265625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d0170308-0176-429c-b298-160fda25d12f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d0170308-0176-429c-b298-160fda25d12f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:36:35 user nova-compute[71498]: WARNING nova.compute.resource_tracker [None req-d0170308-0176-429c-b298-160fda25d12f None None] No compute node record for user:5d1e0d73-5203-4561-b5ca-56519acd0ff4: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 5d1e0d73-5203-4561-b5ca-56519acd0ff4 could not be found.
Apr 14 01:36:35 user nova-compute[71498]: INFO nova.compute.resource_tracker [None req-d0170308-0176-429c-b298-160fda25d12f None None] Compute node record created for user:user with uuid: 5d1e0d73-5203-4561-b5ca-56519acd0ff4
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d0170308-0176-429c-b298-160fda25d12f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 01:36:35 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d0170308-0176-429c-b298-160fda25d12f None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 01:36:36 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-d0170308-0176-429c-b298-160fda25d12f None None] [req-4e5dc1c5-e36b-435d-9c13-84e752fd3c99] Created resource provider record via placement API for resource provider with UUID 5d1e0d73-5203-4561-b5ca-56519acd0ff4 and name user.
Apr 14 01:36:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=71498) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1766}}
Apr 14 01:36:36 user nova-compute[71498]: INFO nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] kernel doesn't support AMD SEV
Apr 14 01:36:36 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d0170308-0176-429c-b298-160fda25d12f None None] Updating inventory in ProviderTree for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 with inventory: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 01:36:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:36:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Libvirt baseline CPU <cpu>
Apr 14 01:36:36 user nova-compute[71498]:   <arch>x86_64</arch>
Apr 14 01:36:36 user nova-compute[71498]:   <model>Nehalem</model>
Apr 14 01:36:36 user nova-compute[71498]:   <vendor>Intel</vendor>
Apr 14 01:36:36 user nova-compute[71498]:   <topology sockets="6" cores="1" threads="1"/>
Apr 14 01:36:36 user nova-compute[71498]: </cpu>
Apr 14 01:36:36 user nova-compute[71498]:  {{(pid=71498) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12486}}
Apr 14 01:36:36 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d0170308-0176-429c-b298-160fda25d12f None None] Updated inventory for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Apr 14 01:36:36 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d0170308-0176-429c-b298-160fda25d12f None None] Updating resource provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 generation from 0 to 1 during operation: update_inventory {{(pid=71498) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 14 01:36:36 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d0170308-0176-429c-b298-160fda25d12f None None] Updating inventory in ProviderTree for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 with inventory: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 01:36:36 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d0170308-0176-429c-b298-160fda25d12f None None] Updating resource provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 generation from 1 to 2 during operation: update_traits {{(pid=71498) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 14 01:36:36 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d0170308-0176-429c-b298-160fda25d12f None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 01:36:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d0170308-0176-429c-b298-160fda25d12f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.631s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:36:36 user nova-compute[71498]: DEBUG nova.service [None req-d0170308-0176-429c-b298-160fda25d12f None None] Creating RPC server for service compute {{(pid=71498) start /opt/stack/nova/nova/service.py:182}}
Apr 14 01:36:36 user nova-compute[71498]: DEBUG nova.service [None req-d0170308-0176-429c-b298-160fda25d12f None None] Join ServiceGroup membership for this service compute {{(pid=71498) start /opt/stack/nova/nova/service.py:199}}
Apr 14 01:36:36 user nova-compute[71498]: DEBUG nova.servicegroup.drivers.db [None req-d0170308-0176-429c-b298-160fda25d12f None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=71498) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Apr 14 01:37:16 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._sync_power_states {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:37:16 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:37:26 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:37:26 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:37:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 01:37:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Rebuilding the list of instances to heal {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 01:37:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Didn't find any instances for network info cache update. {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 01:37:26 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:37:26 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:37:26 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:37:26 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:37:26 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:37:26 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:37:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 01:37:26 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:37:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:37:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:37:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:37:26 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 01:37:26 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:37:26 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:37:26 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=10252MB free_disk=27.037445068359375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 01:37:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:37:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:37:26 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 01:37:26 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 01:37:26 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:37:26 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:37:26 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 01:37:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.261s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:38:26 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:38:26 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:38:26 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:38:26 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:38:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:38:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:38:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:38:26 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 01:38:27 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:38:27 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:38:27 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=10227MB free_disk=27.084857940673828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 01:38:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:38:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:38:27 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 01:38:27 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 01:38:27 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:38:27 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:38:27 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 01:38:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:38:27 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:38:27 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:38:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 01:38:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Rebuilding the list of instances to heal {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 01:38:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Didn't find any instances for network info cache update. {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 01:38:27 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:38:27 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:38:27 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:38:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 01:38:28 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:39:27 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:39:27 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:39:28 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:39:28 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:39:28 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:39:28 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:39:28 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 01:39:28 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:39:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:39:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:39:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:39:28 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 01:39:28 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:39:28 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:39:28 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=10197MB free_disk=26.85968017578125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 01:39:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:39:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:39:28 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 01:39:28 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 01:39:28 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:39:28 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:39:28 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 01:39:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:39:29 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:39:29 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 01:39:29 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Rebuilding the list of instances to heal {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 01:39:29 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Didn't find any instances for network info cache update. {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 01:39:30 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:40:27 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:40:28 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:40:28 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:40:28 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:40:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:40:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:40:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:40:28 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 01:40:28 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:40:28 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:40:28 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=9479MB free_disk=26.882789611816406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 01:40:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:40:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:40:28 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 01:40:28 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 01:40:28 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:40:28 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:40:28 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 01:40:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.115s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:40:29 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:40:29 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 01:40:29 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Rebuilding the list of instances to heal {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 01:40:29 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Didn't find any instances for network info cache update. {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 01:40:29 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:40:29 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:40:29 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:40:30 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:40:30 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:40:30 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 01:40:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "da60f4f1-2474-453f-8f84-c95daf02431a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:40:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "da60f4f1-2474-453f-8f84-c95daf02431a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:40:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 01:40:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:40:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:40:42 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:40:42 user nova-compute[71498]: INFO nova.compute.claims [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Claim successful on node user
Apr 14 01:40:43 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:40:43 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:40:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:40:43 user nova-compute[71498]: DEBUG nova.compute.manager [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 01:40:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "8e042a42-7cc2-4d72-b7ed-2b80339f2c85" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:40:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "8e042a42-7cc2-4d72-b7ed-2b80339f2c85" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:40:43 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 01:40:43 user nova-compute[71498]: DEBUG nova.compute.manager [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 01:40:43 user nova-compute[71498]: DEBUG nova.network.neutron [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:40:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:40:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:40:43 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:40:43 user nova-compute[71498]: INFO nova.compute.claims [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Claim successful on node user
Apr 14 01:40:43 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 01:40:43 user nova-compute[71498]: DEBUG nova.compute.manager [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 01:40:43 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:40:43 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:40:43 user nova-compute[71498]: DEBUG nova.compute.manager [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 01:40:43 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:40:43 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Creating image(s)
Apr 14 01:40:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "/opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:40:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "/opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:40:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "/opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:40:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:40:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:40:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.288s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:40:43 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 01:40:43 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 01:40:43 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:40:43 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 01:40:43 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 01:40:44 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 01:40:44 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:40:44 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Creating image(s)
Apr 14 01:40:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "/opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:40:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "/opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:40:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "/opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:40:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:40:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab.part --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:40:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab.part --force-share --output=json" returned: 0 in 0.151s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:40:44 user nova-compute[71498]: DEBUG nova.virt.images [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] b1bc26f9-63fb-4bff-8f72-f1e49544441d was qcow2, converting to raw {{(pid=71498) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 01:40:44 user nova-compute[71498]: DEBUG nova.privsep.utils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71498) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 01:40:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab.part /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab.converted {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:40:44 user nova-compute[71498]: DEBUG nova.policy [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:40:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab.part /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab.converted" returned: 0 in 0.257s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:40:44 user nova-compute[71498]: DEBUG nova.policy [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '236828e284154097a25f59eaedf47c29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907f632263e04bf2a6c8ff1bae77a5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:40:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab.converted --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:40:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab.converted --force-share --output=json" returned: 0 in 0.123s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:40:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.082s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:40:44 user nova-compute[71498]: INFO oslo.privsep.daemon [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmppfwslynr/privsep.sock']
Apr 14 01:40:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.826s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:40:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:40:44 user sudo[80224]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmppfwslynr/privsep.sock
Apr 14 01:40:44 user sudo[80224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 14 01:40:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Acquiring lock "039d0702-d115-4c25-ab88-d669c6320820" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:40:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "039d0702-d115-4c25-ab88-d669c6320820" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:40:46 user sudo[80224]: pam_unix(sudo:session): session closed for user root
Apr 14 01:40:46 user nova-compute[71498]: INFO oslo.privsep.daemon [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Spawned new privsep daemon via rootwrap
Apr 14 01:40:46 user nova-compute[71498]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 14 01:40:46 user nova-compute[71498]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 14 01:40:46 user nova-compute[71498]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 14 01:40:46 user nova-compute[71498]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80234
Apr 14 01:40:46 user nova-compute[71498]: WARNING oslo_privsep.priv_context [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] privsep daemon already running
Apr 14 01:40:46 user nova-compute[71498]: DEBUG nova.compute.manager [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 01:40:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:40:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:40:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:40:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:40:46 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:40:46 user nova-compute[71498]: INFO nova.compute.claims [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Claim successful on node user
Apr 14 01:40:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.130s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:40:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:40:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:40:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:40:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.143s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:40:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:40:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.130s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:40:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk 1073741824" returned: 0 in 0.050s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.181s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.176s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG nova.compute.manager [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.191s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk 1073741824" returned: 0 in 0.047s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG nova.compute.manager [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG nova.network.neutron [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Cannot resize image /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG nova.objects.instance [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lazy-loading 'migration_context' on Instance uuid 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:40:47 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 01:40:47 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Ensure instance console log exists: /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG nova.compute.manager [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.168s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Checking if we can resize image /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG nova.compute.manager [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:40:47 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Creating image(s)
Apr 14 01:40:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Acquiring lock "/opt/stack/data/nova/instances/039d0702-d115-4c25-ab88-d669c6320820/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "/opt/stack/data/nova/instances/039d0702-d115-4c25-ab88-d669c6320820/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "/opt/stack/data/nova/instances/039d0702-d115-4c25-ab88-d669c6320820/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Cannot resize image /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG nova.objects.instance [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lazy-loading 'migration_context' on Instance uuid da60f4f1-2474-453f-8f84-c95daf02431a {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Ensure instance console log exists: /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.154s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG nova.policy [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2fae797718f548fba18e7bc01829f489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50fbd5c190254145815a39079b57881c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.148s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:40:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/039d0702-d115-4c25-ab88-d669c6320820/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:40:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/039d0702-d115-4c25-ab88-d669c6320820/disk 1073741824" returned: 0 in 0.098s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:40:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:40:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:40:48 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Successfully created port: ed749832-992f-44d3-8316-87f59088b737 {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:40:48 user nova-compute[71498]: DEBUG nova.network.neutron [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Successfully created port: b8356c3e-ccfb-44ae-8020-af80bcb28a43 {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:40:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.134s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:40:48 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Checking if we can resize image /opt/stack/data/nova/instances/039d0702-d115-4c25-ab88-d669c6320820/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 01:40:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/039d0702-d115-4c25-ab88-d669c6320820/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:40:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/039d0702-d115-4c25-ab88-d669c6320820/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:40:48 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Cannot resize image /opt/stack/data/nova/instances/039d0702-d115-4c25-ab88-d669c6320820/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 01:40:48 user nova-compute[71498]: DEBUG nova.objects.instance [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lazy-loading 'migration_context' on Instance uuid 039d0702-d115-4c25-ab88-d669c6320820 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:40:48 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 01:40:48 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Ensure instance console log exists: /opt/stack/data/nova/instances/039d0702-d115-4c25-ab88-d669c6320820/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:40:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:40:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:40:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:40:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:40:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:40:50 user nova-compute[71498]: DEBUG nova.compute.manager [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 01:40:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:40:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:40:50 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:40:50 user nova-compute[71498]: INFO nova.compute.claims [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Claim successful on node user
Apr 14 01:40:51 user nova-compute[71498]: DEBUG nova.network.neutron [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Successfully created port: 5b6ccf71-1fe5-4324-a31c-f530be337523 {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:40:51 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:40:51 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:40:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.356s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:40:51 user nova-compute[71498]: DEBUG nova.compute.manager [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 01:40:51 user nova-compute[71498]: DEBUG nova.compute.manager [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 01:40:51 user nova-compute[71498]: DEBUG nova.network.neutron [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:40:51 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 01:40:51 user nova-compute[71498]: DEBUG nova.compute.manager [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 01:40:51 user nova-compute[71498]: DEBUG nova.compute.manager [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 01:40:51 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:40:51 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Creating image(s)
Apr 14 01:40:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:40:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "/opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:40:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "/opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:40:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:40:51 user nova-compute[71498]: DEBUG nova.policy [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f09ab986a00f43b384cf5d517857a13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4833ddea1fa74866b97ef52a730605aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:40:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.136s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:40:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:40:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:40:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:40:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.140s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:40:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:40:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk 1073741824" returned: 0 in 0.042s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:40:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.186s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:40:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:40:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.132s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:40:52 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 01:40:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:40:52 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Successfully updated port: ed749832-992f-44d3-8316-87f59088b737 {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:40:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "refresh_cache-8e042a42-7cc2-4d72-b7ed-2b80339f2c85" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:40:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquired lock "refresh_cache-8e042a42-7cc2-4d72-b7ed-2b80339f2c85" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:40:52 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:40:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:40:52 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Cannot resize image /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 01:40:52 user nova-compute[71498]: DEBUG nova.objects.instance [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lazy-loading 'migration_context' on Instance uuid 3a3fb53f-7b4a-48d3-85ab-418bad435c07 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:40:52 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 01:40:52 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Ensure instance console log exists: /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:40:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:40:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:40:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:40:52 user nova-compute[71498]: DEBUG nova.network.neutron [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Successfully updated port: b8356c3e-ccfb-44ae-8020-af80bcb28a43 {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:40:52 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:40:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "refresh_cache-da60f4f1-2474-453f-8f84-c95daf02431a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:40:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquired lock "refresh_cache-da60f4f1-2474-453f-8f84-c95daf02431a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:40:52 user nova-compute[71498]: DEBUG nova.network.neutron [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:40:52 user nova-compute[71498]: DEBUG nova.network.neutron [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:40:52 user nova-compute[71498]: DEBUG nova.compute.manager [req-52a16739-9081-4bbd-91b2-5eeef428e40b req-cd93fdd6-4d84-4962-ad54-7d10b736602c service nova] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Received event network-changed-ed749832-992f-44d3-8316-87f59088b737 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:40:52 user nova-compute[71498]: DEBUG nova.compute.manager [req-52a16739-9081-4bbd-91b2-5eeef428e40b req-cd93fdd6-4d84-4962-ad54-7d10b736602c service nova] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Refreshing instance network info cache due to event network-changed-ed749832-992f-44d3-8316-87f59088b737. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:40:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-52a16739-9081-4bbd-91b2-5eeef428e40b req-cd93fdd6-4d84-4962-ad54-7d10b736602c service nova] Acquiring lock "refresh_cache-8e042a42-7cc2-4d72-b7ed-2b80339f2c85" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Updating instance_info_cache with network_info: [{"id": "ed749832-992f-44d3-8316-87f59088b737", "address": "fa:16:3e:98:9d:2e", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped749832-99", "ovs_interfaceid": "ed749832-992f-44d3-8316-87f59088b737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Releasing lock "refresh_cache-8e042a42-7cc2-4d72-b7ed-2b80339f2c85" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Instance network_info: |[{"id": "ed749832-992f-44d3-8316-87f59088b737", "address": "fa:16:3e:98:9d:2e", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped749832-99", "ovs_interfaceid": "ed749832-992f-44d3-8316-87f59088b737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-52a16739-9081-4bbd-91b2-5eeef428e40b req-cd93fdd6-4d84-4962-ad54-7d10b736602c service nova] Acquired lock "refresh_cache-8e042a42-7cc2-4d72-b7ed-2b80339f2c85" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG nova.network.neutron [req-52a16739-9081-4bbd-91b2-5eeef428e40b req-cd93fdd6-4d84-4962-ad54-7d10b736602c service nova] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Refreshing network info cache for port ed749832-992f-44d3-8316-87f59088b737 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Start _get_guest_xml network_info=[{"id": "ed749832-992f-44d3-8316-87f59088b737", "address": "fa:16:3e:98:9d:2e", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped749832-99", "ovs_interfaceid": "ed749832-992f-44d3-8316-87f59088b737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:40:53 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:40:53 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:40:53 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG nova.privsep.utils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71498) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:40:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2013173860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2013173860',id=2,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='219c39c8299e46368012a947fdfbe5fd',ramdisk_id='',reservation_id='r-zu419vy4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-85797606',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:40:44Z,user_data=None,user_id='7ed01a83531f4c6bb18a4593284baf05',uuid=8e042a42-7cc2-4d72-b7ed-2b80339f2c85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed749832-992f-44d3-8316-87f59088b737", "address": "fa:16:3e:98:9d:2e", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped749832-99", "ovs_interfaceid": "ed749832-992f-44d3-8316-87f59088b737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Converting VIF {"id": "ed749832-992f-44d3-8316-87f59088b737", "address": "fa:16:3e:98:9d:2e", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped749832-99", "ovs_interfaceid": "ed749832-992f-44d3-8316-87f59088b737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:9d:2e,bridge_name='br-int',has_traffic_filtering=True,id=ed749832-992f-44d3-8316-87f59088b737,network=Network(365cbeec-3756-4258-a135-04112bdda4b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped749832-99') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG nova.objects.instance [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:40:53 user nova-compute[71498]:   <uuid>8e042a42-7cc2-4d72-b7ed-2b80339f2c85</uuid>
Apr 14 01:40:53 user nova-compute[71498]:   <name>instance-00000002</name>
Apr 14 01:40:53 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:40:53 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:40:53 user nova-compute[71498]:   <metadata>
Apr 14 01:40:53 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:40:53 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:40:53 user nova-compute[71498]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2013173860</nova:name>
Apr 14 01:40:53 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:40:53</nova:creationTime>
Apr 14 01:40:53 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:40:53 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:40:53 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:40:53 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:40:53 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:40:53 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:40:53 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:40:53 user nova-compute[71498]:       <nova:owner>
Apr 14 01:40:53 user nova-compute[71498]:         <nova:user uuid="7ed01a83531f4c6bb18a4593284baf05">tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member</nova:user>
Apr 14 01:40:53 user nova-compute[71498]:         <nova:project uuid="219c39c8299e46368012a947fdfbe5fd">tempest-ServerBootFromVolumeStableRescueTest-85797606</nova:project>
Apr 14 01:40:53 user nova-compute[71498]:       </nova:owner>
Apr 14 01:40:53 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:40:53 user nova-compute[71498]:       <nova:ports>
Apr 14 01:40:53 user nova-compute[71498]:         <nova:port uuid="ed749832-992f-44d3-8316-87f59088b737">
Apr 14 01:40:53 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 01:40:53 user nova-compute[71498]:         </nova:port>
Apr 14 01:40:53 user nova-compute[71498]:       </nova:ports>
Apr 14 01:40:53 user nova-compute[71498]:     </nova:instance>
Apr 14 01:40:53 user nova-compute[71498]:   </metadata>
Apr 14 01:40:53 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:40:53 user nova-compute[71498]:     <system>
Apr 14 01:40:53 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:40:53 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:40:53 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:40:53 user nova-compute[71498]:       <entry name="serial">8e042a42-7cc2-4d72-b7ed-2b80339f2c85</entry>
Apr 14 01:40:53 user nova-compute[71498]:       <entry name="uuid">8e042a42-7cc2-4d72-b7ed-2b80339f2c85</entry>
Apr 14 01:40:53 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:40:53 user nova-compute[71498]:     </system>
Apr 14 01:40:53 user nova-compute[71498]:   </sysinfo>
Apr 14 01:40:53 user nova-compute[71498]:   <os>
Apr 14 01:40:53 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:40:53 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:40:53 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:40:53 user nova-compute[71498]:   </os>
Apr 14 01:40:53 user nova-compute[71498]:   <features>
Apr 14 01:40:53 user nova-compute[71498]:     <acpi/>
Apr 14 01:40:53 user nova-compute[71498]:     <apic/>
Apr 14 01:40:53 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:40:53 user nova-compute[71498]:   </features>
Apr 14 01:40:53 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:40:53 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:40:53 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:40:53 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:40:53 user nova-compute[71498]:   </clock>
Apr 14 01:40:53 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:40:53 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:40:53 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:40:53 user nova-compute[71498]:   </cpu>
Apr 14 01:40:53 user nova-compute[71498]:   <devices>
Apr 14 01:40:53 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:40:53 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:40:53 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk"/>
Apr 14 01:40:53 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:40:53 user nova-compute[71498]:     </disk>
Apr 14 01:40:53 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:40:53 user nova-compute[71498]:       <mac address="fa:16:3e:98:9d:2e"/>
Apr 14 01:40:53 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:40:53 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:40:53 user nova-compute[71498]:       <target dev="taped749832-99"/>
Apr 14 01:40:53 user nova-compute[71498]:     </interface>
Apr 14 01:40:53 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:40:53 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/console.log" append="off"/>
Apr 14 01:40:53 user nova-compute[71498]:     </serial>
Apr 14 01:40:53 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:40:53 user nova-compute[71498]:     <video>
Apr 14 01:40:53 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:40:53 user nova-compute[71498]:     </video>
Apr 14 01:40:53 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:40:53 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:40:53 user nova-compute[71498]:     </rng>
Apr 14 01:40:53 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:40:53 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:40:53 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:40:53 user nova-compute[71498]:     </memballoon>
Apr 14 01:40:53 user nova-compute[71498]:   </devices>
Apr 14 01:40:53 user nova-compute[71498]: </domain>
Apr 14 01:40:53 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:40:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2013173860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2013173860',id=2,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='219c39c8299e46368012a947fdfbe5fd',ramdisk_id='',reservation_id='r-zu419vy4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-85797606',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:40:44Z,user_data=None,user_id='7ed01a83531f4c6bb18a4593284baf05',uuid=8e042a42-7cc2-4d72-b7ed-2b80339f2c85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed749832-992f-44d3-8316-87f59088b737", "address": "fa:16:3e:98:9d:2e", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped749832-99", "ovs_interfaceid": "ed749832-992f-44d3-8316-87f59088b737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Converting VIF {"id": "ed749832-992f-44d3-8316-87f59088b737", "address": "fa:16:3e:98:9d:2e", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped749832-99", "ovs_interfaceid": "ed749832-992f-44d3-8316-87f59088b737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:9d:2e,bridge_name='br-int',has_traffic_filtering=True,id=ed749832-992f-44d3-8316-87f59088b737,network=Network(365cbeec-3756-4258-a135-04112bdda4b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped749832-99') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG os_vif [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:9d:2e,bridge_name='br-int',has_traffic_filtering=True,id=ed749832-992f-44d3-8316-87f59088b737,network=Network(365cbeec-3756-4258-a135-04112bdda4b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped749832-99') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Created schema index Interface.name {{(pid=71498) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Created schema index Port.name {{(pid=71498) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Created schema index Bridge.name {{(pid=71498) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [POLLOUT] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:40:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:40:53 user nova-compute[71498]: INFO oslo.privsep.daemon [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp68c2206n/privsep.sock']
Apr 14 01:40:53 user sudo[80305]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp68c2206n/privsep.sock
Apr 14 01:40:53 user sudo[80305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 14 01:40:54 user nova-compute[71498]: DEBUG nova.network.neutron [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Successfully created port: 7942720d-0958-4826-bedf-0a7eebfe45b6 {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG nova.network.neutron [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Updating instance_info_cache with network_info: [{"id": "b8356c3e-ccfb-44ae-8020-af80bcb28a43", "address": "fa:16:3e:ad:43:af", "network": {"id": "93155729-11d3-4eff-bbd2-8860a881e233", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047423124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "907f632263e04bf2a6c8ff1bae77a5c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8356c3e-cc", "ovs_interfaceid": "b8356c3e-ccfb-44ae-8020-af80bcb28a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Releasing lock "refresh_cache-da60f4f1-2474-453f-8f84-c95daf02431a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG nova.compute.manager [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Instance network_info: |[{"id": "b8356c3e-ccfb-44ae-8020-af80bcb28a43", "address": "fa:16:3e:ad:43:af", "network": {"id": "93155729-11d3-4eff-bbd2-8860a881e233", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047423124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "907f632263e04bf2a6c8ff1bae77a5c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8356c3e-cc", "ovs_interfaceid": "b8356c3e-ccfb-44ae-8020-af80bcb28a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Start _get_guest_xml network_info=[{"id": "b8356c3e-ccfb-44ae-8020-af80bcb28a43", "address": "fa:16:3e:ad:43:af", "network": {"id": "93155729-11d3-4eff-bbd2-8860a881e233", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047423124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "907f632263e04bf2a6c8ff1bae77a5c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8356c3e-cc", "ovs_interfaceid": "b8356c3e-ccfb-44ae-8020-af80bcb28a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:40:54 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:40:54 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:40:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:40:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-107707434',display_name='tempest-ServersNegativeTestJSON-server-107707434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-107707434',id=1,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='907f632263e04bf2a6c8ff1bae77a5c7',ramdisk_id='',reservation_id='r-bai38l24',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1259366012',owner_user_name='tempest-ServersNegativeTestJSON-1259366012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:40:44Z,user_data=None,user_id='236828e284154097a25f59eaedf47c29',uuid=da60f4f1-2474-453f-8f84-c95daf02431a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8356c3e-ccfb-44ae-8020-af80bcb28a43", "address": "fa:16:3e:ad:43:af", "network": {"id": "93155729-11d3-4eff-bbd2-8860a881e233", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047423124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "907f632263e04bf2a6c8ff1bae77a5c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8356c3e-cc", "ovs_interfaceid": "b8356c3e-ccfb-44ae-8020-af80bcb28a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Converting VIF {"id": "b8356c3e-ccfb-44ae-8020-af80bcb28a43", "address": "fa:16:3e:ad:43:af", "network": {"id": "93155729-11d3-4eff-bbd2-8860a881e233", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047423124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "907f632263e04bf2a6c8ff1bae77a5c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8356c3e-cc", "ovs_interfaceid": "b8356c3e-ccfb-44ae-8020-af80bcb28a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:43:af,bridge_name='br-int',has_traffic_filtering=True,id=b8356c3e-ccfb-44ae-8020-af80bcb28a43,network=Network(93155729-11d3-4eff-bbd2-8860a881e233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8356c3e-cc') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG nova.objects.instance [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lazy-loading 'pci_devices' on Instance uuid da60f4f1-2474-453f-8f84-c95daf02431a {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:40:54 user nova-compute[71498]:   <uuid>da60f4f1-2474-453f-8f84-c95daf02431a</uuid>
Apr 14 01:40:54 user nova-compute[71498]:   <name>instance-00000001</name>
Apr 14 01:40:54 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:40:54 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:40:54 user nova-compute[71498]:   <metadata>
Apr 14 01:40:54 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:40:54 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:40:54 user nova-compute[71498]:       <nova:name>tempest-ServersNegativeTestJSON-server-107707434</nova:name>
Apr 14 01:40:54 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:40:54</nova:creationTime>
Apr 14 01:40:54 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:40:54 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:40:54 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:40:54 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:40:54 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:40:54 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:40:54 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:40:54 user nova-compute[71498]:       <nova:owner>
Apr 14 01:40:54 user nova-compute[71498]:         <nova:user uuid="236828e284154097a25f59eaedf47c29">tempest-ServersNegativeTestJSON-1259366012-project-member</nova:user>
Apr 14 01:40:54 user nova-compute[71498]:         <nova:project uuid="907f632263e04bf2a6c8ff1bae77a5c7">tempest-ServersNegativeTestJSON-1259366012</nova:project>
Apr 14 01:40:54 user nova-compute[71498]:       </nova:owner>
Apr 14 01:40:54 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:40:54 user nova-compute[71498]:       <nova:ports>
Apr 14 01:40:54 user nova-compute[71498]:         <nova:port uuid="b8356c3e-ccfb-44ae-8020-af80bcb28a43">
Apr 14 01:40:54 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 01:40:54 user nova-compute[71498]:         </nova:port>
Apr 14 01:40:54 user nova-compute[71498]:       </nova:ports>
Apr 14 01:40:54 user nova-compute[71498]:     </nova:instance>
Apr 14 01:40:54 user nova-compute[71498]:   </metadata>
Apr 14 01:40:54 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:40:54 user nova-compute[71498]:     <system>
Apr 14 01:40:54 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:40:54 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:40:54 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:40:54 user nova-compute[71498]:       <entry name="serial">da60f4f1-2474-453f-8f84-c95daf02431a</entry>
Apr 14 01:40:54 user nova-compute[71498]:       <entry name="uuid">da60f4f1-2474-453f-8f84-c95daf02431a</entry>
Apr 14 01:40:54 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:40:54 user nova-compute[71498]:     </system>
Apr 14 01:40:54 user nova-compute[71498]:   </sysinfo>
Apr 14 01:40:54 user nova-compute[71498]:   <os>
Apr 14 01:40:54 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:40:54 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:40:54 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:40:54 user nova-compute[71498]:   </os>
Apr 14 01:40:54 user nova-compute[71498]:   <features>
Apr 14 01:40:54 user nova-compute[71498]:     <acpi/>
Apr 14 01:40:54 user nova-compute[71498]:     <apic/>
Apr 14 01:40:54 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:40:54 user nova-compute[71498]:   </features>
Apr 14 01:40:54 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:40:54 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:40:54 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:40:54 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:40:54 user nova-compute[71498]:   </clock>
Apr 14 01:40:54 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:40:54 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:40:54 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:40:54 user nova-compute[71498]:   </cpu>
Apr 14 01:40:54 user nova-compute[71498]:   <devices>
Apr 14 01:40:54 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:40:54 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:40:54 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk"/>
Apr 14 01:40:54 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:40:54 user nova-compute[71498]:     </disk>
Apr 14 01:40:54 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:40:54 user nova-compute[71498]:       <mac address="fa:16:3e:ad:43:af"/>
Apr 14 01:40:54 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:40:54 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:40:54 user nova-compute[71498]:       <target dev="tapb8356c3e-cc"/>
Apr 14 01:40:54 user nova-compute[71498]:     </interface>
Apr 14 01:40:54 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:40:54 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/console.log" append="off"/>
Apr 14 01:40:54 user nova-compute[71498]:     </serial>
Apr 14 01:40:54 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:40:54 user nova-compute[71498]:     <video>
Apr 14 01:40:54 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:40:54 user nova-compute[71498]:     </video>
Apr 14 01:40:54 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:40:54 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:40:54 user nova-compute[71498]:     </rng>
Apr 14 01:40:54 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:40:54 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:40:54 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:40:54 user nova-compute[71498]:     </memballoon>
Apr 14 01:40:54 user nova-compute[71498]:   </devices>
Apr 14 01:40:54 user nova-compute[71498]: </domain>
Apr 14 01:40:54 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:40:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-107707434',display_name='tempest-ServersNegativeTestJSON-server-107707434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-107707434',id=1,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='907f632263e04bf2a6c8ff1bae77a5c7',ramdisk_id='',reservation_id='r-bai38l24',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1259366012',owner_user_name='tempest-ServersNegativeTestJSON-1259366012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:40:44Z,user_data=None,user_id='236828e284154097a25f59eaedf47c29',uuid=da60f4f1-2474-453f-8f84-c95daf02431a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8356c3e-ccfb-44ae-8020-af80bcb28a43", "address": "fa:16:3e:ad:43:af", "network": {"id": "93155729-11d3-4eff-bbd2-8860a881e233", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047423124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "907f632263e04bf2a6c8ff1bae77a5c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8356c3e-cc", "ovs_interfaceid": "b8356c3e-ccfb-44ae-8020-af80bcb28a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Converting VIF {"id": "b8356c3e-ccfb-44ae-8020-af80bcb28a43", "address": "fa:16:3e:ad:43:af", "network": {"id": "93155729-11d3-4eff-bbd2-8860a881e233", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047423124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "907f632263e04bf2a6c8ff1bae77a5c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8356c3e-cc", "ovs_interfaceid": "b8356c3e-ccfb-44ae-8020-af80bcb28a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:43:af,bridge_name='br-int',has_traffic_filtering=True,id=b8356c3e-ccfb-44ae-8020-af80bcb28a43,network=Network(93155729-11d3-4eff-bbd2-8860a881e233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8356c3e-cc') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG os_vif [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:43:af,bridge_name='br-int',has_traffic_filtering=True,id=b8356c3e-ccfb-44ae-8020-af80bcb28a43,network=Network(93155729-11d3-4eff-bbd2-8860a881e233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8356c3e-cc') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG nova.network.neutron [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Successfully updated port: 5b6ccf71-1fe5-4324-a31c-f530be337523 {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Acquiring lock "refresh_cache-039d0702-d115-4c25-ab88-d669c6320820" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Acquired lock "refresh_cache-039d0702-d115-4c25-ab88-d669c6320820" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG nova.network.neutron [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG nova.compute.manager [req-d674b999-2343-4b74-96a2-57e60aa2ad5b req-4f6c584d-7a58-43b1-915e-9ba7598f5c2a service nova] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Received event network-changed-b8356c3e-ccfb-44ae-8020-af80bcb28a43 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG nova.compute.manager [req-d674b999-2343-4b74-96a2-57e60aa2ad5b req-4f6c584d-7a58-43b1-915e-9ba7598f5c2a service nova] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Refreshing instance network info cache due to event network-changed-b8356c3e-ccfb-44ae-8020-af80bcb28a43. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d674b999-2343-4b74-96a2-57e60aa2ad5b req-4f6c584d-7a58-43b1-915e-9ba7598f5c2a service nova] Acquiring lock "refresh_cache-da60f4f1-2474-453f-8f84-c95daf02431a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d674b999-2343-4b74-96a2-57e60aa2ad5b req-4f6c584d-7a58-43b1-915e-9ba7598f5c2a service nova] Acquired lock "refresh_cache-da60f4f1-2474-453f-8f84-c95daf02431a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG nova.network.neutron [req-d674b999-2343-4b74-96a2-57e60aa2ad5b req-4f6c584d-7a58-43b1-915e-9ba7598f5c2a service nova] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Refreshing network info cache for port b8356c3e-ccfb-44ae-8020-af80bcb28a43 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:40:54 user nova-compute[71498]: DEBUG nova.network.neutron [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:40:55 user nova-compute[71498]: DEBUG nova.network.neutron [req-52a16739-9081-4bbd-91b2-5eeef428e40b req-cd93fdd6-4d84-4962-ad54-7d10b736602c service nova] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Updated VIF entry in instance network info cache for port ed749832-992f-44d3-8316-87f59088b737. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:40:55 user nova-compute[71498]: DEBUG nova.network.neutron [req-52a16739-9081-4bbd-91b2-5eeef428e40b req-cd93fdd6-4d84-4962-ad54-7d10b736602c service nova] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Updating instance_info_cache with network_info: [{"id": "ed749832-992f-44d3-8316-87f59088b737", "address": "fa:16:3e:98:9d:2e", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped749832-99", "ovs_interfaceid": "ed749832-992f-44d3-8316-87f59088b737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:40:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-52a16739-9081-4bbd-91b2-5eeef428e40b req-cd93fdd6-4d84-4962-ad54-7d10b736602c service nova] Releasing lock "refresh_cache-8e042a42-7cc2-4d72-b7ed-2b80339f2c85" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:40:55 user sudo[80305]: pam_unix(sudo:session): session closed for user root
Apr 14 01:40:55 user nova-compute[71498]: INFO oslo.privsep.daemon [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Spawned new privsep daemon via rootwrap
Apr 14 01:40:55 user nova-compute[71498]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 14 01:40:55 user nova-compute[71498]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 14 01:40:55 user nova-compute[71498]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Apr 14 01:40:55 user nova-compute[71498]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80308
Apr 14 01:40:55 user nova-compute[71498]: WARNING oslo_privsep.priv_context [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] privsep daemon already running
Apr 14 01:40:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped749832-99, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=taped749832-99, col_values=(('external_ids', {'iface-id': 'ed749832-992f-44d3-8316-87f59088b737', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:9d:2e', 'vm-uuid': '8e042a42-7cc2-4d72-b7ed-2b80339f2c85'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:40:56 user nova-compute[71498]: INFO os_vif [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:9d:2e,bridge_name='br-int',has_traffic_filtering=True,id=ed749832-992f-44d3-8316-87f59088b737,network=Network(365cbeec-3756-4258-a135-04112bdda4b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped749832-99')
Apr 14 01:40:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8356c3e-cc, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb8356c3e-cc, col_values=(('external_ids', {'iface-id': 'b8356c3e-ccfb-44ae-8020-af80bcb28a43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:43:af', 'vm-uuid': 'da60f4f1-2474-453f-8f84-c95daf02431a'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:40:56 user nova-compute[71498]: INFO os_vif [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:43:af,bridge_name='br-int',has_traffic_filtering=True,id=b8356c3e-ccfb-44ae-8020-af80bcb28a43,network=Network(93155729-11d3-4eff-bbd2-8860a881e233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8356c3e-cc')
Apr 14 01:40:56 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] No VIF found with MAC fa:16:3e:98:9d:2e, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] No VIF found with MAC fa:16:3e:ad:43:af, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG nova.network.neutron [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Updating instance_info_cache with network_info: [{"id": "5b6ccf71-1fe5-4324-a31c-f530be337523", "address": "fa:16:3e:84:ba:f4", "network": {"id": "fc6463bc-9492-414e-930d-3c5dc5ae31a0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-58429192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50fbd5c190254145815a39079b57881c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b6ccf71-1f", "ovs_interfaceid": "5b6ccf71-1fe5-4324-a31c-f530be337523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Releasing lock "refresh_cache-039d0702-d115-4c25-ab88-d669c6320820" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG nova.compute.manager [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Instance network_info: |[{"id": "5b6ccf71-1fe5-4324-a31c-f530be337523", "address": "fa:16:3e:84:ba:f4", "network": {"id": "fc6463bc-9492-414e-930d-3c5dc5ae31a0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-58429192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50fbd5c190254145815a39079b57881c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b6ccf71-1f", "ovs_interfaceid": "5b6ccf71-1fe5-4324-a31c-f530be337523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Start _get_guest_xml network_info=[{"id": "5b6ccf71-1fe5-4324-a31c-f530be337523", "address": "fa:16:3e:84:ba:f4", "network": {"id": "fc6463bc-9492-414e-930d-3c5dc5ae31a0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-58429192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50fbd5c190254145815a39079b57881c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b6ccf71-1f", "ovs_interfaceid": "5b6ccf71-1fe5-4324-a31c-f530be337523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:40:56 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:40:56 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:40:56 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:40:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1756590565',display_name='tempest-DeleteServersTestJSON-server-1756590565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1756590565',id=3,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50fbd5c190254145815a39079b57881c',ramdisk_id='',reservation_id='r-0q5kkt30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1374716489',owner_user_name='tempest-DeleteServersTestJSON-1374716489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:40:47Z,user_data=None,user_id='2fae797718f548fba18e7bc01829f489',uuid=039d0702-d115-4c25-ab88-d669c6320820,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b6ccf71-1fe5-4324-a31c-f530be337523", "address": "fa:16:3e:84:ba:f4", "network": {"id": "fc6463bc-9492-414e-930d-3c5dc5ae31a0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-58429192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50fbd5c190254145815a39079b57881c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b6ccf71-1f", "ovs_interfaceid": "5b6ccf71-1fe5-4324-a31c-f530be337523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Converting VIF {"id": "5b6ccf71-1fe5-4324-a31c-f530be337523", "address": "fa:16:3e:84:ba:f4", "network": {"id": "fc6463bc-9492-414e-930d-3c5dc5ae31a0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-58429192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50fbd5c190254145815a39079b57881c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b6ccf71-1f", "ovs_interfaceid": "5b6ccf71-1fe5-4324-a31c-f530be337523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:ba:f4,bridge_name='br-int',has_traffic_filtering=True,id=5b6ccf71-1fe5-4324-a31c-f530be337523,network=Network(fc6463bc-9492-414e-930d-3c5dc5ae31a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b6ccf71-1f') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG nova.objects.instance [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lazy-loading 'pci_devices' on Instance uuid 039d0702-d115-4c25-ab88-d669c6320820 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:40:56 user nova-compute[71498]:   <uuid>039d0702-d115-4c25-ab88-d669c6320820</uuid>
Apr 14 01:40:56 user nova-compute[71498]:   <name>instance-00000003</name>
Apr 14 01:40:56 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:40:56 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:40:56 user nova-compute[71498]:   <metadata>
Apr 14 01:40:56 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:40:56 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:40:56 user nova-compute[71498]:       <nova:name>tempest-DeleteServersTestJSON-server-1756590565</nova:name>
Apr 14 01:40:56 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:40:56</nova:creationTime>
Apr 14 01:40:56 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:40:56 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:40:56 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:40:56 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:40:56 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:40:56 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:40:56 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:40:56 user nova-compute[71498]:       <nova:owner>
Apr 14 01:40:56 user nova-compute[71498]:         <nova:user uuid="2fae797718f548fba18e7bc01829f489">tempest-DeleteServersTestJSON-1374716489-project-member</nova:user>
Apr 14 01:40:56 user nova-compute[71498]:         <nova:project uuid="50fbd5c190254145815a39079b57881c">tempest-DeleteServersTestJSON-1374716489</nova:project>
Apr 14 01:40:56 user nova-compute[71498]:       </nova:owner>
Apr 14 01:40:56 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:40:56 user nova-compute[71498]:       <nova:ports>
Apr 14 01:40:56 user nova-compute[71498]:         <nova:port uuid="5b6ccf71-1fe5-4324-a31c-f530be337523">
Apr 14 01:40:56 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 01:40:56 user nova-compute[71498]:         </nova:port>
Apr 14 01:40:56 user nova-compute[71498]:       </nova:ports>
Apr 14 01:40:56 user nova-compute[71498]:     </nova:instance>
Apr 14 01:40:56 user nova-compute[71498]:   </metadata>
Apr 14 01:40:56 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:40:56 user nova-compute[71498]:     <system>
Apr 14 01:40:56 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:40:56 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:40:56 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:40:56 user nova-compute[71498]:       <entry name="serial">039d0702-d115-4c25-ab88-d669c6320820</entry>
Apr 14 01:40:56 user nova-compute[71498]:       <entry name="uuid">039d0702-d115-4c25-ab88-d669c6320820</entry>
Apr 14 01:40:56 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:40:56 user nova-compute[71498]:     </system>
Apr 14 01:40:56 user nova-compute[71498]:   </sysinfo>
Apr 14 01:40:56 user nova-compute[71498]:   <os>
Apr 14 01:40:56 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:40:56 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:40:56 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:40:56 user nova-compute[71498]:   </os>
Apr 14 01:40:56 user nova-compute[71498]:   <features>
Apr 14 01:40:56 user nova-compute[71498]:     <acpi/>
Apr 14 01:40:56 user nova-compute[71498]:     <apic/>
Apr 14 01:40:56 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:40:56 user nova-compute[71498]:   </features>
Apr 14 01:40:56 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:40:56 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:40:56 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:40:56 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:40:56 user nova-compute[71498]:   </clock>
Apr 14 01:40:56 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:40:56 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:40:56 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:40:56 user nova-compute[71498]:   </cpu>
Apr 14 01:40:56 user nova-compute[71498]:   <devices>
Apr 14 01:40:56 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:40:56 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:40:56 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/039d0702-d115-4c25-ab88-d669c6320820/disk"/>
Apr 14 01:40:56 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:40:56 user nova-compute[71498]:     </disk>
Apr 14 01:40:56 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:40:56 user nova-compute[71498]:       <mac address="fa:16:3e:84:ba:f4"/>
Apr 14 01:40:56 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:40:56 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:40:56 user nova-compute[71498]:       <target dev="tap5b6ccf71-1f"/>
Apr 14 01:40:56 user nova-compute[71498]:     </interface>
Apr 14 01:40:56 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:40:56 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/039d0702-d115-4c25-ab88-d669c6320820/console.log" append="off"/>
Apr 14 01:40:56 user nova-compute[71498]:     </serial>
Apr 14 01:40:56 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:40:56 user nova-compute[71498]:     <video>
Apr 14 01:40:56 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:40:56 user nova-compute[71498]:     </video>
Apr 14 01:40:56 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:40:56 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:40:56 user nova-compute[71498]:     </rng>
Apr 14 01:40:56 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:40:56 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:40:56 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:40:56 user nova-compute[71498]:     </memballoon>
Apr 14 01:40:56 user nova-compute[71498]:   </devices>
Apr 14 01:40:56 user nova-compute[71498]: </domain>
Apr 14 01:40:56 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:40:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1756590565',display_name='tempest-DeleteServersTestJSON-server-1756590565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1756590565',id=3,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50fbd5c190254145815a39079b57881c',ramdisk_id='',reservation_id='r-0q5kkt30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1374716489',owner_user_name='tempest-DeleteServersTestJSON-1374716489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:40:47Z,user_data=None,user_id='2fae797718f548fba18e7bc01829f489',uuid=039d0702-d115-4c25-ab88-d669c6320820,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b6ccf71-1fe5-4324-a31c-f530be337523", "address": "fa:16:3e:84:ba:f4", "network": {"id": "fc6463bc-9492-414e-930d-3c5dc5ae31a0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-58429192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50fbd5c190254145815a39079b57881c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b6ccf71-1f", "ovs_interfaceid": "5b6ccf71-1fe5-4324-a31c-f530be337523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Converting VIF {"id": "5b6ccf71-1fe5-4324-a31c-f530be337523", "address": "fa:16:3e:84:ba:f4", "network": {"id": "fc6463bc-9492-414e-930d-3c5dc5ae31a0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-58429192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50fbd5c190254145815a39079b57881c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b6ccf71-1f", "ovs_interfaceid": "5b6ccf71-1fe5-4324-a31c-f530be337523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:ba:f4,bridge_name='br-int',has_traffic_filtering=True,id=5b6ccf71-1fe5-4324-a31c-f530be337523,network=Network(fc6463bc-9492-414e-930d-3c5dc5ae31a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b6ccf71-1f') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG os_vif [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:ba:f4,bridge_name='br-int',has_traffic_filtering=True,id=5b6ccf71-1fe5-4324-a31c-f530be337523,network=Network(fc6463bc-9492-414e-930d-3c5dc5ae31a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b6ccf71-1f') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b6ccf71-1f, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5b6ccf71-1f, col_values=(('external_ids', {'iface-id': '5b6ccf71-1fe5-4324-a31c-f530be337523', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:ba:f4', 'vm-uuid': '039d0702-d115-4c25-ab88-d669c6320820'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:40:56 user nova-compute[71498]: INFO os_vif [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:ba:f4,bridge_name='br-int',has_traffic_filtering=True,id=5b6ccf71-1fe5-4324-a31c-f530be337523,network=Network(fc6463bc-9492-414e-930d-3c5dc5ae31a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b6ccf71-1f')
Apr 14 01:40:56 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] No VIF found with MAC fa:16:3e:84:ba:f4, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG nova.network.neutron [req-d674b999-2343-4b74-96a2-57e60aa2ad5b req-4f6c584d-7a58-43b1-915e-9ba7598f5c2a service nova] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Updated VIF entry in instance network info cache for port b8356c3e-ccfb-44ae-8020-af80bcb28a43. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG nova.network.neutron [req-d674b999-2343-4b74-96a2-57e60aa2ad5b req-4f6c584d-7a58-43b1-915e-9ba7598f5c2a service nova] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Updating instance_info_cache with network_info: [{"id": "b8356c3e-ccfb-44ae-8020-af80bcb28a43", "address": "fa:16:3e:ad:43:af", "network": {"id": "93155729-11d3-4eff-bbd2-8860a881e233", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047423124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "907f632263e04bf2a6c8ff1bae77a5c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8356c3e-cc", "ovs_interfaceid": "b8356c3e-ccfb-44ae-8020-af80bcb28a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d674b999-2343-4b74-96a2-57e60aa2ad5b req-4f6c584d-7a58-43b1-915e-9ba7598f5c2a service nova] Releasing lock "refresh_cache-da60f4f1-2474-453f-8f84-c95daf02431a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG nova.compute.manager [req-c87195be-6c1d-4d46-8755-d4551c393ddc req-90e8c302-11c8-4eba-b701-be69bc234893 service nova] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Received event network-changed-5b6ccf71-1fe5-4324-a31c-f530be337523 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG nova.compute.manager [req-c87195be-6c1d-4d46-8755-d4551c393ddc req-90e8c302-11c8-4eba-b701-be69bc234893 service nova] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Refreshing instance network info cache due to event network-changed-5b6ccf71-1fe5-4324-a31c-f530be337523. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c87195be-6c1d-4d46-8755-d4551c393ddc req-90e8c302-11c8-4eba-b701-be69bc234893 service nova] Acquiring lock "refresh_cache-039d0702-d115-4c25-ab88-d669c6320820" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c87195be-6c1d-4d46-8755-d4551c393ddc req-90e8c302-11c8-4eba-b701-be69bc234893 service nova] Acquired lock "refresh_cache-039d0702-d115-4c25-ab88-d669c6320820" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:40:56 user nova-compute[71498]: DEBUG nova.network.neutron [req-c87195be-6c1d-4d46-8755-d4551c393ddc req-90e8c302-11c8-4eba-b701-be69bc234893 service nova] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Refreshing network info cache for port 5b6ccf71-1fe5-4324-a31c-f530be337523 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:40:57 user nova-compute[71498]: DEBUG nova.network.neutron [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Successfully updated port: 7942720d-0958-4826-bedf-0a7eebfe45b6 {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:40:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "refresh_cache-3a3fb53f-7b4a-48d3-85ab-418bad435c07" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:40:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquired lock "refresh_cache-3a3fb53f-7b4a-48d3-85ab-418bad435c07" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:40:57 user nova-compute[71498]: DEBUG nova.network.neutron [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:40:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:40:57 user nova-compute[71498]: DEBUG nova.network.neutron [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:40:57 user nova-compute[71498]: DEBUG nova.compute.manager [req-945368c7-ebbd-4c6c-9df4-9806581c924d req-d0fce87b-6eb8-4b39-b8f6-ce9fd0a1449e service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Received event network-changed-7942720d-0958-4826-bedf-0a7eebfe45b6 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:40:57 user nova-compute[71498]: DEBUG nova.compute.manager [req-945368c7-ebbd-4c6c-9df4-9806581c924d req-d0fce87b-6eb8-4b39-b8f6-ce9fd0a1449e service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Refreshing instance network info cache due to event network-changed-7942720d-0958-4826-bedf-0a7eebfe45b6. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:40:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-945368c7-ebbd-4c6c-9df4-9806581c924d req-d0fce87b-6eb8-4b39-b8f6-ce9fd0a1449e service nova] Acquiring lock "refresh_cache-3a3fb53f-7b4a-48d3-85ab-418bad435c07" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG nova.network.neutron [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Updating instance_info_cache with network_info: [{"id": "7942720d-0958-4826-bedf-0a7eebfe45b6", "address": "fa:16:3e:0c:0e:df", "network": {"id": "95555a4e-9d95-4509-a683-f61ea2dc38a1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-560359898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4833ddea1fa74866b97ef52a730605aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7942720d-09", "ovs_interfaceid": "7942720d-0958-4826-bedf-0a7eebfe45b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Releasing lock "refresh_cache-3a3fb53f-7b4a-48d3-85ab-418bad435c07" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG nova.compute.manager [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Instance network_info: |[{"id": "7942720d-0958-4826-bedf-0a7eebfe45b6", "address": "fa:16:3e:0c:0e:df", "network": {"id": "95555a4e-9d95-4509-a683-f61ea2dc38a1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-560359898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4833ddea1fa74866b97ef52a730605aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7942720d-09", "ovs_interfaceid": "7942720d-0958-4826-bedf-0a7eebfe45b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-945368c7-ebbd-4c6c-9df4-9806581c924d req-d0fce87b-6eb8-4b39-b8f6-ce9fd0a1449e service nova] Acquired lock "refresh_cache-3a3fb53f-7b4a-48d3-85ab-418bad435c07" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG nova.network.neutron [req-945368c7-ebbd-4c6c-9df4-9806581c924d req-d0fce87b-6eb8-4b39-b8f6-ce9fd0a1449e service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Refreshing network info cache for port 7942720d-0958-4826-bedf-0a7eebfe45b6 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Start _get_guest_xml network_info=[{"id": "7942720d-0958-4826-bedf-0a7eebfe45b6", "address": "fa:16:3e:0c:0e:df", "network": {"id": "95555a4e-9d95-4509-a683-f61ea2dc38a1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-560359898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4833ddea1fa74866b97ef52a730605aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7942720d-09", "ovs_interfaceid": "7942720d-0958-4826-bedf-0a7eebfe45b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:40:58 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:40:58 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:40:58 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:40:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1267413302',display_name='tempest-ServerStableDeviceRescueTest-server-1267413302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1267413302',id=4,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClEbUZCS4BNpBa3d/c+E5gxA0W0UKOCjR2aXoCFkSjH1TtZ7VyBn5ergCTIl3tkCVYAq22i3BavCcYyS+Tyc9WpPRWr8ud0N+f5IiF1KOJhw1hKiESl8P8LoB9KVFwn9Q==',key_name='tempest-keypair-1599380679',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4833ddea1fa74866b97ef52a730605aa',ramdisk_id='',reservation_id='r-8cuxpjqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-131403183',owner_user_name='tempest-ServerStableDeviceRescueTest-131403183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:40:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f09ab986a00f43b384cf5d517857a13d',uuid=3a3fb53f-7b4a-48d3-85ab-418bad435c07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7942720d-0958-4826-bedf-0a7eebfe45b6", "address": "fa:16:3e:0c:0e:df", "network": {"id": "95555a4e-9d95-4509-a683-f61ea2dc38a1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-560359898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4833ddea1fa74866b97ef52a730605aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7942720d-09", "ovs_interfaceid": "7942720d-0958-4826-bedf-0a7eebfe45b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Converting VIF {"id": "7942720d-0958-4826-bedf-0a7eebfe45b6", "address": "fa:16:3e:0c:0e:df", "network": {"id": "95555a4e-9d95-4509-a683-f61ea2dc38a1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-560359898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4833ddea1fa74866b97ef52a730605aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7942720d-09", "ovs_interfaceid": "7942720d-0958-4826-bedf-0a7eebfe45b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:0e:df,bridge_name='br-int',has_traffic_filtering=True,id=7942720d-0958-4826-bedf-0a7eebfe45b6,network=Network(95555a4e-9d95-4509-a683-f61ea2dc38a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7942720d-09') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG nova.objects.instance [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a3fb53f-7b4a-48d3-85ab-418bad435c07 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:40:58 user nova-compute[71498]:   <uuid>3a3fb53f-7b4a-48d3-85ab-418bad435c07</uuid>
Apr 14 01:40:58 user nova-compute[71498]:   <name>instance-00000004</name>
Apr 14 01:40:58 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:40:58 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:40:58 user nova-compute[71498]:   <metadata>
Apr 14 01:40:58 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:40:58 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:40:58 user nova-compute[71498]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1267413302</nova:name>
Apr 14 01:40:58 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:40:58</nova:creationTime>
Apr 14 01:40:58 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:40:58 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:40:58 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:40:58 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:40:58 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:40:58 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:40:58 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:40:58 user nova-compute[71498]:       <nova:owner>
Apr 14 01:40:58 user nova-compute[71498]:         <nova:user uuid="f09ab986a00f43b384cf5d517857a13d">tempest-ServerStableDeviceRescueTest-131403183-project-member</nova:user>
Apr 14 01:40:58 user nova-compute[71498]:         <nova:project uuid="4833ddea1fa74866b97ef52a730605aa">tempest-ServerStableDeviceRescueTest-131403183</nova:project>
Apr 14 01:40:58 user nova-compute[71498]:       </nova:owner>
Apr 14 01:40:58 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:40:58 user nova-compute[71498]:       <nova:ports>
Apr 14 01:40:58 user nova-compute[71498]:         <nova:port uuid="7942720d-0958-4826-bedf-0a7eebfe45b6">
Apr 14 01:40:58 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 01:40:58 user nova-compute[71498]:         </nova:port>
Apr 14 01:40:58 user nova-compute[71498]:       </nova:ports>
Apr 14 01:40:58 user nova-compute[71498]:     </nova:instance>
Apr 14 01:40:58 user nova-compute[71498]:   </metadata>
Apr 14 01:40:58 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:40:58 user nova-compute[71498]:     <system>
Apr 14 01:40:58 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:40:58 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:40:58 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:40:58 user nova-compute[71498]:       <entry name="serial">3a3fb53f-7b4a-48d3-85ab-418bad435c07</entry>
Apr 14 01:40:58 user nova-compute[71498]:       <entry name="uuid">3a3fb53f-7b4a-48d3-85ab-418bad435c07</entry>
Apr 14 01:40:58 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:40:58 user nova-compute[71498]:     </system>
Apr 14 01:40:58 user nova-compute[71498]:   </sysinfo>
Apr 14 01:40:58 user nova-compute[71498]:   <os>
Apr 14 01:40:58 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:40:58 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:40:58 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:40:58 user nova-compute[71498]:   </os>
Apr 14 01:40:58 user nova-compute[71498]:   <features>
Apr 14 01:40:58 user nova-compute[71498]:     <acpi/>
Apr 14 01:40:58 user nova-compute[71498]:     <apic/>
Apr 14 01:40:58 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:40:58 user nova-compute[71498]:   </features>
Apr 14 01:40:58 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:40:58 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:40:58 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:40:58 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:40:58 user nova-compute[71498]:   </clock>
Apr 14 01:40:58 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:40:58 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:40:58 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:40:58 user nova-compute[71498]:   </cpu>
Apr 14 01:40:58 user nova-compute[71498]:   <devices>
Apr 14 01:40:58 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:40:58 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:40:58 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk"/>
Apr 14 01:40:58 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:40:58 user nova-compute[71498]:     </disk>
Apr 14 01:40:58 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:40:58 user nova-compute[71498]:       <mac address="fa:16:3e:0c:0e:df"/>
Apr 14 01:40:58 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:40:58 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:40:58 user nova-compute[71498]:       <target dev="tap7942720d-09"/>
Apr 14 01:40:58 user nova-compute[71498]:     </interface>
Apr 14 01:40:58 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:40:58 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/console.log" append="off"/>
Apr 14 01:40:58 user nova-compute[71498]:     </serial>
Apr 14 01:40:58 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:40:58 user nova-compute[71498]:     <video>
Apr 14 01:40:58 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:40:58 user nova-compute[71498]:     </video>
Apr 14 01:40:58 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:40:58 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:40:58 user nova-compute[71498]:     </rng>
Apr 14 01:40:58 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:40:58 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:40:58 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:40:58 user nova-compute[71498]:     </memballoon>
Apr 14 01:40:58 user nova-compute[71498]:   </devices>
Apr 14 01:40:58 user nova-compute[71498]: </domain>
Apr 14 01:40:58 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:40:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1267413302',display_name='tempest-ServerStableDeviceRescueTest-server-1267413302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1267413302',id=4,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClEbUZCS4BNpBa3d/c+E5gxA0W0UKOCjR2aXoCFkSjH1TtZ7VyBn5ergCTIl3tkCVYAq22i3BavCcYyS+Tyc9WpPRWr8ud0N+f5IiF1KOJhw1hKiESl8P8LoB9KVFwn9Q==',key_name='tempest-keypair-1599380679',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4833ddea1fa74866b97ef52a730605aa',ramdisk_id='',reservation_id='r-8cuxpjqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-131403183',owner_user_name='tempest-ServerStableDeviceRescueTest-131403183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:40:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f09ab986a00f43b384cf5d517857a13d',uuid=3a3fb53f-7b4a-48d3-85ab-418bad435c07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7942720d-0958-4826-bedf-0a7eebfe45b6", "address": "fa:16:3e:0c:0e:df", "network": {"id": "95555a4e-9d95-4509-a683-f61ea2dc38a1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-560359898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4833ddea1fa74866b97ef52a730605aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7942720d-09", "ovs_interfaceid": "7942720d-0958-4826-bedf-0a7eebfe45b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Converting VIF {"id": "7942720d-0958-4826-bedf-0a7eebfe45b6", "address": "fa:16:3e:0c:0e:df", "network": {"id": "95555a4e-9d95-4509-a683-f61ea2dc38a1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-560359898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4833ddea1fa74866b97ef52a730605aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7942720d-09", "ovs_interfaceid": "7942720d-0958-4826-bedf-0a7eebfe45b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:0e:df,bridge_name='br-int',has_traffic_filtering=True,id=7942720d-0958-4826-bedf-0a7eebfe45b6,network=Network(95555a4e-9d95-4509-a683-f61ea2dc38a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7942720d-09') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG os_vif [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:0e:df,bridge_name='br-int',has_traffic_filtering=True,id=7942720d-0958-4826-bedf-0a7eebfe45b6,network=Network(95555a4e-9d95-4509-a683-f61ea2dc38a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7942720d-09') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7942720d-09, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7942720d-09, col_values=(('external_ids', {'iface-id': '7942720d-0958-4826-bedf-0a7eebfe45b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:0e:df', 'vm-uuid': '3a3fb53f-7b4a-48d3-85ab-418bad435c07'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:40:58 user nova-compute[71498]: INFO os_vif [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:0e:df,bridge_name='br-int',has_traffic_filtering=True,id=7942720d-0958-4826-bedf-0a7eebfe45b6,network=Network(95555a4e-9d95-4509-a683-f61ea2dc38a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7942720d-09')
Apr 14 01:40:58 user nova-compute[71498]: DEBUG nova.network.neutron [req-c87195be-6c1d-4d46-8755-d4551c393ddc req-90e8c302-11c8-4eba-b701-be69bc234893 service nova] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Updated VIF entry in instance network info cache for port 5b6ccf71-1fe5-4324-a31c-f530be337523. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG nova.network.neutron [req-c87195be-6c1d-4d46-8755-d4551c393ddc req-90e8c302-11c8-4eba-b701-be69bc234893 service nova] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Updating instance_info_cache with network_info: [{"id": "5b6ccf71-1fe5-4324-a31c-f530be337523", "address": "fa:16:3e:84:ba:f4", "network": {"id": "fc6463bc-9492-414e-930d-3c5dc5ae31a0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-58429192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50fbd5c190254145815a39079b57881c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b6ccf71-1f", "ovs_interfaceid": "5b6ccf71-1fe5-4324-a31c-f530be337523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c87195be-6c1d-4d46-8755-d4551c393ddc req-90e8c302-11c8-4eba-b701-be69bc234893 service nova] Releasing lock "refresh_cache-039d0702-d115-4c25-ab88-d669c6320820" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:40:58 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] No VIF found with MAC fa:16:3e:0c:0e:df, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:40:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:40:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:40:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:40:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:40:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:40:59 user nova-compute[71498]: DEBUG nova.network.neutron [req-945368c7-ebbd-4c6c-9df4-9806581c924d req-d0fce87b-6eb8-4b39-b8f6-ce9fd0a1449e service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Updated VIF entry in instance network info cache for port 7942720d-0958-4826-bedf-0a7eebfe45b6. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:40:59 user nova-compute[71498]: DEBUG nova.network.neutron [req-945368c7-ebbd-4c6c-9df4-9806581c924d req-d0fce87b-6eb8-4b39-b8f6-ce9fd0a1449e service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Updating instance_info_cache with network_info: [{"id": "7942720d-0958-4826-bedf-0a7eebfe45b6", "address": "fa:16:3e:0c:0e:df", "network": {"id": "95555a4e-9d95-4509-a683-f61ea2dc38a1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-560359898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4833ddea1fa74866b97ef52a730605aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7942720d-09", "ovs_interfaceid": "7942720d-0958-4826-bedf-0a7eebfe45b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:40:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:40:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-945368c7-ebbd-4c6c-9df4-9806581c924d req-d0fce87b-6eb8-4b39-b8f6-ce9fd0a1449e service nova] Releasing lock "refresh_cache-3a3fb53f-7b4a-48d3-85ab-418bad435c07" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:41:00 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:00 user nova-compute[71498]: DEBUG nova.compute.manager [req-b03ab546-1bb7-411a-b923-9b7500e42fa2 req-bacae1a6-ccaa-4b1d-b826-81ce3ada1fe5 service nova] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Received event network-vif-plugged-ed749832-992f-44d3-8316-87f59088b737 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:41:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b03ab546-1bb7-411a-b923-9b7500e42fa2 req-bacae1a6-ccaa-4b1d-b826-81ce3ada1fe5 service nova] Acquiring lock "8e042a42-7cc2-4d72-b7ed-2b80339f2c85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b03ab546-1bb7-411a-b923-9b7500e42fa2 req-bacae1a6-ccaa-4b1d-b826-81ce3ada1fe5 service nova] Lock "8e042a42-7cc2-4d72-b7ed-2b80339f2c85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b03ab546-1bb7-411a-b923-9b7500e42fa2 req-bacae1a6-ccaa-4b1d-b826-81ce3ada1fe5 service nova] Lock "8e042a42-7cc2-4d72-b7ed-2b80339f2c85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:00 user nova-compute[71498]: DEBUG nova.compute.manager [req-b03ab546-1bb7-411a-b923-9b7500e42fa2 req-bacae1a6-ccaa-4b1d-b826-81ce3ada1fe5 service nova] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] No waiting events found dispatching network-vif-plugged-ed749832-992f-44d3-8316-87f59088b737 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:41:00 user nova-compute[71498]: WARNING nova.compute.manager [req-b03ab546-1bb7-411a-b923-9b7500e42fa2 req-bacae1a6-ccaa-4b1d-b826-81ce3ada1fe5 service nova] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Received unexpected event network-vif-plugged-ed749832-992f-44d3-8316-87f59088b737 for instance with vm_state building and task_state spawning.
Apr 14 01:41:01 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:01 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:01 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:01 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:01 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:01 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:01 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:02 user nova-compute[71498]: DEBUG nova.compute.manager [req-0a31aac9-fab7-4261-a4d0-167bc1c13e56 req-e41665b1-8118-44c3-9a0a-f2aa20ebc6af service nova] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Received event network-vif-plugged-ed749832-992f-44d3-8316-87f59088b737 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:41:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0a31aac9-fab7-4261-a4d0-167bc1c13e56 req-e41665b1-8118-44c3-9a0a-f2aa20ebc6af service nova] Acquiring lock "8e042a42-7cc2-4d72-b7ed-2b80339f2c85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0a31aac9-fab7-4261-a4d0-167bc1c13e56 req-e41665b1-8118-44c3-9a0a-f2aa20ebc6af service nova] Lock "8e042a42-7cc2-4d72-b7ed-2b80339f2c85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0a31aac9-fab7-4261-a4d0-167bc1c13e56 req-e41665b1-8118-44c3-9a0a-f2aa20ebc6af service nova] Lock "8e042a42-7cc2-4d72-b7ed-2b80339f2c85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:02 user nova-compute[71498]: DEBUG nova.compute.manager [req-0a31aac9-fab7-4261-a4d0-167bc1c13e56 req-e41665b1-8118-44c3-9a0a-f2aa20ebc6af service nova] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] No waiting events found dispatching network-vif-plugged-ed749832-992f-44d3-8316-87f59088b737 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:41:02 user nova-compute[71498]: WARNING nova.compute.manager [req-0a31aac9-fab7-4261-a4d0-167bc1c13e56 req-e41665b1-8118-44c3-9a0a-f2aa20ebc6af service nova] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Received unexpected event network-vif-plugged-ed749832-992f-44d3-8316-87f59088b737 for instance with vm_state building and task_state spawning.
Apr 14 01:41:02 user nova-compute[71498]: DEBUG nova.compute.manager [req-0a31aac9-fab7-4261-a4d0-167bc1c13e56 req-e41665b1-8118-44c3-9a0a-f2aa20ebc6af service nova] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Received event network-vif-plugged-b8356c3e-ccfb-44ae-8020-af80bcb28a43 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:41:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0a31aac9-fab7-4261-a4d0-167bc1c13e56 req-e41665b1-8118-44c3-9a0a-f2aa20ebc6af service nova] Acquiring lock "da60f4f1-2474-453f-8f84-c95daf02431a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0a31aac9-fab7-4261-a4d0-167bc1c13e56 req-e41665b1-8118-44c3-9a0a-f2aa20ebc6af service nova] Lock "da60f4f1-2474-453f-8f84-c95daf02431a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0a31aac9-fab7-4261-a4d0-167bc1c13e56 req-e41665b1-8118-44c3-9a0a-f2aa20ebc6af service nova] Lock "da60f4f1-2474-453f-8f84-c95daf02431a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:02 user nova-compute[71498]: DEBUG nova.compute.manager [req-0a31aac9-fab7-4261-a4d0-167bc1c13e56 req-e41665b1-8118-44c3-9a0a-f2aa20ebc6af service nova] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] No waiting events found dispatching network-vif-plugged-b8356c3e-ccfb-44ae-8020-af80bcb28a43 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:41:02 user nova-compute[71498]: WARNING nova.compute.manager [req-0a31aac9-fab7-4261-a4d0-167bc1c13e56 req-e41665b1-8118-44c3-9a0a-f2aa20ebc6af service nova] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Received unexpected event network-vif-plugged-b8356c3e-ccfb-44ae-8020-af80bcb28a43 for instance with vm_state building and task_state spawning.
Apr 14 01:41:02 user nova-compute[71498]: DEBUG nova.compute.manager [req-0a31aac9-fab7-4261-a4d0-167bc1c13e56 req-e41665b1-8118-44c3-9a0a-f2aa20ebc6af service nova] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Received event network-vif-plugged-b8356c3e-ccfb-44ae-8020-af80bcb28a43 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:41:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0a31aac9-fab7-4261-a4d0-167bc1c13e56 req-e41665b1-8118-44c3-9a0a-f2aa20ebc6af service nova] Acquiring lock "da60f4f1-2474-453f-8f84-c95daf02431a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0a31aac9-fab7-4261-a4d0-167bc1c13e56 req-e41665b1-8118-44c3-9a0a-f2aa20ebc6af service nova] Lock "da60f4f1-2474-453f-8f84-c95daf02431a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0a31aac9-fab7-4261-a4d0-167bc1c13e56 req-e41665b1-8118-44c3-9a0a-f2aa20ebc6af service nova] Lock "da60f4f1-2474-453f-8f84-c95daf02431a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:02 user nova-compute[71498]: DEBUG nova.compute.manager [req-0a31aac9-fab7-4261-a4d0-167bc1c13e56 req-e41665b1-8118-44c3-9a0a-f2aa20ebc6af service nova] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] No waiting events found dispatching network-vif-plugged-b8356c3e-ccfb-44ae-8020-af80bcb28a43 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:41:02 user nova-compute[71498]: WARNING nova.compute.manager [req-0a31aac9-fab7-4261-a4d0-167bc1c13e56 req-e41665b1-8118-44c3-9a0a-f2aa20ebc6af service nova] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Received unexpected event network-vif-plugged-b8356c3e-ccfb-44ae-8020-af80bcb28a43 for instance with vm_state building and task_state spawning.
Apr 14 01:41:02 user nova-compute[71498]: DEBUG nova.compute.manager [req-98329296-23f4-4618-8404-4d776b7b4c14 req-8d9181ca-e144-42b2-8793-90f0c732605f service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Received event network-vif-plugged-7942720d-0958-4826-bedf-0a7eebfe45b6 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:41:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-98329296-23f4-4618-8404-4d776b7b4c14 req-8d9181ca-e144-42b2-8793-90f0c732605f service nova] Acquiring lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-98329296-23f4-4618-8404-4d776b7b4c14 req-8d9181ca-e144-42b2-8793-90f0c732605f service nova] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-98329296-23f4-4618-8404-4d776b7b4c14 req-8d9181ca-e144-42b2-8793-90f0c732605f service nova] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:02 user nova-compute[71498]: DEBUG nova.compute.manager [req-98329296-23f4-4618-8404-4d776b7b4c14 req-8d9181ca-e144-42b2-8793-90f0c732605f service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] No waiting events found dispatching network-vif-plugged-7942720d-0958-4826-bedf-0a7eebfe45b6 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:41:02 user nova-compute[71498]: WARNING nova.compute.manager [req-98329296-23f4-4618-8404-4d776b7b4c14 req-8d9181ca-e144-42b2-8793-90f0c732605f service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Received unexpected event network-vif-plugged-7942720d-0958-4826-bedf-0a7eebfe45b6 for instance with vm_state building and task_state spawning.
Apr 14 01:41:02 user nova-compute[71498]: DEBUG nova.compute.manager [req-82e23963-8ea1-4a3c-971b-5760a43448cc req-114427fe-f9bc-47a7-ae7c-3f5f8052d54c service nova] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Received event network-vif-plugged-5b6ccf71-1fe5-4324-a31c-f530be337523 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:41:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-82e23963-8ea1-4a3c-971b-5760a43448cc req-114427fe-f9bc-47a7-ae7c-3f5f8052d54c service nova] Acquiring lock "039d0702-d115-4c25-ab88-d669c6320820-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-82e23963-8ea1-4a3c-971b-5760a43448cc req-114427fe-f9bc-47a7-ae7c-3f5f8052d54c service nova] Lock "039d0702-d115-4c25-ab88-d669c6320820-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-82e23963-8ea1-4a3c-971b-5760a43448cc req-114427fe-f9bc-47a7-ae7c-3f5f8052d54c service nova] Lock "039d0702-d115-4c25-ab88-d669c6320820-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:02 user nova-compute[71498]: DEBUG nova.compute.manager [req-82e23963-8ea1-4a3c-971b-5760a43448cc req-114427fe-f9bc-47a7-ae7c-3f5f8052d54c service nova] [instance: 039d0702-d115-4c25-ab88-d669c6320820] No waiting events found dispatching network-vif-plugged-5b6ccf71-1fe5-4324-a31c-f530be337523 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:41:02 user nova-compute[71498]: WARNING nova.compute.manager [req-82e23963-8ea1-4a3c-971b-5760a43448cc req-114427fe-f9bc-47a7-ae7c-3f5f8052d54c service nova] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Received unexpected event network-vif-plugged-5b6ccf71-1fe5-4324-a31c-f530be337523 for instance with vm_state building and task_state spawning.
Apr 14 01:41:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "f68784e7-578c-4a12-87d4-f35fbc5a1d59" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "f68784e7-578c-4a12-87d4-f35fbc5a1d59" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.compute.manager [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:41:04 user nova-compute[71498]: INFO nova.compute.claims [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Claim successful on node user
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436464.4322345, da60f4f1-2474-453f-8f84-c95daf02431a => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:41:04 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] VM Resumed (Lifecycle Event)
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.compute.manager [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:41:04 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Instance spawned successfully.
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:41:04 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Instance spawned successfully.
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:04 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436464.4431136, 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:41:04 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] VM Resumed (Lifecycle Event)
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:41:04 user nova-compute[71498]: INFO nova.compute.manager [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Took 20.85 seconds to spawn the instance on the hypervisor.
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.compute.manager [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.compute.manager [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.517s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.compute.manager [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 01:41:04 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436464.4433837, da60f4f1-2474-453f-8f84-c95daf02431a => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:41:04 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] VM Started (Lifecycle Event)
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.compute.manager [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:41:04 user nova-compute[71498]: INFO nova.compute.manager [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Took 20.66 seconds to spawn the instance on the hypervisor.
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:41:04 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Instance spawned successfully.
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:41:04 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Instance spawned successfully.
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.compute.manager [req-ae3c8adf-c9c8-4661-be78-5307cdbd72ce req-804d1195-96d2-4288-8b40-7595807c3856 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Received event network-vif-plugged-7942720d-0958-4826-bedf-0a7eebfe45b6 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ae3c8adf-c9c8-4661-be78-5307cdbd72ce req-804d1195-96d2-4288-8b40-7595807c3856 service nova] Acquiring lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ae3c8adf-c9c8-4661-be78-5307cdbd72ce req-804d1195-96d2-4288-8b40-7595807c3856 service nova] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ae3c8adf-c9c8-4661-be78-5307cdbd72ce req-804d1195-96d2-4288-8b40-7595807c3856 service nova] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.compute.manager [req-ae3c8adf-c9c8-4661-be78-5307cdbd72ce req-804d1195-96d2-4288-8b40-7595807c3856 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] No waiting events found dispatching network-vif-plugged-7942720d-0958-4826-bedf-0a7eebfe45b6 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:41:04 user nova-compute[71498]: WARNING nova.compute.manager [req-ae3c8adf-c9c8-4661-be78-5307cdbd72ce req-804d1195-96d2-4288-8b40-7595807c3856 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Received unexpected event network-vif-plugged-7942720d-0958-4826-bedf-0a7eebfe45b6 for instance with vm_state building and task_state spawning.
Apr 14 01:41:04 user nova-compute[71498]: INFO nova.compute.manager [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Took 22.06 seconds to build instance.
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.compute.manager [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.network.neutron [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.compute.manager [req-5758575e-bdc1-4cf4-a207-c72bdd30f650 req-46c14f49-fa01-495b-be39-1a7a7e62bfa8 service nova] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Received event network-vif-plugged-5b6ccf71-1fe5-4324-a31c-f530be337523 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5758575e-bdc1-4cf4-a207-c72bdd30f650 req-46c14f49-fa01-495b-be39-1a7a7e62bfa8 service nova] Acquiring lock "039d0702-d115-4c25-ab88-d669c6320820-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5758575e-bdc1-4cf4-a207-c72bdd30f650 req-46c14f49-fa01-495b-be39-1a7a7e62bfa8 service nova] Lock "039d0702-d115-4c25-ab88-d669c6320820-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5758575e-bdc1-4cf4-a207-c72bdd30f650 req-46c14f49-fa01-495b-be39-1a7a7e62bfa8 service nova] Lock "039d0702-d115-4c25-ab88-d669c6320820-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:04 user nova-compute[71498]: DEBUG nova.compute.manager [req-5758575e-bdc1-4cf4-a207-c72bdd30f650 req-46c14f49-fa01-495b-be39-1a7a7e62bfa8 service nova] [instance: 039d0702-d115-4c25-ab88-d669c6320820] No waiting events found dispatching network-vif-plugged-5b6ccf71-1fe5-4324-a31c-f530be337523 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:41:04 user nova-compute[71498]: WARNING nova.compute.manager [req-5758575e-bdc1-4cf4-a207-c72bdd30f650 req-46c14f49-fa01-495b-be39-1a7a7e62bfa8 service nova] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Received unexpected event network-vif-plugged-5b6ccf71-1fe5-4324-a31c-f530be337523 for instance with vm_state building and task_state spawning.
Apr 14 01:41:04 user nova-compute[71498]: INFO nova.compute.manager [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Took 21.48 seconds to build instance.
Apr 14 01:41:05 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 01:41:05 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0df8b029-2512-460c-8868-dd6f8da95b8f tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "da60f4f1-2474-453f-8f84-c95daf02431a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.306s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG nova.compute.manager [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d7480e32-9d5e-4fed-8763-56870d4fb07d tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "8e042a42-7cc2-4d72-b7ed-2b80339f2c85" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.721s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG nova.policy [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bbaf843e44ff4359a15ab6d625134b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a409270d6d4d408de33c5e71a56da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:41:05 user nova-compute[71498]: INFO nova.compute.manager [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Took 13.63 seconds to spawn the instance on the hypervisor.
Apr 14 01:41:05 user nova-compute[71498]: DEBUG nova.compute.manager [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436464.4436805, 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:41:05 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] VM Started (Lifecycle Event)
Apr 14 01:41:05 user nova-compute[71498]: DEBUG nova.compute.manager [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:41:05 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Creating image(s)
Apr 14 01:41:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "/opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "/opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "/opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:05 user nova-compute[71498]: INFO nova.compute.manager [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Took 17.75 seconds to spawn the instance on the hypervisor.
Apr 14 01:41:05 user nova-compute[71498]: DEBUG nova.compute.manager [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436464.6915503, 039d0702-d115-4c25-ab88-d669c6320820 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:41:05 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 039d0702-d115-4c25-ab88-d669c6320820] VM Resumed (Lifecycle Event)
Apr 14 01:41:05 user nova-compute[71498]: INFO nova.compute.manager [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Took 14.52 seconds to build instance.
Apr 14 01:41:05 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.216s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4ddafb1e-4439-4206-b882-5c715add0e4a tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.835s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:05 user nova-compute[71498]: INFO nova.compute.manager [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Took 18.96 seconds to build instance.
Apr 14 01:41:05 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436464.7029786, 039d0702-d115-4c25-ab88-d669c6320820 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:41:05 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 039d0702-d115-4c25-ab88-d669c6320820] VM Started (Lifecycle Event)
Apr 14 01:41:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5430992f-fc5b-4546-9cf6-e190403096e5 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "039d0702-d115-4c25-ab88-d669c6320820" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.132s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.274s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436464.7187164, 3a3fb53f-7b4a-48d3-85ab-418bad435c07 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:41:05 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] VM Resumed (Lifecycle Event)
Apr 14 01:41:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/disk 1073741824" returned: 0 in 0.066s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.344s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:41:05 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436464.72634, 3a3fb53f-7b4a-48d3-85ab-418bad435c07 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:41:05 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] VM Started (Lifecycle Event)
Apr 14 01:41:06 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:41:06 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:41:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.207s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:06 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 01:41:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:06 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Cannot resize image /opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 01:41:06 user nova-compute[71498]: DEBUG nova.objects.instance [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lazy-loading 'migration_context' on Instance uuid f68784e7-578c-4a12-87d4-f35fbc5a1d59 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:41:06 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 01:41:06 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Ensure instance console log exists: /opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:41:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:06 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:06 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:06 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:06 user nova-compute[71498]: DEBUG nova.network.neutron [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Successfully created port: 08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:41:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "f1d10278-cf24-4fde-86eb-664ba86cbd8f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "f1d10278-cf24-4fde-86eb-664ba86cbd8f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:08 user nova-compute[71498]: DEBUG nova.compute.manager [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 01:41:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:08 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:41:08 user nova-compute[71498]: INFO nova.compute.claims [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Claim successful on node user
Apr 14 01:41:08 user nova-compute[71498]: DEBUG nova.network.neutron [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Successfully updated port: 08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:41:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "refresh_cache-f68784e7-578c-4a12-87d4-f35fbc5a1d59" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:41:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquired lock "refresh_cache-f68784e7-578c-4a12-87d4-f35fbc5a1d59" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:41:08 user nova-compute[71498]: DEBUG nova.network.neutron [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:41:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:08 user nova-compute[71498]: DEBUG nova.compute.manager [req-3b19d5e3-9915-4278-b131-cbe34e915084 req-a70cdbd6-6944-43f9-9683-399407ae6d78 service nova] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Received event network-changed-08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:41:08 user nova-compute[71498]: DEBUG nova.compute.manager [req-3b19d5e3-9915-4278-b131-cbe34e915084 req-a70cdbd6-6944-43f9-9683-399407ae6d78 service nova] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Refreshing instance network info cache due to event network-changed-08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:41:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3b19d5e3-9915-4278-b131-cbe34e915084 req-a70cdbd6-6944-43f9-9683-399407ae6d78 service nova] Acquiring lock "refresh_cache-f68784e7-578c-4a12-87d4-f35fbc5a1d59" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:41:08 user nova-compute[71498]: DEBUG nova.network.neutron [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:41:09 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:41:09 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:41:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.564s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:09 user nova-compute[71498]: DEBUG nova.compute.manager [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 01:41:09 user nova-compute[71498]: DEBUG nova.compute.manager [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 01:41:09 user nova-compute[71498]: DEBUG nova.network.neutron [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:41:09 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Apr 14 01:41:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:09 user nova-compute[71498]: DEBUG nova.compute.manager [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 01:41:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:09 user nova-compute[71498]: DEBUG nova.compute.manager [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 01:41:09 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:41:09 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Creating image(s)
Apr 14 01:41:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1d10278-cf24-4fde-86eb-664ba86cbd8f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "/opt/stack/data/nova/instances/f1d10278-cf24-4fde-86eb-664ba86cbd8f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "/opt/stack/data/nova/instances/f1d10278-cf24-4fde-86eb-664ba86cbd8f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "f5278a41abeb9d8af10193ebab47e6963b5e7faa" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "f5278a41abeb9d8af10193ebab47e6963b5e7faa" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:09 user nova-compute[71498]: DEBUG nova.policy [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1a1f606719a5435dbcb6092e0708b2cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9a3bf2a3b4480a990adc9821005f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5278a41abeb9d8af10193ebab47e6963b5e7faa.part --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG nova.network.neutron [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Updating instance_info_cache with network_info: [{"id": "08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd", "address": "fa:16:3e:f5:7f:82", "network": {"id": "6569db42-40ba-4426-a76b-b3e64ecae5b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1148770119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a409270d6d4d408de33c5e71a56da9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c0ebf7-58", "ovs_interfaceid": "08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Releasing lock "refresh_cache-f68784e7-578c-4a12-87d4-f35fbc5a1d59" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG nova.compute.manager [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Instance network_info: |[{"id": "08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd", "address": "fa:16:3e:f5:7f:82", "network": {"id": "6569db42-40ba-4426-a76b-b3e64ecae5b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1148770119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a409270d6d4d408de33c5e71a56da9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c0ebf7-58", "ovs_interfaceid": "08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3b19d5e3-9915-4278-b131-cbe34e915084 req-a70cdbd6-6944-43f9-9683-399407ae6d78 service nova] Acquired lock "refresh_cache-f68784e7-578c-4a12-87d4-f35fbc5a1d59" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG nova.network.neutron [req-3b19d5e3-9915-4278-b131-cbe34e915084 req-a70cdbd6-6944-43f9-9683-399407ae6d78 service nova] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Refreshing network info cache for port 08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Start _get_guest_xml network_info=[{"id": "08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd", "address": "fa:16:3e:f5:7f:82", "network": {"id": "6569db42-40ba-4426-a76b-b3e64ecae5b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1148770119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a409270d6d4d408de33c5e71a56da9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c0ebf7-58", "ovs_interfaceid": "08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:41:10 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:41:10 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:41:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1105703559',display_name='tempest-VolumesAdminNegativeTest-server-1105703559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1105703559',id=5,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzSqKeU7xuvAUNkvNUpnnFYDg8L9Gwcz3w0hcuWLt8QTfKNS7hjjtyP4reBw4U2xq2tJ0MdbpLZFiWL5B1QKuYrfH5MWbhJ069nr4zUrKudohsn7krJGDoFkJv3XJBPFQ==',key_name='tempest-keypair-1858701247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0a409270d6d4d408de33c5e71a56da9',ramdisk_id='',reservation_id='r-5cawmr1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1981219566',owner_user_name='tempest-VolumesAdminNegativeTest-1981219566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:41:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbaf843e44ff4359a15ab6d625134b07',uuid=f68784e7-578c-4a12-87d4-f35fbc5a1d59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd", "address": "fa:16:3e:f5:7f:82", "network": {"id": "6569db42-40ba-4426-a76b-b3e64ecae5b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1148770119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a409270d6d4d408de33c5e71a56da9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c0ebf7-58", "ovs_interfaceid": "08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Converting VIF {"id": "08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd", "address": "fa:16:3e:f5:7f:82", "network": {"id": "6569db42-40ba-4426-a76b-b3e64ecae5b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1148770119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a409270d6d4d408de33c5e71a56da9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c0ebf7-58", "ovs_interfaceid": "08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:7f:82,bridge_name='br-int',has_traffic_filtering=True,id=08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd,network=Network(6569db42-40ba-4426-a76b-b3e64ecae5b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08c0ebf7-58') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG nova.objects.instance [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lazy-loading 'pci_devices' on Instance uuid f68784e7-578c-4a12-87d4-f35fbc5a1d59 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5278a41abeb9d8af10193ebab47e6963b5e7faa.part --force-share --output=json" returned: 0 in 0.239s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG nova.virt.images [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] 8ac72bf7-6709-4b09-92e0-a06bd5d54f4d was qcow2, converting to raw {{(pid=71498) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG nova.privsep.utils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71498) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f5278a41abeb9d8af10193ebab47e6963b5e7faa.part /opt/stack/data/nova/instances/_base/f5278a41abeb9d8af10193ebab47e6963b5e7faa.converted {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:41:10 user nova-compute[71498]:   <uuid>f68784e7-578c-4a12-87d4-f35fbc5a1d59</uuid>
Apr 14 01:41:10 user nova-compute[71498]:   <name>instance-00000005</name>
Apr 14 01:41:10 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:41:10 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:41:10 user nova-compute[71498]:   <metadata>
Apr 14 01:41:10 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:41:10 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:41:10 user nova-compute[71498]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1105703559</nova:name>
Apr 14 01:41:10 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:41:10</nova:creationTime>
Apr 14 01:41:10 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:41:10 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:41:10 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:41:10 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:41:10 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:41:10 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:41:10 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:41:10 user nova-compute[71498]:       <nova:owner>
Apr 14 01:41:10 user nova-compute[71498]:         <nova:user uuid="bbaf843e44ff4359a15ab6d625134b07">tempest-VolumesAdminNegativeTest-1981219566-project-member</nova:user>
Apr 14 01:41:10 user nova-compute[71498]:         <nova:project uuid="d0a409270d6d4d408de33c5e71a56da9">tempest-VolumesAdminNegativeTest-1981219566</nova:project>
Apr 14 01:41:10 user nova-compute[71498]:       </nova:owner>
Apr 14 01:41:10 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:41:10 user nova-compute[71498]:       <nova:ports>
Apr 14 01:41:10 user nova-compute[71498]:         <nova:port uuid="08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd">
Apr 14 01:41:10 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 01:41:10 user nova-compute[71498]:         </nova:port>
Apr 14 01:41:10 user nova-compute[71498]:       </nova:ports>
Apr 14 01:41:10 user nova-compute[71498]:     </nova:instance>
Apr 14 01:41:10 user nova-compute[71498]:   </metadata>
Apr 14 01:41:10 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:41:10 user nova-compute[71498]:     <system>
Apr 14 01:41:10 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:41:10 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:41:10 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:41:10 user nova-compute[71498]:       <entry name="serial">f68784e7-578c-4a12-87d4-f35fbc5a1d59</entry>
Apr 14 01:41:10 user nova-compute[71498]:       <entry name="uuid">f68784e7-578c-4a12-87d4-f35fbc5a1d59</entry>
Apr 14 01:41:10 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:41:10 user nova-compute[71498]:     </system>
Apr 14 01:41:10 user nova-compute[71498]:   </sysinfo>
Apr 14 01:41:10 user nova-compute[71498]:   <os>
Apr 14 01:41:10 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:41:10 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:41:10 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:41:10 user nova-compute[71498]:   </os>
Apr 14 01:41:10 user nova-compute[71498]:   <features>
Apr 14 01:41:10 user nova-compute[71498]:     <acpi/>
Apr 14 01:41:10 user nova-compute[71498]:     <apic/>
Apr 14 01:41:10 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:41:10 user nova-compute[71498]:   </features>
Apr 14 01:41:10 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:41:10 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:41:10 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:41:10 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:41:10 user nova-compute[71498]:   </clock>
Apr 14 01:41:10 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:41:10 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:41:10 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:41:10 user nova-compute[71498]:   </cpu>
Apr 14 01:41:10 user nova-compute[71498]:   <devices>
Apr 14 01:41:10 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:41:10 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:41:10 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/disk"/>
Apr 14 01:41:10 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:41:10 user nova-compute[71498]:     </disk>
Apr 14 01:41:10 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:41:10 user nova-compute[71498]:       <mac address="fa:16:3e:f5:7f:82"/>
Apr 14 01:41:10 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:41:10 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:41:10 user nova-compute[71498]:       <target dev="tap08c0ebf7-58"/>
Apr 14 01:41:10 user nova-compute[71498]:     </interface>
Apr 14 01:41:10 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:41:10 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/console.log" append="off"/>
Apr 14 01:41:10 user nova-compute[71498]:     </serial>
Apr 14 01:41:10 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:41:10 user nova-compute[71498]:     <video>
Apr 14 01:41:10 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:41:10 user nova-compute[71498]:     </video>
Apr 14 01:41:10 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:41:10 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:41:10 user nova-compute[71498]:     </rng>
Apr 14 01:41:10 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:41:10 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:41:10 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:41:10 user nova-compute[71498]:     </memballoon>
Apr 14 01:41:10 user nova-compute[71498]:   </devices>
Apr 14 01:41:10 user nova-compute[71498]: </domain>
Apr 14 01:41:10 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1105703559',display_name='tempest-VolumesAdminNegativeTest-server-1105703559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1105703559',id=5,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzSqKeU7xuvAUNkvNUpnnFYDg8L9Gwcz3w0hcuWLt8QTfKNS7hjjtyP4reBw4U2xq2tJ0MdbpLZFiWL5B1QKuYrfH5MWbhJ069nr4zUrKudohsn7krJGDoFkJv3XJBPFQ==',key_name='tempest-keypair-1858701247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0a409270d6d4d408de33c5e71a56da9',ramdisk_id='',reservation_id='r-5cawmr1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1981219566',owner_user_name='tempest-VolumesAdminNegativeTest-1981219566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:41:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbaf843e44ff4359a15ab6d625134b07',uuid=f68784e7-578c-4a12-87d4-f35fbc5a1d59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd", "address": "fa:16:3e:f5:7f:82", "network": {"id": "6569db42-40ba-4426-a76b-b3e64ecae5b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1148770119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a409270d6d4d408de33c5e71a56da9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c0ebf7-58", "ovs_interfaceid": "08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Converting VIF {"id": "08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd", "address": "fa:16:3e:f5:7f:82", "network": {"id": "6569db42-40ba-4426-a76b-b3e64ecae5b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1148770119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a409270d6d4d408de33c5e71a56da9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c0ebf7-58", "ovs_interfaceid": "08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:7f:82,bridge_name='br-int',has_traffic_filtering=True,id=08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd,network=Network(6569db42-40ba-4426-a76b-b3e64ecae5b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08c0ebf7-58') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG os_vif [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:7f:82,bridge_name='br-int',has_traffic_filtering=True,id=08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd,network=Network(6569db42-40ba-4426-a76b-b3e64ecae5b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08c0ebf7-58') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08c0ebf7-58, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap08c0ebf7-58, col_values=(('external_ids', {'iface-id': '08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:7f:82', 'vm-uuid': 'f68784e7-578c-4a12-87d4-f35fbc5a1d59'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:10 user nova-compute[71498]: INFO os_vif [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:7f:82,bridge_name='br-int',has_traffic_filtering=True,id=08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd,network=Network(6569db42-40ba-4426-a76b-b3e64ecae5b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08c0ebf7-58')
Apr 14 01:41:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f5278a41abeb9d8af10193ebab47e6963b5e7faa.part /opt/stack/data/nova/instances/_base/f5278a41abeb9d8af10193ebab47e6963b5e7faa.converted" returned: 0 in 0.317s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5278a41abeb9d8af10193ebab47e6963b5e7faa.converted --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:41:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] No VIF found with MAC fa:16:3e:f5:7f:82, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:41:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5278a41abeb9d8af10193ebab47e6963b5e7faa.converted --force-share --output=json" returned: 0 in 0.202s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "f5278a41abeb9d8af10193ebab47e6963b5e7faa" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.564s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5278a41abeb9d8af10193ebab47e6963b5e7faa --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:11 user nova-compute[71498]: DEBUG nova.network.neutron [req-3b19d5e3-9915-4278-b131-cbe34e915084 req-a70cdbd6-6944-43f9-9683-399407ae6d78 service nova] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Updated VIF entry in instance network info cache for port 08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:41:11 user nova-compute[71498]: DEBUG nova.network.neutron [req-3b19d5e3-9915-4278-b131-cbe34e915084 req-a70cdbd6-6944-43f9-9683-399407ae6d78 service nova] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Updating instance_info_cache with network_info: [{"id": "08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd", "address": "fa:16:3e:f5:7f:82", "network": {"id": "6569db42-40ba-4426-a76b-b3e64ecae5b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1148770119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a409270d6d4d408de33c5e71a56da9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c0ebf7-58", "ovs_interfaceid": "08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:41:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5278a41abeb9d8af10193ebab47e6963b5e7faa --force-share --output=json" returned: 0 in 0.201s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "f5278a41abeb9d8af10193ebab47e6963b5e7faa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "f5278a41abeb9d8af10193ebab47e6963b5e7faa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5278a41abeb9d8af10193ebab47e6963b5e7faa --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3b19d5e3-9915-4278-b131-cbe34e915084 req-a70cdbd6-6944-43f9-9683-399407ae6d78 service nova] Releasing lock "refresh_cache-f68784e7-578c-4a12-87d4-f35fbc5a1d59" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:41:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5278a41abeb9d8af10193ebab47e6963b5e7faa --force-share --output=json" returned: 0 in 0.201s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f5278a41abeb9d8af10193ebab47e6963b5e7faa,backing_fmt=raw /opt/stack/data/nova/instances/f1d10278-cf24-4fde-86eb-664ba86cbd8f/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f5278a41abeb9d8af10193ebab47e6963b5e7faa,backing_fmt=raw /opt/stack/data/nova/instances/f1d10278-cf24-4fde-86eb-664ba86cbd8f/disk 1073741824" returned: 0 in 0.082s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "f5278a41abeb9d8af10193ebab47e6963b5e7faa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5278a41abeb9d8af10193ebab47e6963b5e7faa --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "f45130b1-9e83-47a0-b335-a6e74875b79e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "f45130b1-9e83-47a0-b335-a6e74875b79e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.018s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:11 user nova-compute[71498]: DEBUG nova.compute.manager [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 01:41:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5278a41abeb9d8af10193ebab47e6963b5e7faa --force-share --output=json" returned: 0 in 0.179s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:11 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f1d10278-cf24-4fde-86eb-664ba86cbd8f/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 01:41:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d10278-cf24-4fde-86eb-664ba86cbd8f/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:12 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:41:12 user nova-compute[71498]: INFO nova.compute.claims [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Claim successful on node user
Apr 14 01:41:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d10278-cf24-4fde-86eb-664ba86cbd8f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:12 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Cannot resize image /opt/stack/data/nova/instances/f1d10278-cf24-4fde-86eb-664ba86cbd8f/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 01:41:12 user nova-compute[71498]: DEBUG nova.objects.instance [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lazy-loading 'migration_context' on Instance uuid f1d10278-cf24-4fde-86eb-664ba86cbd8f {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:41:12 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 01:41:12 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Ensure instance console log exists: /opt/stack/data/nova/instances/f1d10278-cf24-4fde-86eb-664ba86cbd8f/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:41:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:12 user nova-compute[71498]: DEBUG nova.network.neutron [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Successfully created port: ed3a6f44-e7a4-41b0-9769-71beee125cb1 {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:41:12 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:41:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:12 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:41:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.707s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:12 user nova-compute[71498]: DEBUG nova.compute.manager [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 01:41:12 user nova-compute[71498]: DEBUG nova.compute.manager [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 01:41:12 user nova-compute[71498]: DEBUG nova.network.neutron [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:41:12 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 01:41:12 user nova-compute[71498]: DEBUG nova.compute.manager [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 01:41:13 user nova-compute[71498]: DEBUG nova.compute.manager [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 01:41:13 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:41:13 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Creating image(s)
Apr 14 01:41:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "/opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "/opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "/opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:13 user nova-compute[71498]: DEBUG nova.policy [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2bada5cdb7704f6b956eb48b3729388d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f0122cc9864fcea660891e2826ca7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:41:13 user nova-compute[71498]: DEBUG nova.compute.manager [req-74a4e9c5-729a-42ec-aa07-3cf78e146a57 req-c4b3acad-0ae9-4ebc-8afc-69cd8993edde service nova] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Received event network-vif-plugged-08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:41:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-74a4e9c5-729a-42ec-aa07-3cf78e146a57 req-c4b3acad-0ae9-4ebc-8afc-69cd8993edde service nova] Acquiring lock "f68784e7-578c-4a12-87d4-f35fbc5a1d59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-74a4e9c5-729a-42ec-aa07-3cf78e146a57 req-c4b3acad-0ae9-4ebc-8afc-69cd8993edde service nova] Lock "f68784e7-578c-4a12-87d4-f35fbc5a1d59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-74a4e9c5-729a-42ec-aa07-3cf78e146a57 req-c4b3acad-0ae9-4ebc-8afc-69cd8993edde service nova] Lock "f68784e7-578c-4a12-87d4-f35fbc5a1d59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:13 user nova-compute[71498]: DEBUG nova.compute.manager [req-74a4e9c5-729a-42ec-aa07-3cf78e146a57 req-c4b3acad-0ae9-4ebc-8afc-69cd8993edde service nova] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] No waiting events found dispatching network-vif-plugged-08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:41:13 user nova-compute[71498]: WARNING nova.compute.manager [req-74a4e9c5-729a-42ec-aa07-3cf78e146a57 req-c4b3acad-0ae9-4ebc-8afc-69cd8993edde service nova] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Received unexpected event network-vif-plugged-08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd for instance with vm_state building and task_state spawning.
Apr 14 01:41:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.295s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.243s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/disk 1073741824" returned: 0 in 0.103s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.356s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.330s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Cannot resize image /opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG nova.objects.instance [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lazy-loading 'migration_context' on Instance uuid f45130b1-9e83-47a0-b335-a6e74875b79e {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Ensure instance console log exists: /opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG nova.network.neutron [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Successfully updated port: ed3a6f44-e7a4-41b0-9769-71beee125cb1 {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "refresh_cache-f1d10278-cf24-4fde-86eb-664ba86cbd8f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquired lock "refresh_cache-f1d10278-cf24-4fde-86eb-664ba86cbd8f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG nova.network.neutron [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG nova.compute.manager [req-58d2fbf4-d024-4ed7-837d-993c1c865fea req-9a360b71-fde8-436a-b6b4-725212222fb1 service nova] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Received event network-changed-ed3a6f44-e7a4-41b0-9769-71beee125cb1 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG nova.compute.manager [req-58d2fbf4-d024-4ed7-837d-993c1c865fea req-9a360b71-fde8-436a-b6b4-725212222fb1 service nova] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Refreshing instance network info cache due to event network-changed-ed3a6f44-e7a4-41b0-9769-71beee125cb1. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-58d2fbf4-d024-4ed7-837d-993c1c865fea req-9a360b71-fde8-436a-b6b4-725212222fb1 service nova] Acquiring lock "refresh_cache-f1d10278-cf24-4fde-86eb-664ba86cbd8f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG nova.network.neutron [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG nova.network.neutron [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Successfully created port: 6762a294-eced-41bd-87c0-ac112e954d3a {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG nova.network.neutron [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Updating instance_info_cache with network_info: [{"id": "ed3a6f44-e7a4-41b0-9769-71beee125cb1", "address": "fa:16:3e:88:7b:f9", "network": {"id": "e70b6880-528f-41d8-b154-89eabc02efdb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1224931198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d9a3bf2a3b4480a990adc9821005f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped3a6f44-e7", "ovs_interfaceid": "ed3a6f44-e7a4-41b0-9769-71beee125cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Releasing lock "refresh_cache-f1d10278-cf24-4fde-86eb-664ba86cbd8f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG nova.compute.manager [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Instance network_info: |[{"id": "ed3a6f44-e7a4-41b0-9769-71beee125cb1", "address": "fa:16:3e:88:7b:f9", "network": {"id": "e70b6880-528f-41d8-b154-89eabc02efdb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1224931198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d9a3bf2a3b4480a990adc9821005f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped3a6f44-e7", "ovs_interfaceid": "ed3a6f44-e7a4-41b0-9769-71beee125cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-58d2fbf4-d024-4ed7-837d-993c1c865fea req-9a360b71-fde8-436a-b6b4-725212222fb1 service nova] Acquired lock "refresh_cache-f1d10278-cf24-4fde-86eb-664ba86cbd8f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG nova.network.neutron [req-58d2fbf4-d024-4ed7-837d-993c1c865fea req-9a360b71-fde8-436a-b6b4-725212222fb1 service nova] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Refreshing network info cache for port ed3a6f44-e7a4-41b0-9769-71beee125cb1 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Start _get_guest_xml network_info=[{"id": "ed3a6f44-e7a4-41b0-9769-71beee125cb1", "address": "fa:16:3e:88:7b:f9", "network": {"id": "e70b6880-528f-41d8-b154-89eabc02efdb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1224931198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d9a3bf2a3b4480a990adc9821005f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped3a6f44-e7", "ovs_interfaceid": "ed3a6f44-e7a4-41b0-9769-71beee125cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:41:00Z,direct_url=<?>,disk_format='qcow2',id=8ac72bf7-6709-4b09-92e0-a06bd5d54f4d,min_disk=0,min_ram=0,name='',owner='2ab306606f2642fbbf4398b239ecbea7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:41:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'device_name': '/dev/sda', 'disk_bus': 'scsi', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': '8ac72bf7-6709-4b09-92e0-a06bd5d54f4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:41:14 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:41:14 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:41:14 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:41:00Z,direct_url=<?>,disk_format='qcow2',id=8ac72bf7-6709-4b09-92e0-a06bd5d54f4d,min_disk=0,min_ram=0,name='',owner='2ab306606f2642fbbf4398b239ecbea7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:41:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:41:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1295717929',display_name='tempest-AttachSCSIVolumeTestJSON-server-1295717929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1295717929',id=6,image_ref='8ac72bf7-6709-4b09-92e0-a06bd5d54f4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkA+tu4xg/6rZ+pvXuvXfIBfdfqlnJ3g+nPNNirxTLXyVXJfO8nlfKhzRDd8JVflZJBNfMF2WhhlVStReA2haNPNG8030TsTlfh5bzCyX6wU3jLESQSqScW09J0bJ51Kw==',key_name='tempest-keypair-698129803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d9a3bf2a3b4480a990adc9821005f7f',ramdisk_id='',reservation_id='r-9hhx54e5',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8ac72bf7-6709-4b09-92e0-a06bd5d54f4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-716976075',owner_user_name='tempest-AttachSCSIVolumeTestJSON-716976075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:41:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a1f606719a5435dbcb6092e0708b2cb',uuid=f1d10278-cf24-4fde-86eb-664ba86cbd8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed3a6f44-e7a4-41b0-9769-71beee125cb1", "address": "fa:16:3e:88:7b:f9", "network": {"id": "e70b6880-528f-41d8-b154-89eabc02efdb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1224931198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d9a3bf2a3b4480a990adc9821005f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped3a6f44-e7", "ovs_interfaceid": "ed3a6f44-e7a4-41b0-9769-71beee125cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Converting VIF {"id": "ed3a6f44-e7a4-41b0-9769-71beee125cb1", "address": "fa:16:3e:88:7b:f9", "network": {"id": "e70b6880-528f-41d8-b154-89eabc02efdb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1224931198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d9a3bf2a3b4480a990adc9821005f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped3a6f44-e7", "ovs_interfaceid": "ed3a6f44-e7a4-41b0-9769-71beee125cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:7b:f9,bridge_name='br-int',has_traffic_filtering=True,id=ed3a6f44-e7a4-41b0-9769-71beee125cb1,network=Network(e70b6880-528f-41d8-b154-89eabc02efdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped3a6f44-e7') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:41:14 user nova-compute[71498]: DEBUG nova.objects.instance [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lazy-loading 'pci_devices' on Instance uuid f1d10278-cf24-4fde-86eb-664ba86cbd8f {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:41:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:41:15 user nova-compute[71498]:   <uuid>f1d10278-cf24-4fde-86eb-664ba86cbd8f</uuid>
Apr 14 01:41:15 user nova-compute[71498]:   <name>instance-00000006</name>
Apr 14 01:41:15 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:41:15 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:41:15 user nova-compute[71498]:   <metadata>
Apr 14 01:41:15 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:41:15 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:41:15 user nova-compute[71498]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1295717929</nova:name>
Apr 14 01:41:15 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:41:14</nova:creationTime>
Apr 14 01:41:15 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:41:15 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:41:15 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:41:15 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:41:15 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:41:15 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:41:15 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:41:15 user nova-compute[71498]:       <nova:owner>
Apr 14 01:41:15 user nova-compute[71498]:         <nova:user uuid="1a1f606719a5435dbcb6092e0708b2cb">tempest-AttachSCSIVolumeTestJSON-716976075-project-member</nova:user>
Apr 14 01:41:15 user nova-compute[71498]:         <nova:project uuid="0d9a3bf2a3b4480a990adc9821005f7f">tempest-AttachSCSIVolumeTestJSON-716976075</nova:project>
Apr 14 01:41:15 user nova-compute[71498]:       </nova:owner>
Apr 14 01:41:15 user nova-compute[71498]:       <nova:root type="image" uuid="8ac72bf7-6709-4b09-92e0-a06bd5d54f4d"/>
Apr 14 01:41:15 user nova-compute[71498]:       <nova:ports>
Apr 14 01:41:15 user nova-compute[71498]:         <nova:port uuid="ed3a6f44-e7a4-41b0-9769-71beee125cb1">
Apr 14 01:41:15 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 01:41:15 user nova-compute[71498]:         </nova:port>
Apr 14 01:41:15 user nova-compute[71498]:       </nova:ports>
Apr 14 01:41:15 user nova-compute[71498]:     </nova:instance>
Apr 14 01:41:15 user nova-compute[71498]:   </metadata>
Apr 14 01:41:15 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:41:15 user nova-compute[71498]:     <system>
Apr 14 01:41:15 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:41:15 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:41:15 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:41:15 user nova-compute[71498]:       <entry name="serial">f1d10278-cf24-4fde-86eb-664ba86cbd8f</entry>
Apr 14 01:41:15 user nova-compute[71498]:       <entry name="uuid">f1d10278-cf24-4fde-86eb-664ba86cbd8f</entry>
Apr 14 01:41:15 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:41:15 user nova-compute[71498]:     </system>
Apr 14 01:41:15 user nova-compute[71498]:   </sysinfo>
Apr 14 01:41:15 user nova-compute[71498]:   <os>
Apr 14 01:41:15 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:41:15 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:41:15 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:41:15 user nova-compute[71498]:   </os>
Apr 14 01:41:15 user nova-compute[71498]:   <features>
Apr 14 01:41:15 user nova-compute[71498]:     <acpi/>
Apr 14 01:41:15 user nova-compute[71498]:     <apic/>
Apr 14 01:41:15 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:41:15 user nova-compute[71498]:   </features>
Apr 14 01:41:15 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:41:15 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:41:15 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:41:15 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:41:15 user nova-compute[71498]:   </clock>
Apr 14 01:41:15 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:41:15 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:41:15 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:41:15 user nova-compute[71498]:   </cpu>
Apr 14 01:41:15 user nova-compute[71498]:   <devices>
Apr 14 01:41:15 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:41:15 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:41:15 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/f1d10278-cf24-4fde-86eb-664ba86cbd8f/disk"/>
Apr 14 01:41:15 user nova-compute[71498]:       <target dev="sda" bus="scsi"/>
Apr 14 01:41:15 user nova-compute[71498]:       <address type="drive" controller="0" unit="0"/>
Apr 14 01:41:15 user nova-compute[71498]:     </disk>
Apr 14 01:41:15 user nova-compute[71498]:     <disk type="file" device="cdrom">
Apr 14 01:41:15 user nova-compute[71498]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 01:41:15 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/f1d10278-cf24-4fde-86eb-664ba86cbd8f/disk.config"/>
Apr 14 01:41:15 user nova-compute[71498]:       <target dev="sdb" bus="scsi"/>
Apr 14 01:41:15 user nova-compute[71498]:       <address type="drive" controller="0" unit="1"/>
Apr 14 01:41:15 user nova-compute[71498]:     </disk>
Apr 14 01:41:15 user nova-compute[71498]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Apr 14 01:41:15 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:41:15 user nova-compute[71498]:       <mac address="fa:16:3e:88:7b:f9"/>
Apr 14 01:41:15 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:41:15 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:41:15 user nova-compute[71498]:       <target dev="taped3a6f44-e7"/>
Apr 14 01:41:15 user nova-compute[71498]:     </interface>
Apr 14 01:41:15 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:41:15 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/f1d10278-cf24-4fde-86eb-664ba86cbd8f/console.log" append="off"/>
Apr 14 01:41:15 user nova-compute[71498]:     </serial>
Apr 14 01:41:15 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:41:15 user nova-compute[71498]:     <video>
Apr 14 01:41:15 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:41:15 user nova-compute[71498]:     </video>
Apr 14 01:41:15 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:41:15 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:41:15 user nova-compute[71498]:     </rng>
Apr 14 01:41:15 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:41:15 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:41:15 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:41:15 user nova-compute[71498]:     </memballoon>
Apr 14 01:41:15 user nova-compute[71498]:   </devices>
Apr 14 01:41:15 user nova-compute[71498]: </domain>
Apr 14 01:41:15 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:41:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:41:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1295717929',display_name='tempest-AttachSCSIVolumeTestJSON-server-1295717929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1295717929',id=6,image_ref='8ac72bf7-6709-4b09-92e0-a06bd5d54f4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkA+tu4xg/6rZ+pvXuvXfIBfdfqlnJ3g+nPNNirxTLXyVXJfO8nlfKhzRDd8JVflZJBNfMF2WhhlVStReA2haNPNG8030TsTlfh5bzCyX6wU3jLESQSqScW09J0bJ51Kw==',key_name='tempest-keypair-698129803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d9a3bf2a3b4480a990adc9821005f7f',ramdisk_id='',reservation_id='r-9hhx54e5',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8ac72bf7-6709-4b09-92e0-a06bd5d54f4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-716976075',owner_user_name='tempest-AttachSCSIVolumeTestJSON-716976075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:41:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a1f606719a5435dbcb6092e0708b2cb',uuid=f1d10278-cf24-4fde-86eb-664ba86cbd8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed3a6f44-e7a4-41b0-9769-71beee125cb1", "address": "fa:16:3e:88:7b:f9", "network": {"id": "e70b6880-528f-41d8-b154-89eabc02efdb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1224931198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d9a3bf2a3b4480a990adc9821005f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped3a6f44-e7", "ovs_interfaceid": "ed3a6f44-e7a4-41b0-9769-71beee125cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:41:15 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Converting VIF {"id": "ed3a6f44-e7a4-41b0-9769-71beee125cb1", "address": "fa:16:3e:88:7b:f9", "network": {"id": "e70b6880-528f-41d8-b154-89eabc02efdb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1224931198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d9a3bf2a3b4480a990adc9821005f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped3a6f44-e7", "ovs_interfaceid": "ed3a6f44-e7a4-41b0-9769-71beee125cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:41:15 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:7b:f9,bridge_name='br-int',has_traffic_filtering=True,id=ed3a6f44-e7a4-41b0-9769-71beee125cb1,network=Network(e70b6880-528f-41d8-b154-89eabc02efdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped3a6f44-e7') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:41:15 user nova-compute[71498]: DEBUG os_vif [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:7b:f9,bridge_name='br-int',has_traffic_filtering=True,id=ed3a6f44-e7a4-41b0-9769-71beee125cb1,network=Network(e70b6880-528f-41d8-b154-89eabc02efdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped3a6f44-e7') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:41:15 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:15 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:41:15 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:41:15 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:15 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped3a6f44-e7, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:41:15 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=taped3a6f44-e7, col_values=(('external_ids', {'iface-id': 'ed3a6f44-e7a4-41b0-9769-71beee125cb1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:7b:f9', 'vm-uuid': 'f1d10278-cf24-4fde-86eb-664ba86cbd8f'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:41:15 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:15 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:41:15 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:15 user nova-compute[71498]: INFO os_vif [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:7b:f9,bridge_name='br-int',has_traffic_filtering=True,id=ed3a6f44-e7a4-41b0-9769-71beee125cb1,network=Network(e70b6880-528f-41d8-b154-89eabc02efdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped3a6f44-e7')
Apr 14 01:41:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] No BDM found with device name sda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:41:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:41:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] No VIF found with MAC fa:16:3e:88:7b:f9, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:41:15 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Using config drive
Apr 14 01:41:15 user nova-compute[71498]: DEBUG nova.compute.manager [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:41:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:41:15 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436475.3796813, f68784e7-578c-4a12-87d4-f35fbc5a1d59 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:41:15 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] VM Resumed (Lifecycle Event)
Apr 14 01:41:15 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:41:15 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Instance spawned successfully.
Apr 14 01:41:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:41:15 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:41:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:15 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:41:15 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436475.3798287, f68784e7-578c-4a12-87d4-f35fbc5a1d59 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:41:15 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] VM Started (Lifecycle Event)
Apr 14 01:41:15 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:41:15 user nova-compute[71498]: DEBUG nova.compute.manager [req-2f1e57c5-fb9e-434d-a883-800f992e0ace req-24c05f11-cfed-4278-a9be-ecde120a0f7b service nova] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Received event network-vif-plugged-08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:41:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-2f1e57c5-fb9e-434d-a883-800f992e0ace req-24c05f11-cfed-4278-a9be-ecde120a0f7b service nova] Acquiring lock "f68784e7-578c-4a12-87d4-f35fbc5a1d59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-2f1e57c5-fb9e-434d-a883-800f992e0ace req-24c05f11-cfed-4278-a9be-ecde120a0f7b service nova] Lock "f68784e7-578c-4a12-87d4-f35fbc5a1d59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-2f1e57c5-fb9e-434d-a883-800f992e0ace req-24c05f11-cfed-4278-a9be-ecde120a0f7b service nova] Lock "f68784e7-578c-4a12-87d4-f35fbc5a1d59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:15 user nova-compute[71498]: DEBUG nova.compute.manager [req-2f1e57c5-fb9e-434d-a883-800f992e0ace req-24c05f11-cfed-4278-a9be-ecde120a0f7b service nova] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] No waiting events found dispatching network-vif-plugged-08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:41:15 user nova-compute[71498]: WARNING nova.compute.manager [req-2f1e57c5-fb9e-434d-a883-800f992e0ace req-24c05f11-cfed-4278-a9be-ecde120a0f7b service nova] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Received unexpected event network-vif-plugged-08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd for instance with vm_state building and task_state spawning.
Apr 14 01:41:15 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:41:15 user nova-compute[71498]: INFO nova.compute.manager [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Took 10.36 seconds to spawn the instance on the hypervisor.
Apr 14 01:41:15 user nova-compute[71498]: DEBUG nova.compute.manager [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:41:15 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:41:15 user nova-compute[71498]: INFO nova.compute.manager [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Took 11.57 seconds to build instance.
Apr 14 01:41:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-747d0250-e903-4200-a822-dd8ee788416f tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "f68784e7-578c-4a12-87d4-f35fbc5a1d59" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.737s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:15 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Creating config drive at /opt/stack/data/nova/instances/f1d10278-cf24-4fde-86eb-664ba86cbd8f/disk.config
Apr 14 01:41:15 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f1d10278-cf24-4fde-86eb-664ba86cbd8f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpw21aib1u {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:16 user nova-compute[71498]: DEBUG nova.network.neutron [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Successfully updated port: 6762a294-eced-41bd-87c0-ac112e954d3a {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:41:16 user nova-compute[71498]: DEBUG nova.network.neutron [req-58d2fbf4-d024-4ed7-837d-993c1c865fea req-9a360b71-fde8-436a-b6b4-725212222fb1 service nova] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Updated VIF entry in instance network info cache for port ed3a6f44-e7a4-41b0-9769-71beee125cb1. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:41:16 user nova-compute[71498]: DEBUG nova.network.neutron [req-58d2fbf4-d024-4ed7-837d-993c1c865fea req-9a360b71-fde8-436a-b6b4-725212222fb1 service nova] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Updating instance_info_cache with network_info: [{"id": "ed3a6f44-e7a4-41b0-9769-71beee125cb1", "address": "fa:16:3e:88:7b:f9", "network": {"id": "e70b6880-528f-41d8-b154-89eabc02efdb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1224931198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d9a3bf2a3b4480a990adc9821005f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped3a6f44-e7", "ovs_interfaceid": "ed3a6f44-e7a4-41b0-9769-71beee125cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:41:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f1d10278-cf24-4fde-86eb-664ba86cbd8f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpw21aib1u" returned: 0 in 0.061s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "refresh_cache-f45130b1-9e83-47a0-b335-a6e74875b79e" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:41:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquired lock "refresh_cache-f45130b1-9e83-47a0-b335-a6e74875b79e" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:41:16 user nova-compute[71498]: DEBUG nova.network.neutron [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:41:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-58d2fbf4-d024-4ed7-837d-993c1c865fea req-9a360b71-fde8-436a-b6b4-725212222fb1 service nova] Releasing lock "refresh_cache-f1d10278-cf24-4fde-86eb-664ba86cbd8f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:41:16 user nova-compute[71498]: DEBUG nova.network.neutron [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:41:16 user nova-compute[71498]: DEBUG nova.network.neutron [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Updating instance_info_cache with network_info: [{"id": "6762a294-eced-41bd-87c0-ac112e954d3a", "address": "fa:16:3e:41:81:59", "network": {"id": "c7acaa49-fce0-41b5-8dd6-d5ef02e27e23", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1296085277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58f0122cc9864fcea660891e2826ca7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6762a294-ec", "ovs_interfaceid": "6762a294-eced-41bd-87c0-ac112e954d3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:41:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Releasing lock "refresh_cache-f45130b1-9e83-47a0-b335-a6e74875b79e" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:41:16 user nova-compute[71498]: DEBUG nova.compute.manager [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Instance network_info: |[{"id": "6762a294-eced-41bd-87c0-ac112e954d3a", "address": "fa:16:3e:41:81:59", "network": {"id": "c7acaa49-fce0-41b5-8dd6-d5ef02e27e23", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1296085277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58f0122cc9864fcea660891e2826ca7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6762a294-ec", "ovs_interfaceid": "6762a294-eced-41bd-87c0-ac112e954d3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 01:41:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Start _get_guest_xml network_info=[{"id": "6762a294-eced-41bd-87c0-ac112e954d3a", "address": "fa:16:3e:41:81:59", "network": {"id": "c7acaa49-fce0-41b5-8dd6-d5ef02e27e23", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1296085277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58f0122cc9864fcea660891e2826ca7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6762a294-ec", "ovs_interfaceid": "6762a294-eced-41bd-87c0-ac112e954d3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:41:16 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:41:16 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:41:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:41:16 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:41:16 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:41:16 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:41:16 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:41:16 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:41:16 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:41:16 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:41:16 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:41:16 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:41:16 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:41:16 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:41:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:41:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1373277645',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1373277645',id=7,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUT3ZOn0Mn2ktm54d2qA9xktIMZqL7Q40F6rrStB8sUhSSG/BBymdkGPGHtlWKKsqIfu1Qyxy455mqWjjowlE5hNoX4c7IQemPoagPLG/KJKleE/aVTRO8q8iRe5UAbxg==',key_name='tempest-keypair-658101980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='58f0122cc9864fcea660891e2826ca7b',ramdisk_id='',reservation_id='r-svkr1ynm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-242857735',owner_user_name='tempest-TaggedAttachmentsTest-242857735-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:41:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bada5cdb7704f6b956eb48b3729388d',uuid=f45130b1-9e83-47a0-b335-a6e74875b79e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6762a294-eced-41bd-87c0-ac112e954d3a", "address": "fa:16:3e:41:81:59", "network": {"id": "c7acaa49-fce0-41b5-8dd6-d5ef02e27e23", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1296085277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58f0122cc9864fcea660891e2826ca7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6762a294-ec", "ovs_interfaceid": "6762a294-eced-41bd-87c0-ac112e954d3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:41:16 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Converting VIF {"id": "6762a294-eced-41bd-87c0-ac112e954d3a", "address": "fa:16:3e:41:81:59", "network": {"id": "c7acaa49-fce0-41b5-8dd6-d5ef02e27e23", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1296085277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58f0122cc9864fcea660891e2826ca7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6762a294-ec", "ovs_interfaceid": "6762a294-eced-41bd-87c0-ac112e954d3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:41:16 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:81:59,bridge_name='br-int',has_traffic_filtering=True,id=6762a294-eced-41bd-87c0-ac112e954d3a,network=Network(c7acaa49-fce0-41b5-8dd6-d5ef02e27e23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6762a294-ec') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:41:16 user nova-compute[71498]: DEBUG nova.objects.instance [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lazy-loading 'pci_devices' on Instance uuid f45130b1-9e83-47a0-b335-a6e74875b79e {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:41:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:41:17 user nova-compute[71498]:   <uuid>f45130b1-9e83-47a0-b335-a6e74875b79e</uuid>
Apr 14 01:41:17 user nova-compute[71498]:   <name>instance-00000007</name>
Apr 14 01:41:17 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:41:17 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:41:17 user nova-compute[71498]:   <metadata>
Apr 14 01:41:17 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:41:17 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:41:17 user nova-compute[71498]:       <nova:name>tempest-device-tagging-server-1373277645</nova:name>
Apr 14 01:41:17 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:41:16</nova:creationTime>
Apr 14 01:41:17 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:41:17 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:41:17 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:41:17 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:41:17 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:41:17 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:41:17 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:41:17 user nova-compute[71498]:       <nova:owner>
Apr 14 01:41:17 user nova-compute[71498]:         <nova:user uuid="2bada5cdb7704f6b956eb48b3729388d">tempest-TaggedAttachmentsTest-242857735-project-member</nova:user>
Apr 14 01:41:17 user nova-compute[71498]:         <nova:project uuid="58f0122cc9864fcea660891e2826ca7b">tempest-TaggedAttachmentsTest-242857735</nova:project>
Apr 14 01:41:17 user nova-compute[71498]:       </nova:owner>
Apr 14 01:41:17 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:41:17 user nova-compute[71498]:       <nova:ports>
Apr 14 01:41:17 user nova-compute[71498]:         <nova:port uuid="6762a294-eced-41bd-87c0-ac112e954d3a">
Apr 14 01:41:17 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 01:41:17 user nova-compute[71498]:         </nova:port>
Apr 14 01:41:17 user nova-compute[71498]:       </nova:ports>
Apr 14 01:41:17 user nova-compute[71498]:     </nova:instance>
Apr 14 01:41:17 user nova-compute[71498]:   </metadata>
Apr 14 01:41:17 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:41:17 user nova-compute[71498]:     <system>
Apr 14 01:41:17 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:41:17 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:41:17 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:41:17 user nova-compute[71498]:       <entry name="serial">f45130b1-9e83-47a0-b335-a6e74875b79e</entry>
Apr 14 01:41:17 user nova-compute[71498]:       <entry name="uuid">f45130b1-9e83-47a0-b335-a6e74875b79e</entry>
Apr 14 01:41:17 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:41:17 user nova-compute[71498]:     </system>
Apr 14 01:41:17 user nova-compute[71498]:   </sysinfo>
Apr 14 01:41:17 user nova-compute[71498]:   <os>
Apr 14 01:41:17 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:41:17 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:41:17 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:41:17 user nova-compute[71498]:   </os>
Apr 14 01:41:17 user nova-compute[71498]:   <features>
Apr 14 01:41:17 user nova-compute[71498]:     <acpi/>
Apr 14 01:41:17 user nova-compute[71498]:     <apic/>
Apr 14 01:41:17 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:41:17 user nova-compute[71498]:   </features>
Apr 14 01:41:17 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:41:17 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:41:17 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:41:17 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:41:17 user nova-compute[71498]:   </clock>
Apr 14 01:41:17 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:41:17 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:41:17 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:41:17 user nova-compute[71498]:   </cpu>
Apr 14 01:41:17 user nova-compute[71498]:   <devices>
Apr 14 01:41:17 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:41:17 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:41:17 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/disk"/>
Apr 14 01:41:17 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:41:17 user nova-compute[71498]:     </disk>
Apr 14 01:41:17 user nova-compute[71498]:     <disk type="file" device="cdrom">
Apr 14 01:41:17 user nova-compute[71498]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 01:41:17 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/disk.config"/>
Apr 14 01:41:17 user nova-compute[71498]:       <target dev="hda" bus="ide"/>
Apr 14 01:41:17 user nova-compute[71498]:     </disk>
Apr 14 01:41:17 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:41:17 user nova-compute[71498]:       <mac address="fa:16:3e:41:81:59"/>
Apr 14 01:41:17 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:41:17 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:41:17 user nova-compute[71498]:       <target dev="tap6762a294-ec"/>
Apr 14 01:41:17 user nova-compute[71498]:     </interface>
Apr 14 01:41:17 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:41:17 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/console.log" append="off"/>
Apr 14 01:41:17 user nova-compute[71498]:     </serial>
Apr 14 01:41:17 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:41:17 user nova-compute[71498]:     <video>
Apr 14 01:41:17 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:41:17 user nova-compute[71498]:     </video>
Apr 14 01:41:17 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:41:17 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:41:17 user nova-compute[71498]:     </rng>
Apr 14 01:41:17 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:41:17 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:41:17 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:41:17 user nova-compute[71498]:     </memballoon>
Apr 14 01:41:17 user nova-compute[71498]:   </devices>
Apr 14 01:41:17 user nova-compute[71498]: </domain>
Apr 14 01:41:17 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:41:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:41:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1373277645',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1373277645',id=7,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUT3ZOn0Mn2ktm54d2qA9xktIMZqL7Q40F6rrStB8sUhSSG/BBymdkGPGHtlWKKsqIfu1Qyxy455mqWjjowlE5hNoX4c7IQemPoagPLG/KJKleE/aVTRO8q8iRe5UAbxg==',key_name='tempest-keypair-658101980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='58f0122cc9864fcea660891e2826ca7b',ramdisk_id='',reservation_id='r-svkr1ynm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-242857735',owner_user_name='tempest-TaggedAttachmentsTest-242857735-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:41:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bada5cdb7704f6b956eb48b3729388d',uuid=f45130b1-9e83-47a0-b335-a6e74875b79e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6762a294-eced-41bd-87c0-ac112e954d3a", "address": "fa:16:3e:41:81:59", "network": {"id": "c7acaa49-fce0-41b5-8dd6-d5ef02e27e23", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1296085277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58f0122cc9864fcea660891e2826ca7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6762a294-ec", "ovs_interfaceid": "6762a294-eced-41bd-87c0-ac112e954d3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:41:17 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Converting VIF {"id": "6762a294-eced-41bd-87c0-ac112e954d3a", "address": "fa:16:3e:41:81:59", "network": {"id": "c7acaa49-fce0-41b5-8dd6-d5ef02e27e23", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1296085277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58f0122cc9864fcea660891e2826ca7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6762a294-ec", "ovs_interfaceid": "6762a294-eced-41bd-87c0-ac112e954d3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:41:17 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:81:59,bridge_name='br-int',has_traffic_filtering=True,id=6762a294-eced-41bd-87c0-ac112e954d3a,network=Network(c7acaa49-fce0-41b5-8dd6-d5ef02e27e23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6762a294-ec') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:41:17 user nova-compute[71498]: DEBUG os_vif [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:81:59,bridge_name='br-int',has_traffic_filtering=True,id=6762a294-eced-41bd-87c0-ac112e954d3a,network=Network(c7acaa49-fce0-41b5-8dd6-d5ef02e27e23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6762a294-ec') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:41:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:41:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:41:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6762a294-ec, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:41:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6762a294-ec, col_values=(('external_ids', {'iface-id': '6762a294-eced-41bd-87c0-ac112e954d3a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:81:59', 'vm-uuid': 'f45130b1-9e83-47a0-b335-a6e74875b79e'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:41:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:41:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:17 user nova-compute[71498]: INFO os_vif [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:81:59,bridge_name='br-int',has_traffic_filtering=True,id=6762a294-eced-41bd-87c0-ac112e954d3a,network=Network(c7acaa49-fce0-41b5-8dd6-d5ef02e27e23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6762a294-ec')
Apr 14 01:41:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:41:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] No BDM found with device name hda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:41:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] No VIF found with MAC fa:16:3e:41:81:59, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:41:17 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Using config drive
Apr 14 01:41:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:17 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Creating config drive at /opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/disk.config
Apr 14 01:41:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpia1vufi8 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:17 user nova-compute[71498]: DEBUG nova.compute.manager [req-fc11d4d5-0400-4a9d-ad65-af5cb6d68f03 req-e74fa6ce-900f-437c-b288-e27c05a1f358 service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Received event network-changed-6762a294-eced-41bd-87c0-ac112e954d3a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:41:17 user nova-compute[71498]: DEBUG nova.compute.manager [req-fc11d4d5-0400-4a9d-ad65-af5cb6d68f03 req-e74fa6ce-900f-437c-b288-e27c05a1f358 service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Refreshing instance network info cache due to event network-changed-6762a294-eced-41bd-87c0-ac112e954d3a. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:41:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-fc11d4d5-0400-4a9d-ad65-af5cb6d68f03 req-e74fa6ce-900f-437c-b288-e27c05a1f358 service nova] Acquiring lock "refresh_cache-f45130b1-9e83-47a0-b335-a6e74875b79e" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:41:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-fc11d4d5-0400-4a9d-ad65-af5cb6d68f03 req-e74fa6ce-900f-437c-b288-e27c05a1f358 service nova] Acquired lock "refresh_cache-f45130b1-9e83-47a0-b335-a6e74875b79e" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:41:17 user nova-compute[71498]: DEBUG nova.network.neutron [req-fc11d4d5-0400-4a9d-ad65-af5cb6d68f03 req-e74fa6ce-900f-437c-b288-e27c05a1f358 service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Refreshing network info cache for port 6762a294-eced-41bd-87c0-ac112e954d3a {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:41:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpia1vufi8" returned: 0 in 0.087s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:17 user nova-compute[71498]: DEBUG nova.compute.manager [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 01:41:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:18 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:41:18 user nova-compute[71498]: INFO nova.compute.claims [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Claim successful on node user
Apr 14 01:41:18 user nova-compute[71498]: DEBUG nova.network.neutron [req-fc11d4d5-0400-4a9d-ad65-af5cb6d68f03 req-e74fa6ce-900f-437c-b288-e27c05a1f358 service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Updated VIF entry in instance network info cache for port 6762a294-eced-41bd-87c0-ac112e954d3a. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:41:18 user nova-compute[71498]: DEBUG nova.network.neutron [req-fc11d4d5-0400-4a9d-ad65-af5cb6d68f03 req-e74fa6ce-900f-437c-b288-e27c05a1f358 service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Updating instance_info_cache with network_info: [{"id": "6762a294-eced-41bd-87c0-ac112e954d3a", "address": "fa:16:3e:41:81:59", "network": {"id": "c7acaa49-fce0-41b5-8dd6-d5ef02e27e23", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1296085277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58f0122cc9864fcea660891e2826ca7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6762a294-ec", "ovs_interfaceid": "6762a294-eced-41bd-87c0-ac112e954d3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:41:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-fc11d4d5-0400-4a9d-ad65-af5cb6d68f03 req-e74fa6ce-900f-437c-b288-e27c05a1f358 service nova] Releasing lock "refresh_cache-f45130b1-9e83-47a0-b335-a6e74875b79e" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:41:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:19 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:41:19 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:41:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.139s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:19 user nova-compute[71498]: DEBUG nova.compute.manager [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 01:41:19 user nova-compute[71498]: DEBUG nova.compute.manager [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 01:41:19 user nova-compute[71498]: DEBUG nova.network.neutron [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:41:19 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 01:41:19 user nova-compute[71498]: DEBUG nova.compute.manager [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 01:41:19 user nova-compute[71498]: DEBUG nova.policy [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f6e19e75aa9d4cda971c8d2449e85290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e707623638044e983b557119edd7673', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:41:19 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:19 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:19 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:19 user nova-compute[71498]: DEBUG nova.compute.manager [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 01:41:19 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:41:19 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Creating image(s)
Apr 14 01:41:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "/opt/stack/data/nova/instances/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "/opt/stack/data/nova/instances/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "/opt/stack/data/nova/instances/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:19 user nova-compute[71498]: DEBUG nova.compute.manager [req-660e0c04-a9d4-40a3-9a86-fa8b35261b4c req-2a294154-2924-43c1-8b11-f88fd1044fce service nova] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Received event network-vif-plugged-ed3a6f44-e7a4-41b0-9769-71beee125cb1 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:41:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-660e0c04-a9d4-40a3-9a86-fa8b35261b4c req-2a294154-2924-43c1-8b11-f88fd1044fce service nova] Acquiring lock "f1d10278-cf24-4fde-86eb-664ba86cbd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-660e0c04-a9d4-40a3-9a86-fa8b35261b4c req-2a294154-2924-43c1-8b11-f88fd1044fce service nova] Lock "f1d10278-cf24-4fde-86eb-664ba86cbd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-660e0c04-a9d4-40a3-9a86-fa8b35261b4c req-2a294154-2924-43c1-8b11-f88fd1044fce service nova] Lock "f1d10278-cf24-4fde-86eb-664ba86cbd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:19 user nova-compute[71498]: DEBUG nova.compute.manager [req-660e0c04-a9d4-40a3-9a86-fa8b35261b4c req-2a294154-2924-43c1-8b11-f88fd1044fce service nova] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] No waiting events found dispatching network-vif-plugged-ed3a6f44-e7a4-41b0-9769-71beee125cb1 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:41:19 user nova-compute[71498]: WARNING nova.compute.manager [req-660e0c04-a9d4-40a3-9a86-fa8b35261b4c req-2a294154-2924-43c1-8b11-f88fd1044fce service nova] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Received unexpected event network-vif-plugged-ed3a6f44-e7a4-41b0-9769-71beee125cb1 for instance with vm_state building and task_state spawning.
Apr 14 01:41:19 user nova-compute[71498]: DEBUG nova.compute.manager [req-660e0c04-a9d4-40a3-9a86-fa8b35261b4c req-2a294154-2924-43c1-8b11-f88fd1044fce service nova] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Received event network-vif-plugged-ed3a6f44-e7a4-41b0-9769-71beee125cb1 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:41:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-660e0c04-a9d4-40a3-9a86-fa8b35261b4c req-2a294154-2924-43c1-8b11-f88fd1044fce service nova] Acquiring lock "f1d10278-cf24-4fde-86eb-664ba86cbd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-660e0c04-a9d4-40a3-9a86-fa8b35261b4c req-2a294154-2924-43c1-8b11-f88fd1044fce service nova] Lock "f1d10278-cf24-4fde-86eb-664ba86cbd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-660e0c04-a9d4-40a3-9a86-fa8b35261b4c req-2a294154-2924-43c1-8b11-f88fd1044fce service nova] Lock "f1d10278-cf24-4fde-86eb-664ba86cbd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:19 user nova-compute[71498]: DEBUG nova.compute.manager [req-660e0c04-a9d4-40a3-9a86-fa8b35261b4c req-2a294154-2924-43c1-8b11-f88fd1044fce service nova] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] No waiting events found dispatching network-vif-plugged-ed3a6f44-e7a4-41b0-9769-71beee125cb1 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:41:19 user nova-compute[71498]: WARNING nova.compute.manager [req-660e0c04-a9d4-40a3-9a86-fa8b35261b4c req-2a294154-2924-43c1-8b11-f88fd1044fce service nova] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Received unexpected event network-vif-plugged-ed3a6f44-e7a4-41b0-9769-71beee125cb1 for instance with vm_state building and task_state spawning.
Apr 14 01:41:20 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.226s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:20 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:20 user nova-compute[71498]: DEBUG nova.compute.manager [req-c70a5239-e67f-48cd-b3ff-7841b5fd4225 req-b22c5d36-b12f-4384-bf83-a9e1de845ea3 service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Received event network-vif-plugged-6762a294-eced-41bd-87c0-ac112e954d3a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:41:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c70a5239-e67f-48cd-b3ff-7841b5fd4225 req-b22c5d36-b12f-4384-bf83-a9e1de845ea3 service nova] Acquiring lock "f45130b1-9e83-47a0-b335-a6e74875b79e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c70a5239-e67f-48cd-b3ff-7841b5fd4225 req-b22c5d36-b12f-4384-bf83-a9e1de845ea3 service nova] Lock "f45130b1-9e83-47a0-b335-a6e74875b79e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c70a5239-e67f-48cd-b3ff-7841b5fd4225 req-b22c5d36-b12f-4384-bf83-a9e1de845ea3 service nova] Lock "f45130b1-9e83-47a0-b335-a6e74875b79e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:20 user nova-compute[71498]: DEBUG nova.compute.manager [req-c70a5239-e67f-48cd-b3ff-7841b5fd4225 req-b22c5d36-b12f-4384-bf83-a9e1de845ea3 service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] No waiting events found dispatching network-vif-plugged-6762a294-eced-41bd-87c0-ac112e954d3a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:41:20 user nova-compute[71498]: WARNING nova.compute.manager [req-c70a5239-e67f-48cd-b3ff-7841b5fd4225 req-b22c5d36-b12f-4384-bf83-a9e1de845ea3 service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Received unexpected event network-vif-plugged-6762a294-eced-41bd-87c0-ac112e954d3a for instance with vm_state building and task_state spawning.
Apr 14 01:41:20 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.194s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:20 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:20 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/disk 1073741824" returned: 0 in 0.084s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:20 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:20 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.167s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:20 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 01:41:20 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:20 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:20 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Cannot resize image /opt/stack/data/nova/instances/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 01:41:20 user nova-compute[71498]: DEBUG nova.objects.instance [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lazy-loading 'migration_context' on Instance uuid 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:41:20 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 01:41:20 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Ensure instance console log exists: /opt/stack/data/nova/instances/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:41:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:20 user nova-compute[71498]: DEBUG nova.network.neutron [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Successfully created port: 72f288aa-49e2-407b-9e41-47c8fd81286f {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:41:20 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:20 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:21 user nova-compute[71498]: DEBUG nova.network.neutron [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Successfully updated port: 72f288aa-49e2-407b-9e41-47c8fd81286f {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:41:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "refresh_cache-3decf8d9-7bb3-4395-a8b2-91c8dcf1880c" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:41:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquired lock "refresh_cache-3decf8d9-7bb3-4395-a8b2-91c8dcf1880c" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:41:21 user nova-compute[71498]: DEBUG nova.network.neutron [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:41:21 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436481.8468254, f1d10278-cf24-4fde-86eb-664ba86cbd8f => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:41:21 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] VM Resumed (Lifecycle Event)
Apr 14 01:41:21 user nova-compute[71498]: DEBUG nova.compute.manager [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:41:21 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:41:21 user nova-compute[71498]: DEBUG nova.compute.manager [req-25e23cff-d166-4a4b-8bda-f1679ef95dce req-f17de1e8-dde1-425a-b90b-ee51eb04224a service nova] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Received event network-changed-72f288aa-49e2-407b-9e41-47c8fd81286f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:41:21 user nova-compute[71498]: DEBUG nova.compute.manager [req-25e23cff-d166-4a4b-8bda-f1679ef95dce req-f17de1e8-dde1-425a-b90b-ee51eb04224a service nova] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Refreshing instance network info cache due to event network-changed-72f288aa-49e2-407b-9e41-47c8fd81286f. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:41:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-25e23cff-d166-4a4b-8bda-f1679ef95dce req-f17de1e8-dde1-425a-b90b-ee51eb04224a service nova] Acquiring lock "refresh_cache-3decf8d9-7bb3-4395-a8b2-91c8dcf1880c" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:41:21 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:41:21 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Instance spawned successfully.
Apr 14 01:41:21 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:41:21 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:41:21 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:21 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:21 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:21 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:21 user nova-compute[71498]: DEBUG nova.network.neutron [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:41:21 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:41:21 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436481.8526552, f1d10278-cf24-4fde-86eb-664ba86cbd8f => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:41:21 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] VM Started (Lifecycle Event)
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:41:22 user nova-compute[71498]: INFO nova.compute.manager [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Took 12.47 seconds to spawn the instance on the hypervisor.
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.compute.manager [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:41:22 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:41:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:22 user nova-compute[71498]: INFO nova.compute.manager [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Took 13.62 seconds to build instance.
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.compute.manager [req-89f558e3-5e9d-4ef8-8f86-0d922dc61d3b req-e879b69e-1c27-421b-9445-e3db992dd2b2 service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Received event network-vif-plugged-6762a294-eced-41bd-87c0-ac112e954d3a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-89f558e3-5e9d-4ef8-8f86-0d922dc61d3b req-e879b69e-1c27-421b-9445-e3db992dd2b2 service nova] Acquiring lock "f45130b1-9e83-47a0-b335-a6e74875b79e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-89f558e3-5e9d-4ef8-8f86-0d922dc61d3b req-e879b69e-1c27-421b-9445-e3db992dd2b2 service nova] Lock "f45130b1-9e83-47a0-b335-a6e74875b79e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-89f558e3-5e9d-4ef8-8f86-0d922dc61d3b req-e879b69e-1c27-421b-9445-e3db992dd2b2 service nova] Lock "f45130b1-9e83-47a0-b335-a6e74875b79e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.compute.manager [req-89f558e3-5e9d-4ef8-8f86-0d922dc61d3b req-e879b69e-1c27-421b-9445-e3db992dd2b2 service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] No waiting events found dispatching network-vif-plugged-6762a294-eced-41bd-87c0-ac112e954d3a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:41:22 user nova-compute[71498]: WARNING nova.compute.manager [req-89f558e3-5e9d-4ef8-8f86-0d922dc61d3b req-e879b69e-1c27-421b-9445-e3db992dd2b2 service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Received unexpected event network-vif-plugged-6762a294-eced-41bd-87c0-ac112e954d3a for instance with vm_state building and task_state spawning.
Apr 14 01:41:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-80b71eb5-5ec9-411f-845c-0f1bcbab478b tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "f1d10278-cf24-4fde-86eb-664ba86cbd8f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.937s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.network.neutron [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Updating instance_info_cache with network_info: [{"id": "72f288aa-49e2-407b-9e41-47c8fd81286f", "address": "fa:16:3e:17:11:af", "network": {"id": "335d6a15-36dc-4fbc-ae2a-08b44984eb3a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1640804392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e707623638044e983b557119edd7673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72f288aa-49", "ovs_interfaceid": "72f288aa-49e2-407b-9e41-47c8fd81286f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Releasing lock "refresh_cache-3decf8d9-7bb3-4395-a8b2-91c8dcf1880c" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.compute.manager [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Instance network_info: |[{"id": "72f288aa-49e2-407b-9e41-47c8fd81286f", "address": "fa:16:3e:17:11:af", "network": {"id": "335d6a15-36dc-4fbc-ae2a-08b44984eb3a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1640804392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e707623638044e983b557119edd7673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72f288aa-49", "ovs_interfaceid": "72f288aa-49e2-407b-9e41-47c8fd81286f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-25e23cff-d166-4a4b-8bda-f1679ef95dce req-f17de1e8-dde1-425a-b90b-ee51eb04224a service nova] Acquired lock "refresh_cache-3decf8d9-7bb3-4395-a8b2-91c8dcf1880c" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.network.neutron [req-25e23cff-d166-4a4b-8bda-f1679ef95dce req-f17de1e8-dde1-425a-b90b-ee51eb04224a service nova] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Refreshing network info cache for port 72f288aa-49e2-407b-9e41-47c8fd81286f {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Start _get_guest_xml network_info=[{"id": "72f288aa-49e2-407b-9e41-47c8fd81286f", "address": "fa:16:3e:17:11:af", "network": {"id": "335d6a15-36dc-4fbc-ae2a-08b44984eb3a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1640804392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e707623638044e983b557119edd7673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72f288aa-49", "ovs_interfaceid": "72f288aa-49e2-407b-9e41-47c8fd81286f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:41:22 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:41:22 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:41:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1080614213',display_name='tempest-TestVolumeSwap-server-1080614213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1080614213',id=8,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPNiUI2ug6LQUiapieczdsy9Wqi1WC3qcruFFPEMTuuD+5FKNmRUw7VMsnHH30l96OHFwUCmZQiDrlxZsDi3HAwnteFmFsj2Cvd/o8xLG4tOF7+RBcte95gdr83Q6b27w==',key_name='tempest-keypair-1595267406',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e707623638044e983b557119edd7673',ramdisk_id='',reservation_id='r-nf51tq0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-755712300',owner_user_name='tempest-TestVolumeSwap-755712300-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:41:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6e19e75aa9d4cda971c8d2449e85290',uuid=3decf8d9-7bb3-4395-a8b2-91c8dcf1880c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72f288aa-49e2-407b-9e41-47c8fd81286f", "address": "fa:16:3e:17:11:af", "network": {"id": "335d6a15-36dc-4fbc-ae2a-08b44984eb3a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1640804392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e707623638044e983b557119edd7673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72f288aa-49", "ovs_interfaceid": "72f288aa-49e2-407b-9e41-47c8fd81286f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Converting VIF {"id": "72f288aa-49e2-407b-9e41-47c8fd81286f", "address": "fa:16:3e:17:11:af", "network": {"id": "335d6a15-36dc-4fbc-ae2a-08b44984eb3a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1640804392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e707623638044e983b557119edd7673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72f288aa-49", "ovs_interfaceid": "72f288aa-49e2-407b-9e41-47c8fd81286f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:11:af,bridge_name='br-int',has_traffic_filtering=True,id=72f288aa-49e2-407b-9e41-47c8fd81286f,network=Network(335d6a15-36dc-4fbc-ae2a-08b44984eb3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72f288aa-49') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.objects.instance [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lazy-loading 'pci_devices' on Instance uuid 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:41:22 user nova-compute[71498]:   <uuid>3decf8d9-7bb3-4395-a8b2-91c8dcf1880c</uuid>
Apr 14 01:41:22 user nova-compute[71498]:   <name>instance-00000008</name>
Apr 14 01:41:22 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:41:22 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:41:22 user nova-compute[71498]:   <metadata>
Apr 14 01:41:22 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:41:22 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:41:22 user nova-compute[71498]:       <nova:name>tempest-TestVolumeSwap-server-1080614213</nova:name>
Apr 14 01:41:22 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:41:22</nova:creationTime>
Apr 14 01:41:22 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:41:22 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:41:22 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:41:22 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:41:22 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:41:22 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:41:22 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:41:22 user nova-compute[71498]:       <nova:owner>
Apr 14 01:41:22 user nova-compute[71498]:         <nova:user uuid="f6e19e75aa9d4cda971c8d2449e85290">tempest-TestVolumeSwap-755712300-project-member</nova:user>
Apr 14 01:41:22 user nova-compute[71498]:         <nova:project uuid="3e707623638044e983b557119edd7673">tempest-TestVolumeSwap-755712300</nova:project>
Apr 14 01:41:22 user nova-compute[71498]:       </nova:owner>
Apr 14 01:41:22 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:41:22 user nova-compute[71498]:       <nova:ports>
Apr 14 01:41:22 user nova-compute[71498]:         <nova:port uuid="72f288aa-49e2-407b-9e41-47c8fd81286f">
Apr 14 01:41:22 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 01:41:22 user nova-compute[71498]:         </nova:port>
Apr 14 01:41:22 user nova-compute[71498]:       </nova:ports>
Apr 14 01:41:22 user nova-compute[71498]:     </nova:instance>
Apr 14 01:41:22 user nova-compute[71498]:   </metadata>
Apr 14 01:41:22 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:41:22 user nova-compute[71498]:     <system>
Apr 14 01:41:22 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:41:22 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:41:22 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:41:22 user nova-compute[71498]:       <entry name="serial">3decf8d9-7bb3-4395-a8b2-91c8dcf1880c</entry>
Apr 14 01:41:22 user nova-compute[71498]:       <entry name="uuid">3decf8d9-7bb3-4395-a8b2-91c8dcf1880c</entry>
Apr 14 01:41:22 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:41:22 user nova-compute[71498]:     </system>
Apr 14 01:41:22 user nova-compute[71498]:   </sysinfo>
Apr 14 01:41:22 user nova-compute[71498]:   <os>
Apr 14 01:41:22 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:41:22 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:41:22 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:41:22 user nova-compute[71498]:   </os>
Apr 14 01:41:22 user nova-compute[71498]:   <features>
Apr 14 01:41:22 user nova-compute[71498]:     <acpi/>
Apr 14 01:41:22 user nova-compute[71498]:     <apic/>
Apr 14 01:41:22 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:41:22 user nova-compute[71498]:   </features>
Apr 14 01:41:22 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:41:22 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:41:22 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:41:22 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:41:22 user nova-compute[71498]:   </clock>
Apr 14 01:41:22 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:41:22 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:41:22 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:41:22 user nova-compute[71498]:   </cpu>
Apr 14 01:41:22 user nova-compute[71498]:   <devices>
Apr 14 01:41:22 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:41:22 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:41:22 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/disk"/>
Apr 14 01:41:22 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:41:22 user nova-compute[71498]:     </disk>
Apr 14 01:41:22 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:41:22 user nova-compute[71498]:       <mac address="fa:16:3e:17:11:af"/>
Apr 14 01:41:22 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:41:22 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:41:22 user nova-compute[71498]:       <target dev="tap72f288aa-49"/>
Apr 14 01:41:22 user nova-compute[71498]:     </interface>
Apr 14 01:41:22 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:41:22 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/console.log" append="off"/>
Apr 14 01:41:22 user nova-compute[71498]:     </serial>
Apr 14 01:41:22 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:41:22 user nova-compute[71498]:     <video>
Apr 14 01:41:22 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:41:22 user nova-compute[71498]:     </video>
Apr 14 01:41:22 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:41:22 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:41:22 user nova-compute[71498]:     </rng>
Apr 14 01:41:22 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:41:22 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:41:22 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:41:22 user nova-compute[71498]:     </memballoon>
Apr 14 01:41:22 user nova-compute[71498]:   </devices>
Apr 14 01:41:22 user nova-compute[71498]: </domain>
Apr 14 01:41:22 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:41:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1080614213',display_name='tempest-TestVolumeSwap-server-1080614213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1080614213',id=8,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPNiUI2ug6LQUiapieczdsy9Wqi1WC3qcruFFPEMTuuD+5FKNmRUw7VMsnHH30l96OHFwUCmZQiDrlxZsDi3HAwnteFmFsj2Cvd/o8xLG4tOF7+RBcte95gdr83Q6b27w==',key_name='tempest-keypair-1595267406',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e707623638044e983b557119edd7673',ramdisk_id='',reservation_id='r-nf51tq0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-755712300',owner_user_name='tempest-TestVolumeSwap-755712300-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:41:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6e19e75aa9d4cda971c8d2449e85290',uuid=3decf8d9-7bb3-4395-a8b2-91c8dcf1880c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72f288aa-49e2-407b-9e41-47c8fd81286f", "address": "fa:16:3e:17:11:af", "network": {"id": "335d6a15-36dc-4fbc-ae2a-08b44984eb3a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1640804392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e707623638044e983b557119edd7673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72f288aa-49", "ovs_interfaceid": "72f288aa-49e2-407b-9e41-47c8fd81286f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Converting VIF {"id": "72f288aa-49e2-407b-9e41-47c8fd81286f", "address": "fa:16:3e:17:11:af", "network": {"id": "335d6a15-36dc-4fbc-ae2a-08b44984eb3a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1640804392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e707623638044e983b557119edd7673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72f288aa-49", "ovs_interfaceid": "72f288aa-49e2-407b-9e41-47c8fd81286f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:11:af,bridge_name='br-int',has_traffic_filtering=True,id=72f288aa-49e2-407b-9e41-47c8fd81286f,network=Network(335d6a15-36dc-4fbc-ae2a-08b44984eb3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72f288aa-49') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG os_vif [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:11:af,bridge_name='br-int',has_traffic_filtering=True,id=72f288aa-49e2-407b-9e41-47c8fd81286f,network=Network(335d6a15-36dc-4fbc-ae2a-08b44984eb3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72f288aa-49') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72f288aa-49, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap72f288aa-49, col_values=(('external_ids', {'iface-id': '72f288aa-49e2-407b-9e41-47c8fd81286f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:11:af', 'vm-uuid': '3decf8d9-7bb3-4395-a8b2-91c8dcf1880c'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:22 user nova-compute[71498]: INFO os_vif [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:11:af,bridge_name='br-int',has_traffic_filtering=True,id=72f288aa-49e2-407b-9e41-47c8fd81286f,network=Network(335d6a15-36dc-4fbc-ae2a-08b44984eb3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72f288aa-49')
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436482.6021194, f45130b1-9e83-47a0-b335-a6e74875b79e => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:41:22 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] VM Resumed (Lifecycle Event)
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.compute.manager [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] No VIF found with MAC fa:16:3e:17:11:af, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:41:22 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Instance spawned successfully.
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:41:22 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436482.6063764, f45130b1-9e83-47a0-b335-a6e74875b79e => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:41:22 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] VM Started (Lifecycle Event)
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:41:22 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:41:22 user nova-compute[71498]: INFO nova.compute.manager [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Took 9.67 seconds to spawn the instance on the hypervisor.
Apr 14 01:41:22 user nova-compute[71498]: DEBUG nova.compute.manager [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:41:22 user nova-compute[71498]: INFO nova.compute.manager [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Took 10.95 seconds to build instance.
Apr 14 01:41:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-84353cff-d40b-4a88-9a8a-441a8dad1cab tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "f45130b1-9e83-47a0-b335-a6e74875b79e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.159s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:23 user nova-compute[71498]: DEBUG nova.network.neutron [req-25e23cff-d166-4a4b-8bda-f1679ef95dce req-f17de1e8-dde1-425a-b90b-ee51eb04224a service nova] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Updated VIF entry in instance network info cache for port 72f288aa-49e2-407b-9e41-47c8fd81286f. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:41:23 user nova-compute[71498]: DEBUG nova.network.neutron [req-25e23cff-d166-4a4b-8bda-f1679ef95dce req-f17de1e8-dde1-425a-b90b-ee51eb04224a service nova] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Updating instance_info_cache with network_info: [{"id": "72f288aa-49e2-407b-9e41-47c8fd81286f", "address": "fa:16:3e:17:11:af", "network": {"id": "335d6a15-36dc-4fbc-ae2a-08b44984eb3a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1640804392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e707623638044e983b557119edd7673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72f288aa-49", "ovs_interfaceid": "72f288aa-49e2-407b-9e41-47c8fd81286f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:41:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-25e23cff-d166-4a4b-8bda-f1679ef95dce req-f17de1e8-dde1-425a-b90b-ee51eb04224a service nova] Releasing lock "refresh_cache-3decf8d9-7bb3-4395-a8b2-91c8dcf1880c" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:41:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:24 user nova-compute[71498]: DEBUG nova.compute.manager [req-3646fcd6-8124-43a8-ae12-cc5f1d745557 req-ece94045-dc40-486c-b157-1e195f496124 service nova] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Received event network-vif-plugged-72f288aa-49e2-407b-9e41-47c8fd81286f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:41:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3646fcd6-8124-43a8-ae12-cc5f1d745557 req-ece94045-dc40-486c-b157-1e195f496124 service nova] Acquiring lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3646fcd6-8124-43a8-ae12-cc5f1d745557 req-ece94045-dc40-486c-b157-1e195f496124 service nova] Lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3646fcd6-8124-43a8-ae12-cc5f1d745557 req-ece94045-dc40-486c-b157-1e195f496124 service nova] Lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:24 user nova-compute[71498]: DEBUG nova.compute.manager [req-3646fcd6-8124-43a8-ae12-cc5f1d745557 req-ece94045-dc40-486c-b157-1e195f496124 service nova] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] No waiting events found dispatching network-vif-plugged-72f288aa-49e2-407b-9e41-47c8fd81286f {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:41:24 user nova-compute[71498]: WARNING nova.compute.manager [req-3646fcd6-8124-43a8-ae12-cc5f1d745557 req-ece94045-dc40-486c-b157-1e195f496124 service nova] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Received unexpected event network-vif-plugged-72f288aa-49e2-407b-9e41-47c8fd81286f for instance with vm_state building and task_state spawning.
Apr 14 01:41:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:26 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:41:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Cleaning up deleted instances {{(pid=71498) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 01:41:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] There are 0 instances to clean {{(pid=71498) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 01:41:26 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:41:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Cleaning up deleted instances with incomplete migration  {{(pid=71498) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 01:41:26 user nova-compute[71498]: DEBUG nova.compute.manager [req-a4ce9158-bd9d-4c81-bca1-7d2035d80b71 req-3da44a57-af6a-4f18-9007-407f41968546 service nova] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Received event network-vif-plugged-72f288aa-49e2-407b-9e41-47c8fd81286f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:41:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a4ce9158-bd9d-4c81-bca1-7d2035d80b71 req-3da44a57-af6a-4f18-9007-407f41968546 service nova] Acquiring lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a4ce9158-bd9d-4c81-bca1-7d2035d80b71 req-3da44a57-af6a-4f18-9007-407f41968546 service nova] Lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a4ce9158-bd9d-4c81-bca1-7d2035d80b71 req-3da44a57-af6a-4f18-9007-407f41968546 service nova] Lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:26 user nova-compute[71498]: DEBUG nova.compute.manager [req-a4ce9158-bd9d-4c81-bca1-7d2035d80b71 req-3da44a57-af6a-4f18-9007-407f41968546 service nova] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] No waiting events found dispatching network-vif-plugged-72f288aa-49e2-407b-9e41-47c8fd81286f {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:41:26 user nova-compute[71498]: WARNING nova.compute.manager [req-a4ce9158-bd9d-4c81-bca1-7d2035d80b71 req-3da44a57-af6a-4f18-9007-407f41968546 service nova] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Received unexpected event network-vif-plugged-72f288aa-49e2-407b-9e41-47c8fd81286f for instance with vm_state building and task_state spawning.
Apr 14 01:41:26 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:41:26 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436486.602079, 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:41:26 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] VM Resumed (Lifecycle Event)
Apr 14 01:41:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:41:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:41:26 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Instance spawned successfully.
Apr 14 01:41:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:41:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:41:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:41:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:26 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:41:26 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436486.6069965, 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:41:26 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] VM Started (Lifecycle Event)
Apr 14 01:41:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:41:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:41:26 user nova-compute[71498]: INFO nova.compute.manager [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Took 7.03 seconds to spawn the instance on the hypervisor.
Apr 14 01:41:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:41:26 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:41:26 user nova-compute[71498]: INFO nova.compute.manager [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Took 8.85 seconds to build instance.
Apr 14 01:41:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ce026eca-6a57-44af-97a7-9e7b17dfdc87 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.175s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:28 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:41:28 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:41:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:28 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 01:41:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/039d0702-d115-4c25-ab88-d669c6320820/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/039d0702-d115-4c25-ab88-d669c6320820/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/039d0702-d115-4c25-ab88-d669c6320820/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/039d0702-d115-4c25-ab88-d669c6320820/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d10278-cf24-4fde-86eb-664ba86cbd8f/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d10278-cf24-4fde-86eb-664ba86cbd8f/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d10278-cf24-4fde-86eb-664ba86cbd8f/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d10278-cf24-4fde-86eb-664ba86cbd8f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:32 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:41:32 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:41:32 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=7819MB free_disk=26.690284729003906GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 01:41:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:32 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance da60f4f1-2474-453f-8f84-c95daf02431a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:41:32 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:41:32 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 039d0702-d115-4c25-ab88-d669c6320820 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:41:32 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:41:32 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance f68784e7-578c-4a12-87d4-f35fbc5a1d59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:41:32 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance f1d10278-cf24-4fde-86eb-664ba86cbd8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:41:32 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance f45130b1-9e83-47a0-b335-a6e74875b79e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:41:32 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:41:32 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 01:41:32 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 01:41:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:33 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:41:33 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:41:33 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 01:41:33 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.333s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:34 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:41:34 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 01:41:34 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Rebuilding the list of instances to heal {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 01:41:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-da60f4f1-2474-453f-8f84-c95daf02431a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:41:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-da60f4f1-2474-453f-8f84-c95daf02431a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:41:34 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 01:41:34 user nova-compute[71498]: DEBUG nova.objects.instance [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lazy-loading 'info_cache' on Instance uuid da60f4f1-2474-453f-8f84-c95daf02431a {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:41:35 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Updating instance_info_cache with network_info: [{"id": "b8356c3e-ccfb-44ae-8020-af80bcb28a43", "address": "fa:16:3e:ad:43:af", "network": {"id": "93155729-11d3-4eff-bbd2-8860a881e233", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047423124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "907f632263e04bf2a6c8ff1bae77a5c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8356c3e-cc", "ovs_interfaceid": "b8356c3e-ccfb-44ae-8020-af80bcb28a43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:41:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-da60f4f1-2474-453f-8f84-c95daf02431a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:41:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 01:41:35 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:41:35 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:41:35 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:41:35 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:41:35 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:41:35 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:41:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 01:41:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:47 user nova-compute[71498]: DEBUG nova.compute.manager [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 01:41:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:48 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:41:48 user nova-compute[71498]: INFO nova.compute.claims [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Claim successful on node user
Apr 14 01:41:48 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Refreshing inventories for resource provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 01:41:48 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Updating ProviderTree inventory for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 01:41:48 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Updating inventory in ProviderTree for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 01:41:48 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Refreshing aggregate associations for resource provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4, aggregates: None {{(pid=71498) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 01:41:48 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Refreshing trait associations for resource provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,HW_CPU_X86_SSE2 {{(pid=71498) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 01:41:48 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:41:48 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:41:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.557s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:48 user nova-compute[71498]: DEBUG nova.compute.manager [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 01:41:48 user nova-compute[71498]: DEBUG nova.compute.manager [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 01:41:48 user nova-compute[71498]: DEBUG nova.network.neutron [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:41:48 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 01:41:48 user nova-compute[71498]: DEBUG nova.compute.manager [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 01:41:48 user nova-compute[71498]: INFO nova.virt.block_device [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Booting with volume 5e9b1e2c-15a4-481a-a713-fa24dca0918e at /dev/vda
Apr 14 01:41:49 user nova-compute[71498]: DEBUG nova.policy [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '692d1dd6aa73472a9c63049910360a0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113733a7b1f9424bb5243107472b01c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:41:49 user nova-compute[71498]: DEBUG os_brick.utils [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:41:49 user nova-compute[71498]: INFO oslo.privsep.daemon [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmphjaxxu13/privsep.sock']
Apr 14 01:41:49 user sudo[81717]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmphjaxxu13/privsep.sock
Apr 14 01:41:49 user sudo[81717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 14 01:41:49 user nova-compute[71498]: DEBUG nova.network.neutron [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Successfully created port: 3522bbcc-4190-48e3-ab01-ae36f8d6d64e {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:41:50 user nova-compute[71498]: DEBUG nova.network.neutron [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Successfully created port: d44e7f03-f338-4efa-b6b4-fb90d22aa37c {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:41:50 user sudo[81717]: pam_unix(sudo:session): session closed for user root
Apr 14 01:41:50 user nova-compute[71498]: INFO oslo.privsep.daemon [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Spawned new privsep daemon via rootwrap
Apr 14 01:41:50 user nova-compute[71498]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 14 01:41:50 user nova-compute[71498]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 14 01:41:50 user nova-compute[71498]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Apr 14 01:41:50 user nova-compute[71498]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81721
Apr 14 01:41:50 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccec3bd-9d6b-402a-bbcc-7378fd61dc7b]: (2,) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:41:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:51 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c034db4f-7074-42d0-b672-00c0d28da078]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:41:51 user nova-compute[71498]: WARNING os_brick.initiator.connectors.nvmeof [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Apr 14 01:41:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:51 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d817d82-89a6-41e2-97d6-759901f295af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:41:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:51 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc5cc8c-66a9-4468-8dbe-8f4d19f9fa60]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:41:51 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c76969-b33b-4dea-ab90-1a8cc6ce573f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:41:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:41:51 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:41:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:41:51 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:41:51 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e7724d-b8b7-47cf-9df5-2cd1f2256bf9]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:41:51 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:41:51 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:41:51 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:41:51 user nova-compute[71498]: DEBUG os_brick.utils [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] <== get_connector_properties: return (2213ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:41:51 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Updating existing volume attachment record: a2d4b20a-282f-4cf8-b9cb-1bb84bcb8db0 {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:41:51 user nova-compute[71498]: DEBUG nova.network.neutron [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Successfully created port: 2b26233c-8774-42ae-9f2f-8794c8e364a1 {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:41:51 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "9397a9e2-b5e9-47e7-b25e-5c40379a60eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "9397a9e2-b5e9-47e7-b25e-5c40379a60eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:52 user nova-compute[71498]: DEBUG nova.compute.manager [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 01:41:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:52 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:41:52 user nova-compute[71498]: INFO nova.compute.claims [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Claim successful on node user
Apr 14 01:41:52 user nova-compute[71498]: DEBUG nova.network.neutron [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Successfully created port: 592ca281-1142-433c-996f-54b6bdce948b {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:41:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:52 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:41:52 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:41:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.532s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:52 user nova-compute[71498]: DEBUG nova.compute.manager [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 01:41:52 user nova-compute[71498]: DEBUG nova.compute.manager [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 01:41:52 user nova-compute[71498]: DEBUG nova.network.neutron [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:41:52 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 01:41:52 user nova-compute[71498]: DEBUG nova.compute.manager [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 01:41:53 user nova-compute[71498]: DEBUG nova.policy [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8b18b911fcf847efbf4f814f3b687279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb176ac656c47b38e736fc629fc46e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:41:53 user nova-compute[71498]: DEBUG nova.network.neutron [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Successfully created port: 933d0949-bd1a-4905-ae6a-e15e6b6e72dd {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:41:53 user nova-compute[71498]: DEBUG nova.compute.manager [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 01:41:53 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:41:53 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Creating image(s)
Apr 14 01:41:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "/opt/stack/data/nova/instances/9397a9e2-b5e9-47e7-b25e-5c40379a60eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "/opt/stack/data/nova/instances/9397a9e2-b5e9-47e7-b25e-5c40379a60eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "/opt/stack/data/nova/instances/9397a9e2-b5e9-47e7-b25e-5c40379a60eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.167s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.140s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/9397a9e2-b5e9-47e7-b25e-5c40379a60eb/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/9397a9e2-b5e9-47e7-b25e-5c40379a60eb/disk 1073741824" returned: 0 in 0.060s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.157s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:53 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9397a9e2-b5e9-47e7-b25e-5c40379a60eb/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 01:41:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9397a9e2-b5e9-47e7-b25e-5c40379a60eb/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9397a9e2-b5e9-47e7-b25e-5c40379a60eb/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:53 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Cannot resize image /opt/stack/data/nova/instances/9397a9e2-b5e9-47e7-b25e-5c40379a60eb/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 01:41:53 user nova-compute[71498]: DEBUG nova.objects.instance [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lazy-loading 'migration_context' on Instance uuid 9397a9e2-b5e9-47e7-b25e-5c40379a60eb {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:41:53 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 01:41:53 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Ensure instance console log exists: /opt/stack/data/nova/instances/9397a9e2-b5e9-47e7-b25e-5c40379a60eb/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:41:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:53 user nova-compute[71498]: DEBUG nova.network.neutron [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Successfully updated port: 3522bbcc-4190-48e3-ab01-ae36f8d6d64e {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:41:53 user nova-compute[71498]: DEBUG nova.compute.manager [req-4c9dde27-8255-4a7d-b5af-c4390afc9c4e req-b1fdff1f-c1aa-4a1e-a371-e5007fae7e17 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-changed-3522bbcc-4190-48e3-ab01-ae36f8d6d64e {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:41:53 user nova-compute[71498]: DEBUG nova.compute.manager [req-4c9dde27-8255-4a7d-b5af-c4390afc9c4e req-b1fdff1f-c1aa-4a1e-a371-e5007fae7e17 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Refreshing instance network info cache due to event network-changed-3522bbcc-4190-48e3-ab01-ae36f8d6d64e. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:41:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4c9dde27-8255-4a7d-b5af-c4390afc9c4e req-b1fdff1f-c1aa-4a1e-a371-e5007fae7e17 service nova] Acquiring lock "refresh_cache-bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:41:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4c9dde27-8255-4a7d-b5af-c4390afc9c4e req-b1fdff1f-c1aa-4a1e-a371-e5007fae7e17 service nova] Acquired lock "refresh_cache-bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:41:53 user nova-compute[71498]: DEBUG nova.network.neutron [req-4c9dde27-8255-4a7d-b5af-c4390afc9c4e req-b1fdff1f-c1aa-4a1e-a371-e5007fae7e17 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Refreshing network info cache for port 3522bbcc-4190-48e3-ab01-ae36f8d6d64e {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:41:54 user nova-compute[71498]: DEBUG nova.network.neutron [req-4c9dde27-8255-4a7d-b5af-c4390afc9c4e req-b1fdff1f-c1aa-4a1e-a371-e5007fae7e17 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:41:54 user nova-compute[71498]: DEBUG nova.network.neutron [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Successfully created port: 084feebd-4d90-4eab-b8ec-346c32858b42 {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:41:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:54 user nova-compute[71498]: DEBUG nova.network.neutron [req-4c9dde27-8255-4a7d-b5af-c4390afc9c4e req-b1fdff1f-c1aa-4a1e-a371-e5007fae7e17 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:41:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4c9dde27-8255-4a7d-b5af-c4390afc9c4e req-b1fdff1f-c1aa-4a1e-a371-e5007fae7e17 service nova] Releasing lock "refresh_cache-bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG nova.network.neutron [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Successfully updated port: 084feebd-4d90-4eab-b8ec-346c32858b42 {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "refresh_cache-9397a9e2-b5e9-47e7-b25e-5c40379a60eb" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquired lock "refresh_cache-9397a9e2-b5e9-47e7-b25e-5c40379a60eb" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG nova.network.neutron [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG nova.compute.manager [req-e8cace16-d154-459b-92af-8f4af25c9546 req-629be5fe-718c-4a0a-a6a7-1e2c77b9a8b6 service nova] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Received event network-changed-084feebd-4d90-4eab-b8ec-346c32858b42 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG nova.compute.manager [req-e8cace16-d154-459b-92af-8f4af25c9546 req-629be5fe-718c-4a0a-a6a7-1e2c77b9a8b6 service nova] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Refreshing instance network info cache due to event network-changed-084feebd-4d90-4eab-b8ec-346c32858b42. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e8cace16-d154-459b-92af-8f4af25c9546 req-629be5fe-718c-4a0a-a6a7-1e2c77b9a8b6 service nova] Acquiring lock "refresh_cache-9397a9e2-b5e9-47e7-b25e-5c40379a60eb" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG nova.network.neutron [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG nova.network.neutron [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Successfully updated port: eee87019-7923-4e16-8e15-f2a1010616e3 {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG nova.network.neutron [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Updating instance_info_cache with network_info: [{"id": "084feebd-4d90-4eab-b8ec-346c32858b42", "address": "fa:16:3e:31:eb:07", "network": {"id": "d2f0bf5d-7422-436e-82b2-95cfe8eb77bd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1126078103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cdb176ac656c47b38e736fc629fc46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084feebd-4d", "ovs_interfaceid": "084feebd-4d90-4eab-b8ec-346c32858b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Releasing lock "refresh_cache-9397a9e2-b5e9-47e7-b25e-5c40379a60eb" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG nova.compute.manager [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Instance network_info: |[{"id": "084feebd-4d90-4eab-b8ec-346c32858b42", "address": "fa:16:3e:31:eb:07", "network": {"id": "d2f0bf5d-7422-436e-82b2-95cfe8eb77bd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1126078103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cdb176ac656c47b38e736fc629fc46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084feebd-4d", "ovs_interfaceid": "084feebd-4d90-4eab-b8ec-346c32858b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e8cace16-d154-459b-92af-8f4af25c9546 req-629be5fe-718c-4a0a-a6a7-1e2c77b9a8b6 service nova] Acquired lock "refresh_cache-9397a9e2-b5e9-47e7-b25e-5c40379a60eb" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG nova.network.neutron [req-e8cace16-d154-459b-92af-8f4af25c9546 req-629be5fe-718c-4a0a-a6a7-1e2c77b9a8b6 service nova] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Refreshing network info cache for port 084feebd-4d90-4eab-b8ec-346c32858b42 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Start _get_guest_xml network_info=[{"id": "084feebd-4d90-4eab-b8ec-346c32858b42", "address": "fa:16:3e:31:eb:07", "network": {"id": "d2f0bf5d-7422-436e-82b2-95cfe8eb77bd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1126078103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cdb176ac656c47b38e736fc629fc46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084feebd-4d", "ovs_interfaceid": "084feebd-4d90-4eab-b8ec-346c32858b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:41:55 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:41:55 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:41:55 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:41:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-888539893',display_name='tempest-VolumesActionsTest-instance-888539893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-888539893',id=10,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cdb176ac656c47b38e736fc629fc46e0',ramdisk_id='',reservation_id='r-lc3velri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-193871514',owner_user_name='tempest-VolumesActionsTest-193871514-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:41:53Z,user_data=None,user_id='8b18b911fcf847efbf4f814f3b687279',uuid=9397a9e2-b5e9-47e7-b25e-5c40379a60eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "084feebd-4d90-4eab-b8ec-346c32858b42", "address": "fa:16:3e:31:eb:07", "network": {"id": "d2f0bf5d-7422-436e-82b2-95cfe8eb77bd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1126078103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cdb176ac656c47b38e736fc629fc46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084feebd-4d", "ovs_interfaceid": "084feebd-4d90-4eab-b8ec-346c32858b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Converting VIF {"id": "084feebd-4d90-4eab-b8ec-346c32858b42", "address": "fa:16:3e:31:eb:07", "network": {"id": "d2f0bf5d-7422-436e-82b2-95cfe8eb77bd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1126078103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cdb176ac656c47b38e736fc629fc46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084feebd-4d", "ovs_interfaceid": "084feebd-4d90-4eab-b8ec-346c32858b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:eb:07,bridge_name='br-int',has_traffic_filtering=True,id=084feebd-4d90-4eab-b8ec-346c32858b42,network=Network(d2f0bf5d-7422-436e-82b2-95cfe8eb77bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084feebd-4d') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG nova.objects.instance [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lazy-loading 'pci_devices' on Instance uuid 9397a9e2-b5e9-47e7-b25e-5c40379a60eb {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:41:55 user nova-compute[71498]:   <uuid>9397a9e2-b5e9-47e7-b25e-5c40379a60eb</uuid>
Apr 14 01:41:55 user nova-compute[71498]:   <name>instance-0000000a</name>
Apr 14 01:41:55 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:41:55 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:41:55 user nova-compute[71498]:   <metadata>
Apr 14 01:41:55 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:41:55 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:41:55 user nova-compute[71498]:       <nova:name>tempest-VolumesActionsTest-instance-888539893</nova:name>
Apr 14 01:41:55 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:41:55</nova:creationTime>
Apr 14 01:41:55 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:41:55 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:41:55 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:41:55 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:41:55 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:41:55 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:41:55 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:41:55 user nova-compute[71498]:       <nova:owner>
Apr 14 01:41:55 user nova-compute[71498]:         <nova:user uuid="8b18b911fcf847efbf4f814f3b687279">tempest-VolumesActionsTest-193871514-project-member</nova:user>
Apr 14 01:41:55 user nova-compute[71498]:         <nova:project uuid="cdb176ac656c47b38e736fc629fc46e0">tempest-VolumesActionsTest-193871514</nova:project>
Apr 14 01:41:55 user nova-compute[71498]:       </nova:owner>
Apr 14 01:41:55 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:41:55 user nova-compute[71498]:       <nova:ports>
Apr 14 01:41:55 user nova-compute[71498]:         <nova:port uuid="084feebd-4d90-4eab-b8ec-346c32858b42">
Apr 14 01:41:55 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 14 01:41:55 user nova-compute[71498]:         </nova:port>
Apr 14 01:41:55 user nova-compute[71498]:       </nova:ports>
Apr 14 01:41:55 user nova-compute[71498]:     </nova:instance>
Apr 14 01:41:55 user nova-compute[71498]:   </metadata>
Apr 14 01:41:55 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:41:55 user nova-compute[71498]:     <system>
Apr 14 01:41:55 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:41:55 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:41:55 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:41:55 user nova-compute[71498]:       <entry name="serial">9397a9e2-b5e9-47e7-b25e-5c40379a60eb</entry>
Apr 14 01:41:55 user nova-compute[71498]:       <entry name="uuid">9397a9e2-b5e9-47e7-b25e-5c40379a60eb</entry>
Apr 14 01:41:55 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:41:55 user nova-compute[71498]:     </system>
Apr 14 01:41:55 user nova-compute[71498]:   </sysinfo>
Apr 14 01:41:55 user nova-compute[71498]:   <os>
Apr 14 01:41:55 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:41:55 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:41:55 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:41:55 user nova-compute[71498]:   </os>
Apr 14 01:41:55 user nova-compute[71498]:   <features>
Apr 14 01:41:55 user nova-compute[71498]:     <acpi/>
Apr 14 01:41:55 user nova-compute[71498]:     <apic/>
Apr 14 01:41:55 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:41:55 user nova-compute[71498]:   </features>
Apr 14 01:41:55 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:41:55 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:41:55 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:41:55 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:41:55 user nova-compute[71498]:   </clock>
Apr 14 01:41:55 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:41:55 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:41:55 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:41:55 user nova-compute[71498]:   </cpu>
Apr 14 01:41:55 user nova-compute[71498]:   <devices>
Apr 14 01:41:55 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:41:55 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:41:55 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/9397a9e2-b5e9-47e7-b25e-5c40379a60eb/disk"/>
Apr 14 01:41:55 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:41:55 user nova-compute[71498]:     </disk>
Apr 14 01:41:55 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:41:55 user nova-compute[71498]:       <mac address="fa:16:3e:31:eb:07"/>
Apr 14 01:41:55 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:41:55 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:41:55 user nova-compute[71498]:       <target dev="tap084feebd-4d"/>
Apr 14 01:41:55 user nova-compute[71498]:     </interface>
Apr 14 01:41:55 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:41:55 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/9397a9e2-b5e9-47e7-b25e-5c40379a60eb/console.log" append="off"/>
Apr 14 01:41:55 user nova-compute[71498]:     </serial>
Apr 14 01:41:55 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:41:55 user nova-compute[71498]:     <video>
Apr 14 01:41:55 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:41:55 user nova-compute[71498]:     </video>
Apr 14 01:41:55 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:41:55 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:41:55 user nova-compute[71498]:     </rng>
Apr 14 01:41:55 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:41:55 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:41:55 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:41:55 user nova-compute[71498]:     </memballoon>
Apr 14 01:41:55 user nova-compute[71498]:   </devices>
Apr 14 01:41:55 user nova-compute[71498]: </domain>
Apr 14 01:41:55 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:41:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-888539893',display_name='tempest-VolumesActionsTest-instance-888539893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-888539893',id=10,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cdb176ac656c47b38e736fc629fc46e0',ramdisk_id='',reservation_id='r-lc3velri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-193871514',owner_user_name='tempest-VolumesActionsTest-193871514-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:41:53Z,user_data=None,user_id='8b18b911fcf847efbf4f814f3b687279',uuid=9397a9e2-b5e9-47e7-b25e-5c40379a60eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "084feebd-4d90-4eab-b8ec-346c32858b42", "address": "fa:16:3e:31:eb:07", "network": {"id": "d2f0bf5d-7422-436e-82b2-95cfe8eb77bd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1126078103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cdb176ac656c47b38e736fc629fc46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084feebd-4d", "ovs_interfaceid": "084feebd-4d90-4eab-b8ec-346c32858b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Converting VIF {"id": "084feebd-4d90-4eab-b8ec-346c32858b42", "address": "fa:16:3e:31:eb:07", "network": {"id": "d2f0bf5d-7422-436e-82b2-95cfe8eb77bd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1126078103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cdb176ac656c47b38e736fc629fc46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084feebd-4d", "ovs_interfaceid": "084feebd-4d90-4eab-b8ec-346c32858b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:eb:07,bridge_name='br-int',has_traffic_filtering=True,id=084feebd-4d90-4eab-b8ec-346c32858b42,network=Network(d2f0bf5d-7422-436e-82b2-95cfe8eb77bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084feebd-4d') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG os_vif [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:eb:07,bridge_name='br-int',has_traffic_filtering=True,id=084feebd-4d90-4eab-b8ec-346c32858b42,network=Network(d2f0bf5d-7422-436e-82b2-95cfe8eb77bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084feebd-4d') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap084feebd-4d, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap084feebd-4d, col_values=(('external_ids', {'iface-id': '084feebd-4d90-4eab-b8ec-346c32858b42', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:eb:07', 'vm-uuid': '9397a9e2-b5e9-47e7-b25e-5c40379a60eb'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:55 user nova-compute[71498]: INFO os_vif [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:eb:07,bridge_name='br-int',has_traffic_filtering=True,id=084feebd-4d90-4eab-b8ec-346c32858b42,network=Network(d2f0bf5d-7422-436e-82b2-95cfe8eb77bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084feebd-4d')
Apr 14 01:41:55 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] No VIF found with MAC fa:16:3e:31:eb:07, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG nova.compute.manager [req-960f27b5-b34b-49a7-87c7-e085859d3422 req-345d00bd-d54f-4b10-b2f1-bfd2db25cf9e service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-changed-eee87019-7923-4e16-8e15-f2a1010616e3 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG nova.compute.manager [req-960f27b5-b34b-49a7-87c7-e085859d3422 req-345d00bd-d54f-4b10-b2f1-bfd2db25cf9e service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Refreshing instance network info cache due to event network-changed-eee87019-7923-4e16-8e15-f2a1010616e3. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-960f27b5-b34b-49a7-87c7-e085859d3422 req-345d00bd-d54f-4b10-b2f1-bfd2db25cf9e service nova] Acquiring lock "refresh_cache-bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:41:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-960f27b5-b34b-49a7-87c7-e085859d3422 req-345d00bd-d54f-4b10-b2f1-bfd2db25cf9e service nova] Acquired lock "refresh_cache-bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:41:56 user nova-compute[71498]: DEBUG nova.network.neutron [req-960f27b5-b34b-49a7-87c7-e085859d3422 req-345d00bd-d54f-4b10-b2f1-bfd2db25cf9e service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Refreshing network info cache for port eee87019-7923-4e16-8e15-f2a1010616e3 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:41:56 user nova-compute[71498]: DEBUG nova.network.neutron [req-960f27b5-b34b-49a7-87c7-e085859d3422 req-345d00bd-d54f-4b10-b2f1-bfd2db25cf9e service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:41:56 user nova-compute[71498]: DEBUG nova.network.neutron [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Successfully updated port: fd852601-98a3-4811-8bf5-120906e84646 {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:41:56 user nova-compute[71498]: DEBUG nova.network.neutron [req-960f27b5-b34b-49a7-87c7-e085859d3422 req-345d00bd-d54f-4b10-b2f1-bfd2db25cf9e service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:41:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-960f27b5-b34b-49a7-87c7-e085859d3422 req-345d00bd-d54f-4b10-b2f1-bfd2db25cf9e service nova] Releasing lock "refresh_cache-bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:41:56 user nova-compute[71498]: INFO nova.virt.block_device [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Booting with volume 953520b1-6ecb-41ad-8793-851901048f6d at /dev/vdb
Apr 14 01:41:56 user nova-compute[71498]: DEBUG nova.network.neutron [req-e8cace16-d154-459b-92af-8f4af25c9546 req-629be5fe-718c-4a0a-a6a7-1e2c77b9a8b6 service nova] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Updated VIF entry in instance network info cache for port 084feebd-4d90-4eab-b8ec-346c32858b42. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:41:56 user nova-compute[71498]: DEBUG nova.network.neutron [req-e8cace16-d154-459b-92af-8f4af25c9546 req-629be5fe-718c-4a0a-a6a7-1e2c77b9a8b6 service nova] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Updating instance_info_cache with network_info: [{"id": "084feebd-4d90-4eab-b8ec-346c32858b42", "address": "fa:16:3e:31:eb:07", "network": {"id": "d2f0bf5d-7422-436e-82b2-95cfe8eb77bd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1126078103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cdb176ac656c47b38e736fc629fc46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084feebd-4d", "ovs_interfaceid": "084feebd-4d90-4eab-b8ec-346c32858b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:41:56 user nova-compute[71498]: DEBUG os_brick.utils [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:41:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e8cace16-d154-459b-92af-8f4af25c9546 req-629be5fe-718c-4a0a-a6a7-1e2c77b9a8b6 service nova] Releasing lock "refresh_cache-9397a9e2-b5e9-47e7-b25e-5c40379a60eb" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:41:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:56 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3be127-8a9d-4692-8f38-5329eab2b6a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:41:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:56 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d82a8fa-0017-4087-9964-fd87b31bc6cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:41:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:41:56 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad78be76-ec0b-45cd-b838-85fd8f14597a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:41:56 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2964ea-5e86-4b82-be2b-94ca721e45c2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:41:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:41:56 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:41:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:41:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:41:56 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:41:56 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ac7873-1667-435a-a277-4d6c71e83283]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:41:56 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:41:56 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:41:56 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:41:56 user nova-compute[71498]: DEBUG os_brick.utils [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:41:56 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Updating existing volume attachment record: 382fb1d8-0966-4964-95a3-acafbfaf1d06 {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:41:56 user nova-compute[71498]: DEBUG nova.network.neutron [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Successfully updated port: d44e7f03-f338-4efa-b6b4-fb90d22aa37c {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:41:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:41:57 user nova-compute[71498]: DEBUG nova.compute.manager [req-eff07492-b718-4b81-b891-974e28ef39c4 req-85c2caef-b1c9-4d66-9b42-62e31a4896be service nova] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Received event network-vif-plugged-084feebd-4d90-4eab-b8ec-346c32858b42 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:41:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-eff07492-b718-4b81-b891-974e28ef39c4 req-85c2caef-b1c9-4d66-9b42-62e31a4896be service nova] Acquiring lock "9397a9e2-b5e9-47e7-b25e-5c40379a60eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-eff07492-b718-4b81-b891-974e28ef39c4 req-85c2caef-b1c9-4d66-9b42-62e31a4896be service nova] Lock "9397a9e2-b5e9-47e7-b25e-5c40379a60eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-eff07492-b718-4b81-b891-974e28ef39c4 req-85c2caef-b1c9-4d66-9b42-62e31a4896be service nova] Lock "9397a9e2-b5e9-47e7-b25e-5c40379a60eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:57 user nova-compute[71498]: DEBUG nova.compute.manager [req-eff07492-b718-4b81-b891-974e28ef39c4 req-85c2caef-b1c9-4d66-9b42-62e31a4896be service nova] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] No waiting events found dispatching network-vif-plugged-084feebd-4d90-4eab-b8ec-346c32858b42 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:41:57 user nova-compute[71498]: WARNING nova.compute.manager [req-eff07492-b718-4b81-b891-974e28ef39c4 req-85c2caef-b1c9-4d66-9b42-62e31a4896be service nova] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Received unexpected event network-vif-plugged-084feebd-4d90-4eab-b8ec-346c32858b42 for instance with vm_state building and task_state spawning.
Apr 14 01:41:57 user nova-compute[71498]: DEBUG nova.network.neutron [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Successfully updated port: 2b26233c-8774-42ae-9f2f-8794c8e364a1 {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:41:58 user nova-compute[71498]: DEBUG nova.compute.manager [req-c484d97a-0a09-499c-9f60-0910bbfb3579 req-a387ae5a-e954-4f8d-92df-591433b0bfe9 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-changed-fd852601-98a3-4811-8bf5-120906e84646 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:41:58 user nova-compute[71498]: DEBUG nova.compute.manager [req-c484d97a-0a09-499c-9f60-0910bbfb3579 req-a387ae5a-e954-4f8d-92df-591433b0bfe9 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Refreshing instance network info cache due to event network-changed-fd852601-98a3-4811-8bf5-120906e84646. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:41:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c484d97a-0a09-499c-9f60-0910bbfb3579 req-a387ae5a-e954-4f8d-92df-591433b0bfe9 service nova] Acquiring lock "refresh_cache-bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:41:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c484d97a-0a09-499c-9f60-0910bbfb3579 req-a387ae5a-e954-4f8d-92df-591433b0bfe9 service nova] Acquired lock "refresh_cache-bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:41:58 user nova-compute[71498]: DEBUG nova.network.neutron [req-c484d97a-0a09-499c-9f60-0910bbfb3579 req-a387ae5a-e954-4f8d-92df-591433b0bfe9 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Refreshing network info cache for port fd852601-98a3-4811-8bf5-120906e84646 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:41:58 user nova-compute[71498]: DEBUG nova.network.neutron [req-c484d97a-0a09-499c-9f60-0910bbfb3579 req-a387ae5a-e954-4f8d-92df-591433b0bfe9 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:41:58 user nova-compute[71498]: DEBUG nova.network.neutron [req-c484d97a-0a09-499c-9f60-0910bbfb3579 req-a387ae5a-e954-4f8d-92df-591433b0bfe9 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:41:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c484d97a-0a09-499c-9f60-0910bbfb3579 req-a387ae5a-e954-4f8d-92df-591433b0bfe9 service nova] Releasing lock "refresh_cache-bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:41:58 user nova-compute[71498]: DEBUG nova.compute.manager [req-c484d97a-0a09-499c-9f60-0910bbfb3579 req-a387ae5a-e954-4f8d-92df-591433b0bfe9 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-changed-d44e7f03-f338-4efa-b6b4-fb90d22aa37c {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:41:58 user nova-compute[71498]: DEBUG nova.compute.manager [req-c484d97a-0a09-499c-9f60-0910bbfb3579 req-a387ae5a-e954-4f8d-92df-591433b0bfe9 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Refreshing instance network info cache due to event network-changed-d44e7f03-f338-4efa-b6b4-fb90d22aa37c. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:41:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c484d97a-0a09-499c-9f60-0910bbfb3579 req-a387ae5a-e954-4f8d-92df-591433b0bfe9 service nova] Acquiring lock "refresh_cache-bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:41:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c484d97a-0a09-499c-9f60-0910bbfb3579 req-a387ae5a-e954-4f8d-92df-591433b0bfe9 service nova] Acquired lock "refresh_cache-bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:41:58 user nova-compute[71498]: DEBUG nova.network.neutron [req-c484d97a-0a09-499c-9f60-0910bbfb3579 req-a387ae5a-e954-4f8d-92df-591433b0bfe9 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Refreshing network info cache for port d44e7f03-f338-4efa-b6b4-fb90d22aa37c {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:41:58 user nova-compute[71498]: DEBUG nova.network.neutron [req-c484d97a-0a09-499c-9f60-0910bbfb3579 req-a387ae5a-e954-4f8d-92df-591433b0bfe9 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:41:58 user nova-compute[71498]: DEBUG nova.network.neutron [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Successfully updated port: 592ca281-1142-433c-996f-54b6bdce948b {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:41:58 user nova-compute[71498]: DEBUG nova.network.neutron [req-c484d97a-0a09-499c-9f60-0910bbfb3579 req-a387ae5a-e954-4f8d-92df-591433b0bfe9 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:41:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c484d97a-0a09-499c-9f60-0910bbfb3579 req-a387ae5a-e954-4f8d-92df-591433b0bfe9 service nova] Releasing lock "refresh_cache-bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:41:59 user nova-compute[71498]: DEBUG nova.compute.manager [req-c484d97a-0a09-499c-9f60-0910bbfb3579 req-a387ae5a-e954-4f8d-92df-591433b0bfe9 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-changed-2b26233c-8774-42ae-9f2f-8794c8e364a1 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:41:59 user nova-compute[71498]: DEBUG nova.compute.manager [req-c484d97a-0a09-499c-9f60-0910bbfb3579 req-a387ae5a-e954-4f8d-92df-591433b0bfe9 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Refreshing instance network info cache due to event network-changed-2b26233c-8774-42ae-9f2f-8794c8e364a1. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:41:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c484d97a-0a09-499c-9f60-0910bbfb3579 req-a387ae5a-e954-4f8d-92df-591433b0bfe9 service nova] Acquiring lock "refresh_cache-bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:41:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c484d97a-0a09-499c-9f60-0910bbfb3579 req-a387ae5a-e954-4f8d-92df-591433b0bfe9 service nova] Acquired lock "refresh_cache-bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:41:59 user nova-compute[71498]: DEBUG nova.network.neutron [req-c484d97a-0a09-499c-9f60-0910bbfb3579 req-a387ae5a-e954-4f8d-92df-591433b0bfe9 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Refreshing network info cache for port 2b26233c-8774-42ae-9f2f-8794c8e364a1 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:41:59 user nova-compute[71498]: DEBUG nova.network.neutron [req-c484d97a-0a09-499c-9f60-0910bbfb3579 req-a387ae5a-e954-4f8d-92df-591433b0bfe9 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:41:59 user nova-compute[71498]: DEBUG nova.network.neutron [req-c484d97a-0a09-499c-9f60-0910bbfb3579 req-a387ae5a-e954-4f8d-92df-591433b0bfe9 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:41:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c484d97a-0a09-499c-9f60-0910bbfb3579 req-a387ae5a-e954-4f8d-92df-591433b0bfe9 service nova] Releasing lock "refresh_cache-bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:41:59 user nova-compute[71498]: DEBUG nova.network.neutron [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Successfully updated port: 933d0949-bd1a-4905-ae6a-e15e6b6e72dd {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:41:59 user nova-compute[71498]: DEBUG nova.compute.manager [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:41:59 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:41:59 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436519.4710224, 9397a9e2-b5e9-47e7-b25e-5c40379a60eb => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:41:59 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] VM Resumed (Lifecycle Event)
Apr 14 01:41:59 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Instance spawned successfully.
Apr 14 01:41:59 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:41:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "refresh_cache-bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:41:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquired lock "refresh_cache-bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:41:59 user nova-compute[71498]: DEBUG nova.network.neutron [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:41:59 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:41:59 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:41:59 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:59 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:59 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:59 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:59 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:59 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:41:59 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:41:59 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436519.4711874, 9397a9e2-b5e9-47e7-b25e-5c40379a60eb => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:41:59 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] VM Started (Lifecycle Event)
Apr 14 01:41:59 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:41:59 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:41:59 user nova-compute[71498]: DEBUG nova.network.neutron [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:41:59 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:41:59 user nova-compute[71498]: DEBUG nova.compute.manager [req-5114175b-08b3-4ef1-9157-b1f9a88055c0 req-e1c8edb6-79b1-4397-a24f-8d67c4d3b9a8 service nova] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Received event network-vif-plugged-084feebd-4d90-4eab-b8ec-346c32858b42 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:41:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5114175b-08b3-4ef1-9157-b1f9a88055c0 req-e1c8edb6-79b1-4397-a24f-8d67c4d3b9a8 service nova] Acquiring lock "9397a9e2-b5e9-47e7-b25e-5c40379a60eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:41:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5114175b-08b3-4ef1-9157-b1f9a88055c0 req-e1c8edb6-79b1-4397-a24f-8d67c4d3b9a8 service nova] Lock "9397a9e2-b5e9-47e7-b25e-5c40379a60eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:41:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5114175b-08b3-4ef1-9157-b1f9a88055c0 req-e1c8edb6-79b1-4397-a24f-8d67c4d3b9a8 service nova] Lock "9397a9e2-b5e9-47e7-b25e-5c40379a60eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:41:59 user nova-compute[71498]: DEBUG nova.compute.manager [req-5114175b-08b3-4ef1-9157-b1f9a88055c0 req-e1c8edb6-79b1-4397-a24f-8d67c4d3b9a8 service nova] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] No waiting events found dispatching network-vif-plugged-084feebd-4d90-4eab-b8ec-346c32858b42 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:41:59 user nova-compute[71498]: WARNING nova.compute.manager [req-5114175b-08b3-4ef1-9157-b1f9a88055c0 req-e1c8edb6-79b1-4397-a24f-8d67c4d3b9a8 service nova] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Received unexpected event network-vif-plugged-084feebd-4d90-4eab-b8ec-346c32858b42 for instance with vm_state building and task_state spawning.
Apr 14 01:41:59 user nova-compute[71498]: INFO nova.compute.manager [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Took 6.59 seconds to spawn the instance on the hypervisor.
Apr 14 01:41:59 user nova-compute[71498]: DEBUG nova.compute.manager [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:41:59 user nova-compute[71498]: INFO nova.compute.manager [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Took 7.57 seconds to build instance.
Apr 14 01:41:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-26e3b507-bebf-4d41-abca-80cf0ee87c7c tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "9397a9e2-b5e9-47e7-b25e-5c40379a60eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.685s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:00 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:00 user nova-compute[71498]: DEBUG nova.compute.manager [req-f382a38f-2e34-4e0c-b39f-0ad289aea6f6 req-a3b2cdd6-8a5f-488e-9b94-4d5227d95c6f service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-changed-592ca281-1142-433c-996f-54b6bdce948b {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:42:00 user nova-compute[71498]: DEBUG nova.compute.manager [req-f382a38f-2e34-4e0c-b39f-0ad289aea6f6 req-a3b2cdd6-8a5f-488e-9b94-4d5227d95c6f service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Refreshing instance network info cache due to event network-changed-592ca281-1142-433c-996f-54b6bdce948b. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:42:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f382a38f-2e34-4e0c-b39f-0ad289aea6f6 req-a3b2cdd6-8a5f-488e-9b94-4d5227d95c6f service nova] Acquiring lock "refresh_cache-bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:42:00 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:01 user nova-compute[71498]: INFO nova.virt.block_device [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Booting with volume da07fe19-d0bc-4451-a0c5-29df607f9b02 at /dev/vdc
Apr 14 01:42:01 user nova-compute[71498]: DEBUG os_brick.utils [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:42:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:01 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c528d3cd-aaea-48c4-b061-0b20b759ba47]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:01 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[674ebc37-8428-4512-a5e8-8d0fcdd7a9ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:01 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5de5f78-efb1-476c-8b3f-5f06140dd9d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:01 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44620cb-5276-4579-8b4f-ca63d629f8fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:42:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:42:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:42:01 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:42:01 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ee802a-f675-4c47-b796-6a01e75de5d4]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:42:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:42:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:42:01 user nova-compute[71498]: DEBUG os_brick.utils [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:42:01 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Updating existing volume attachment record: 4e65d368-f07f-475c-b7c2-078aa89ad09a {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:42:02 user nova-compute[71498]: DEBUG nova.network.neutron [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Updating instance_info_cache with network_info: [{"id": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e", "address": "fa:16:3e:f9:e2:65", "network": {"id": "92b9d247-3013-4a97-9ca0-41643807ce1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-923461645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3522bbcc-41", "ovs_interfaceid": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eee87019-7923-4e16-8e15-f2a1010616e3", "address": "fa:16:3e:6c:ff:19", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeee87019-79", "ovs_interfaceid": "eee87019-7923-4e16-8e15-f2a1010616e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fd852601-98a3-4811-8bf5-120906e84646", "address": "fa:16:3e:cd:ab:83", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd852601-98", "ovs_interfaceid": "fd852601-98a3-4811-8bf5-120906e84646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d44e7f03-f338-4efa-b6b4-fb90d22aa37c", "address": "fa:16:3e:8d:5d:e1", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd44e7f03-f3", "ovs_interfaceid": "d44e7f03-f338-4efa-b6b4-fb90d22aa37c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b26233c-8774-42ae-9f2f-8794c8e364a1", "address": "fa:16:3e:ae:ed:db", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b26233c-87", "ovs_interfaceid": "2b26233c-8774-42ae-9f2f-8794c8e364a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "592ca281-1142-433c-996f-54b6bdce948b", "address": "fa:16:3e:ee:9d:4c", "network": {"id": "9169c3c6-6243-44ce-8070-5991e81046ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1541501115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592ca281-11", "ovs_interfaceid": "592ca281-1142-433c-996f-54b6bdce948b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd", "address": "fa:16:3e:0f:ad:4f", "network": {"id": "9169c3c6-6243-44ce-8070-5991e81046ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1541501115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933d0949-bd", "ovs_interfaceid": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:42:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Releasing lock "refresh_cache-bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:42:02 user nova-compute[71498]: DEBUG nova.compute.manager [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Instance network_info: |[{"id": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e", "address": "fa:16:3e:f9:e2:65", "network": {"id": "92b9d247-3013-4a97-9ca0-41643807ce1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-923461645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3522bbcc-41", "ovs_interfaceid": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eee87019-7923-4e16-8e15-f2a1010616e3", "address": "fa:16:3e:6c:ff:19", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeee87019-79", "ovs_interfaceid": "eee87019-7923-4e16-8e15-f2a1010616e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fd852601-98a3-4811-8bf5-120906e84646", "address": "fa:16:3e:cd:ab:83", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd852601-98", "ovs_interfaceid": "fd852601-98a3-4811-8bf5-120906e84646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d44e7f03-f338-4efa-b6b4-fb90d22aa37c", "address": "fa:16:3e:8d:5d:e1", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd44e7f03-f3", "ovs_interfaceid": "d44e7f03-f338-4efa-b6b4-fb90d22aa37c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b26233c-8774-42ae-9f2f-8794c8e364a1", "address": "fa:16:3e:ae:ed:db", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b26233c-87", "ovs_interfaceid": "2b26233c-8774-42ae-9f2f-8794c8e364a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "592ca281-1142-433c-996f-54b6bdce948b", "address": "fa:16:3e:ee:9d:4c", "network": {"id": "9169c3c6-6243-44ce-8070-5991e81046ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1541501115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592ca281-11", "ovs_interfaceid": "592ca281-1142-433c-996f-54b6bdce948b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd", "address": "fa:16:3e:0f:ad:4f", "network": {"id": "9169c3c6-6243-44ce-8070-5991e81046ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1541501115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933d0949-bd", "ovs_interfaceid": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 01:42:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f382a38f-2e34-4e0c-b39f-0ad289aea6f6 req-a3b2cdd6-8a5f-488e-9b94-4d5227d95c6f service nova] Acquired lock "refresh_cache-bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:42:02 user nova-compute[71498]: DEBUG nova.network.neutron [req-f382a38f-2e34-4e0c-b39f-0ad289aea6f6 req-a3b2cdd6-8a5f-488e-9b94-4d5227d95c6f service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Refreshing network info cache for port 592ca281-1142-433c-996f-54b6bdce948b {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:42:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:03 user nova-compute[71498]: DEBUG nova.network.neutron [req-f382a38f-2e34-4e0c-b39f-0ad289aea6f6 req-a3b2cdd6-8a5f-488e-9b94-4d5227d95c6f service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Updated VIF entry in instance network info cache for port 592ca281-1142-433c-996f-54b6bdce948b. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:42:03 user nova-compute[71498]: DEBUG nova.network.neutron [req-f382a38f-2e34-4e0c-b39f-0ad289aea6f6 req-a3b2cdd6-8a5f-488e-9b94-4d5227d95c6f service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Updating instance_info_cache with network_info: [{"id": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e", "address": "fa:16:3e:f9:e2:65", "network": {"id": "92b9d247-3013-4a97-9ca0-41643807ce1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-923461645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3522bbcc-41", "ovs_interfaceid": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eee87019-7923-4e16-8e15-f2a1010616e3", "address": "fa:16:3e:6c:ff:19", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeee87019-79", "ovs_interfaceid": "eee87019-7923-4e16-8e15-f2a1010616e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fd852601-98a3-4811-8bf5-120906e84646", "address": "fa:16:3e:cd:ab:83", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd852601-98", "ovs_interfaceid": "fd852601-98a3-4811-8bf5-120906e84646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d44e7f03-f338-4efa-b6b4-fb90d22aa37c", "address": "fa:16:3e:8d:5d:e1", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd44e7f03-f3", "ovs_interfaceid": "d44e7f03-f338-4efa-b6b4-fb90d22aa37c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b26233c-8774-42ae-9f2f-8794c8e364a1", "address": "fa:16:3e:ae:ed:db", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b26233c-87", "ovs_interfaceid": "2b26233c-8774-42ae-9f2f-8794c8e364a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "592ca281-1142-433c-996f-54b6bdce948b", "address": "fa:16:3e:ee:9d:4c", "network": {"id": "9169c3c6-6243-44ce-8070-5991e81046ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1541501115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592ca281-11", "ovs_interfaceid": "592ca281-1142-433c-996f-54b6bdce948b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd", "address": "fa:16:3e:0f:ad:4f", "network": {"id": "9169c3c6-6243-44ce-8070-5991e81046ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1541501115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933d0949-bd", "ovs_interfaceid": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:42:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f382a38f-2e34-4e0c-b39f-0ad289aea6f6 req-a3b2cdd6-8a5f-488e-9b94-4d5227d95c6f service nova] Releasing lock "refresh_cache-bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:42:03 user nova-compute[71498]: DEBUG nova.compute.manager [req-f382a38f-2e34-4e0c-b39f-0ad289aea6f6 req-a3b2cdd6-8a5f-488e-9b94-4d5227d95c6f service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-changed-933d0949-bd1a-4905-ae6a-e15e6b6e72dd {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:42:03 user nova-compute[71498]: DEBUG nova.compute.manager [req-f382a38f-2e34-4e0c-b39f-0ad289aea6f6 req-a3b2cdd6-8a5f-488e-9b94-4d5227d95c6f service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Refreshing instance network info cache due to event network-changed-933d0949-bd1a-4905-ae6a-e15e6b6e72dd. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:42:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f382a38f-2e34-4e0c-b39f-0ad289aea6f6 req-a3b2cdd6-8a5f-488e-9b94-4d5227d95c6f service nova] Acquiring lock "refresh_cache-bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:42:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f382a38f-2e34-4e0c-b39f-0ad289aea6f6 req-a3b2cdd6-8a5f-488e-9b94-4d5227d95c6f service nova] Acquired lock "refresh_cache-bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:42:03 user nova-compute[71498]: DEBUG nova.network.neutron [req-f382a38f-2e34-4e0c-b39f-0ad289aea6f6 req-a3b2cdd6-8a5f-488e-9b94-4d5227d95c6f service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Refreshing network info cache for port 933d0949-bd1a-4905-ae6a-e15e6b6e72dd {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:42:03 user nova-compute[71498]: DEBUG nova.network.neutron [req-f382a38f-2e34-4e0c-b39f-0ad289aea6f6 req-a3b2cdd6-8a5f-488e-9b94-4d5227d95c6f service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Updated VIF entry in instance network info cache for port 933d0949-bd1a-4905-ae6a-e15e6b6e72dd. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:42:03 user nova-compute[71498]: DEBUG nova.network.neutron [req-f382a38f-2e34-4e0c-b39f-0ad289aea6f6 req-a3b2cdd6-8a5f-488e-9b94-4d5227d95c6f service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Updating instance_info_cache with network_info: [{"id": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e", "address": "fa:16:3e:f9:e2:65", "network": {"id": "92b9d247-3013-4a97-9ca0-41643807ce1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-923461645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3522bbcc-41", "ovs_interfaceid": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eee87019-7923-4e16-8e15-f2a1010616e3", "address": "fa:16:3e:6c:ff:19", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeee87019-79", "ovs_interfaceid": "eee87019-7923-4e16-8e15-f2a1010616e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fd852601-98a3-4811-8bf5-120906e84646", "address": "fa:16:3e:cd:ab:83", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd852601-98", "ovs_interfaceid": "fd852601-98a3-4811-8bf5-120906e84646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d44e7f03-f338-4efa-b6b4-fb90d22aa37c", "address": "fa:16:3e:8d:5d:e1", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd44e7f03-f3", "ovs_interfaceid": "d44e7f03-f338-4efa-b6b4-fb90d22aa37c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b26233c-8774-42ae-9f2f-8794c8e364a1", "address": "fa:16:3e:ae:ed:db", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b26233c-87", "ovs_interfaceid": "2b26233c-8774-42ae-9f2f-8794c8e364a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "592ca281-1142-433c-996f-54b6bdce948b", "address": "fa:16:3e:ee:9d:4c", "network": {"id": "9169c3c6-6243-44ce-8070-5991e81046ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1541501115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592ca281-11", "ovs_interfaceid": "592ca281-1142-433c-996f-54b6bdce948b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd", "address": "fa:16:3e:0f:ad:4f", "network": {"id": "9169c3c6-6243-44ce-8070-5991e81046ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1541501115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933d0949-bd", "ovs_interfaceid": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:42:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f382a38f-2e34-4e0c-b39f-0ad289aea6f6 req-a3b2cdd6-8a5f-488e-9b94-4d5227d95c6f service nova] Releasing lock "refresh_cache-bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:42:05 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:06 user nova-compute[71498]: DEBUG nova.compute.manager [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 01:42:06 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:42:06 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Creating image(s)
Apr 14 01:42:06 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Did not create local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 01:42:06 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Ensure instance console log exists: /opt/stack/data/nova/instances/bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:42:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:06 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Start _get_guest_xml network_info=[{"id": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e", "address": "fa:16:3e:f9:e2:65", "network": {"id": "92b9d247-3013-4a97-9ca0-41643807ce1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-923461645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3522bbcc-41", "ovs_interfaceid": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eee87019-7923-4e16-8e15-f2a1010616e3", "address": "fa:16:3e:6c:ff:19", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeee87019-79", "ovs_interfaceid": "eee87019-7923-4e16-8e15-f2a1010616e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fd852601-98a3-4811-8bf5-120906e84646", "address": "fa:16:3e:cd:ab:83", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd852601-98", "ovs_interfaceid": "fd852601-98a3-4811-8bf5-120906e84646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d44e7f03-f338-4efa-b6b4-fb90d22aa37c", "address": "fa:16:3e:8d:5d:e1", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd44e7f03-f3", "ovs_interfaceid": "d44e7f03-f338-4efa-b6b4-fb90d22aa37c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b26233c-8774-42ae-9f2f-8794c8e364a1", "address": "fa:16:3e:ae:ed:db", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b26233c-87", "ovs_interfaceid": "2b26233c-8774-42ae-9f2f-8794c8e364a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "592ca281-1142-433c-996f-54b6bdce948b", "address": "fa:16:3e:ee:9d:4c", "network": {"id": "9169c3c6-6243-44ce-8070-5991e81046ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1541501115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592ca281-11", "ovs_interfaceid": "592ca281-1142-433c-996f-54b6bdce948b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd", "address": "fa:16:3e:0f:ad:4f", "network": {"id": "9169c3c6-6243-44ce-8070-5991e81046ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1541501115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933d0949-bd", "ovs_interfaceid": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a2d4b20a-282f-4cf8-b9cb-1bb84bcb8db0', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oLYPhWbV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5', 'attached_at': '', 'detached_at': '', 'volume_id': '5e9b1e2c-15a4-481a-a713-fa24dca0918e', 'serial': '5e9b1e2c-15a4-481a-a713-fa24dca0918e'}, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None}, {'attachment_id': '382fb1d8-0966-4964-95a3-acafbfaf1d06', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TXlNnZyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5', 'attached_at': '', 'detached_at': '', 'volume_id': '953520b1-6ecb-41ad-8793-851901048f6d', 'serial': '953520b1-6ecb-41ad-8793-851901048f6d'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': 1, 'device_type': 'disk', 'volume_type': None}, {'attachment_id': '4e65d368-f07f-475c-b7c2-078aa89ad09a', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AymIXcgr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5', 'attached_at': '', 'detached_at': '', 'volume_id': 'da07fe19-d0bc-4451-a0c5-29df607f9b02', 'serial': 'da07fe19-d0bc-4451-a0c5-29df607f9b02'}, 'mount_device': '/dev/vdc', 'guest_format': None, 'boot_index': 2, 'device_type': 'disk', 'volume_type': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:42:06 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:42:06 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:42:06 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:42:06 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:42:06 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:42:06 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:42:06 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:42:06 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:42:06 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:42:06 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:42:06 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:42:06 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:42:06 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:42:06 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:42:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:06 user nova-compute[71498]: DEBUG os_brick.initiator.connector [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Factory for ISCSI on None {{(pid=71498) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 14 01:42:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:06 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:42:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oLYPhWbV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:42:06 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:42:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:42:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:42:06 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:42:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:42:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:42:06 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:42:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[121bd1ff-04d9-4944-9ea5-b4f67352d9b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:42:07 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b767c00-bc7d-49ae-a20f-ee92a8ddeeff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e] added
Apr 14 01:42:07 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[111d4b5f-a18e-4af5-ba40-bfafa0b0e545]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8ff019-cbe9-4b60-890c-16fa71bca533]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oLYPhWbV {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oLYPhWbV" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3d6bd7-7d0f-45b6-b10c-927e7a0c87f9]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oLYPhWbV'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4644a2-a07d-4f8a-aa0d-98e9ab9e339a]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e390b1-8e9d-4a08-947d-6437539d1b8c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 01:42:07 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 01:42:07 user nova-compute[71498]:  {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:42:07 user nova-compute[71498]: WARNING os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 01:42:07 user nova-compute[71498]: 
Apr 14 01:42:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c2195a-16c8-4a50-a196-25af6c32e4ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e, portal: 172.16.0.220,3260]
Apr 14 01:42:07 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e, portal: 172.16.0.220,3260] successful.
Apr 14 01:42:07 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0a75b5-7f6c-4b37-bec8-9cb0eb73166c]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f5950b-6cdc-4333-b9d3-095e02f819b5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:42:07 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:42:07 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f011025-ff1a-481b-a439-5254522e0903]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:42:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oLYPhWbV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23866396237333166', 'path': '/dev/sdb'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866396237333166', 'path': '/dev/sdb'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TXlNnZyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:42:08 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:42:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:42:08 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:42:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:42:08 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:42:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d31915-3ea4-41c4-ac57-d15e9fc91a18]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:42:08 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9442adbc-8603-4510-b4cd-fa9527edd9f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d] added
Apr 14 01:42:08 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[898a3dd6-9116-4dee-9e24-266115c7ae38]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7808bd00-c0f2-4abf-827c-635f7b5ef14e]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TXlNnZyv {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TXlNnZyv" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3c99fc-436d-4e57-98f6-a078e7e16e45]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TXlNnZyv'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf45797-15c0-4a60-9452-a44a1dab3938]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[911a7836-4459-4080-8c53-3e1cb44a77cd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:42:08 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:42:08 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca29b8de-6546-48b3-bc72-88da6ecbee18]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d, portal: 172.16.0.220,3260]
Apr 14 01:42:08 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d, portal: 172.16.0.220,3260] successful.
Apr 14 01:42:08 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[495736ff-c2e6-4235-bc6f-d6f6d537427e]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fcf546-9afb-4389-943c-773b72b769a9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:42:08 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:42:08 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:42:08 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:42:08 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cb37bf-58dc-4913-bba5-c1122827f254]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:08 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG nova.compute.manager [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:42:09 user nova-compute[71498]: INFO nova.compute.claims [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Claim successful on node user
Apr 14 01:42:09 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TXlNnZyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26136613633313435', 'path': '/dev/sdc'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136613633313435', 'path': '/dev/sdc'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AymIXcgr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:42:09 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:42:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:42:09 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:42:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:42:09 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[003a51ba-3c12-4b3d-93ab-39aeccfaba17]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:42:09 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e26a8cb-7d4a-4990-bb13-5727580b76e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02] added
Apr 14 01:42:09 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG nova.compute.manager [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9c437d-6bda-4170-9466-6abb947d41d3]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[12333f5d-aa67-48d7-b44d-205e31dcf740]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AymIXcgr {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AymIXcgr" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb94840-a5e5-4689-979f-1b2225fca4ef]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AymIXcgr'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7965fd-6e13-4d6d-b0cf-93c560d7f28f]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG nova.compute.manager [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG nova.network.neutron [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:09 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a9233d-10ad-45a2-b287-35b90bcb238e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:42:09 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:42:09 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:42:09 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:42:09 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG nova.compute.manager [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c4d19b-159a-4811-a437-e0d3a36d1501]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02, portal: 172.16.0.220,3260]
Apr 14 01:42:09 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02, portal: 172.16.0.220,3260] successful.
Apr 14 01:42:09 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:09 user nova-compute[71498]: INFO nova.virt.block_device [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Booting with volume f78596d7-c339-491a-a0d2-470a1c158a53 at /dev/vda
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb3402d-3461-40e9-beac-7b0708116aee]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG nova.policy [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '447da297b18f4e7f86fa94cd4d5d7918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef081a56d11d4b4d82ba5fe6572f3b95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa8dc1c-3847-4b02-9339-c08f6898128a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:42:09 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:42:09 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:42:09 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:42:09 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:42:09 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:42:09 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[291b225b-543d-4d88-94a4-a439c427ecfb]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:42:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AymIXcgr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:42:10 user nova-compute[71498]: DEBUG os_brick.utils [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:42:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:10 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[76169331-8fa7-48cb-acf7-c322df166801]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:10 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cec7dd9-b6be-463a-b57c-c695be97873a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:10 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db648cb-e67f-4e42-84d2-96c7dc7823bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:10 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea45694-30ef-417d-8417-213f5743144f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:42:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:42:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:42:10 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:42:10 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29b261b-b0f2-410c-941b-6f660034a026]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:42:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:42:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:42:10 user nova-compute[71498]: DEBUG os_brick.utils [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:42:10 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Updating existing volume attachment record: b8cabddc-b3b7-413f-a15c-6c0f5a91f190 {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:42:10 user nova-compute[71498]: DEBUG nova.network.neutron [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Successfully created port: 9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:42:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:42:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26339623132356237', 'path': '/dev/sdd'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:42:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339623132356237', 'path': '/dev/sdd'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1230095561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1230095561',id=9,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPq5zgM+RzDby5P6sRhmB9kf8xO+nt7oF+oBIIGpm1i/teJmlf9WNHKzRFpDDT0brJjaI9znJHTvCslBDxEsUUPyP0/a95qsEexcDD0LKojeUgUwxZPEpB+ozEEQVR6lcg==',key_name='tempest-keypair-1529995714',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='113733a7b1f9424bb5243107472b01c6',ramdisk_id='',reservation_id='r-z1ofx0f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-135372045',owner_user_name='tempest-TaggedBootDevicesTest-135372045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:41:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='692d1dd6aa73472a9c63049910360a0b',uuid=bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e", "address": "fa:16:3e:f9:e2:65", "network": {"id": "92b9d247-3013-4a97-9ca0-41643807ce1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-923461645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3522bbcc-41", "ovs_interfaceid": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converting VIF {"id": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e", "address": "fa:16:3e:f9:e2:65", "network": {"id": "92b9d247-3013-4a97-9ca0-41643807ce1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-923461645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3522bbcc-41", "ovs_interfaceid": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:e2:65,bridge_name='br-int',has_traffic_filtering=True,id=3522bbcc-4190-48e3-ab01-ae36f8d6d64e,network=Network(92b9d247-3013-4a97-9ca0-41643807ce1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3522bbcc-41') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1230095561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1230095561',id=9,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPq5zgM+RzDby5P6sRhmB9kf8xO+nt7oF+oBIIGpm1i/teJmlf9WNHKzRFpDDT0brJjaI9znJHTvCslBDxEsUUPyP0/a95qsEexcDD0LKojeUgUwxZPEpB+ozEEQVR6lcg==',key_name='tempest-keypair-1529995714',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='113733a7b1f9424bb5243107472b01c6',ramdisk_id='',reservation_id='r-z1ofx0f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-135372045',owner_user_name='tempest-TaggedBootDevicesTest-135372045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:41:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='692d1dd6aa73472a9c63049910360a0b',uuid=bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eee87019-7923-4e16-8e15-f2a1010616e3", "address": "fa:16:3e:6c:ff:19", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeee87019-79", "ovs_interfaceid": "eee87019-7923-4e16-8e15-f2a1010616e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converting VIF {"id": "eee87019-7923-4e16-8e15-f2a1010616e3", "address": "fa:16:3e:6c:ff:19", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeee87019-79", "ovs_interfaceid": "eee87019-7923-4e16-8e15-f2a1010616e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:ff:19,bridge_name='br-int',has_traffic_filtering=True,id=eee87019-7923-4e16-8e15-f2a1010616e3,network=Network(08a79a3b-5c3d-4923-b568-4655661083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeee87019-79') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1230095561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1230095561',id=9,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPq5zgM+RzDby5P6sRhmB9kf8xO+nt7oF+oBIIGpm1i/teJmlf9WNHKzRFpDDT0brJjaI9znJHTvCslBDxEsUUPyP0/a95qsEexcDD0LKojeUgUwxZPEpB+ozEEQVR6lcg==',key_name='tempest-keypair-1529995714',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='113733a7b1f9424bb5243107472b01c6',ramdisk_id='',reservation_id='r-z1ofx0f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-135372045',owner_user_name='tempest-TaggedBootDevicesTest-135372045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:41:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='692d1dd6aa73472a9c63049910360a0b',uuid=bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd852601-98a3-4811-8bf5-120906e84646", "address": "fa:16:3e:cd:ab:83", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd852601-98", "ovs_interfaceid": "fd852601-98a3-4811-8bf5-120906e84646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converting VIF {"id": "fd852601-98a3-4811-8bf5-120906e84646", "address": "fa:16:3e:cd:ab:83", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd852601-98", "ovs_interfaceid": "fd852601-98a3-4811-8bf5-120906e84646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:ab:83,bridge_name='br-int',has_traffic_filtering=True,id=fd852601-98a3-4811-8bf5-120906e84646,network=Network(08a79a3b-5c3d-4923-b568-4655661083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd852601-98') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1230095561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1230095561',id=9,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPq5zgM+RzDby5P6sRhmB9kf8xO+nt7oF+oBIIGpm1i/teJmlf9WNHKzRFpDDT0brJjaI9znJHTvCslBDxEsUUPyP0/a95qsEexcDD0LKojeUgUwxZPEpB+ozEEQVR6lcg==',key_name='tempest-keypair-1529995714',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='113733a7b1f9424bb5243107472b01c6',ramdisk_id='',reservation_id='r-z1ofx0f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-135372045',owner_user_name='tempest-TaggedBootDevicesTest-135372045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:41:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='692d1dd6aa73472a9c63049910360a0b',uuid=bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d44e7f03-f338-4efa-b6b4-fb90d22aa37c", "address": "fa:16:3e:8d:5d:e1", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd44e7f03-f3", "ovs_interfaceid": "d44e7f03-f338-4efa-b6b4-fb90d22aa37c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converting VIF {"id": "d44e7f03-f338-4efa-b6b4-fb90d22aa37c", "address": "fa:16:3e:8d:5d:e1", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd44e7f03-f3", "ovs_interfaceid": "d44e7f03-f338-4efa-b6b4-fb90d22aa37c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:5d:e1,bridge_name='br-int',has_traffic_filtering=True,id=d44e7f03-f338-4efa-b6b4-fb90d22aa37c,network=Network(08a79a3b-5c3d-4923-b568-4655661083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd44e7f03-f3') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1230095561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1230095561',id=9,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPq5zgM+RzDby5P6sRhmB9kf8xO+nt7oF+oBIIGpm1i/teJmlf9WNHKzRFpDDT0brJjaI9znJHTvCslBDxEsUUPyP0/a95qsEexcDD0LKojeUgUwxZPEpB+ozEEQVR6lcg==',key_name='tempest-keypair-1529995714',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='113733a7b1f9424bb5243107472b01c6',ramdisk_id='',reservation_id='r-z1ofx0f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-135372045',owner_user_name='tempest-TaggedBootDevicesTest-135372045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:41:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='692d1dd6aa73472a9c63049910360a0b',uuid=bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b26233c-8774-42ae-9f2f-8794c8e364a1", "address": "fa:16:3e:ae:ed:db", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b26233c-87", "ovs_interfaceid": "2b26233c-8774-42ae-9f2f-8794c8e364a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converting VIF {"id": "2b26233c-8774-42ae-9f2f-8794c8e364a1", "address": "fa:16:3e:ae:ed:db", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b26233c-87", "ovs_interfaceid": "2b26233c-8774-42ae-9f2f-8794c8e364a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ed:db,bridge_name='br-int',has_traffic_filtering=True,id=2b26233c-8774-42ae-9f2f-8794c8e364a1,network=Network(08a79a3b-5c3d-4923-b568-4655661083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b26233c-87') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1230095561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1230095561',id=9,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPq5zgM+RzDby5P6sRhmB9kf8xO+nt7oF+oBIIGpm1i/teJmlf9WNHKzRFpDDT0brJjaI9znJHTvCslBDxEsUUPyP0/a95qsEexcDD0LKojeUgUwxZPEpB+ozEEQVR6lcg==',key_name='tempest-keypair-1529995714',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='113733a7b1f9424bb5243107472b01c6',ramdisk_id='',reservation_id='r-z1ofx0f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-135372045',owner_user_name='tempest-TaggedBootDevicesTest-135372045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:41:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='692d1dd6aa73472a9c63049910360a0b',uuid=bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "592ca281-1142-433c-996f-54b6bdce948b", "address": "fa:16:3e:ee:9d:4c", "network": {"id": "9169c3c6-6243-44ce-8070-5991e81046ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1541501115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592ca281-11", "ovs_interfaceid": "592ca281-1142-433c-996f-54b6bdce948b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converting VIF {"id": "592ca281-1142-433c-996f-54b6bdce948b", "address": "fa:16:3e:ee:9d:4c", "network": {"id": "9169c3c6-6243-44ce-8070-5991e81046ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1541501115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592ca281-11", "ovs_interfaceid": "592ca281-1142-433c-996f-54b6bdce948b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:9d:4c,bridge_name='br-int',has_traffic_filtering=True,id=592ca281-1142-433c-996f-54b6bdce948b,network=Network(9169c3c6-6243-44ce-8070-5991e81046ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592ca281-11') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1230095561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1230095561',id=9,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPq5zgM+RzDby5P6sRhmB9kf8xO+nt7oF+oBIIGpm1i/teJmlf9WNHKzRFpDDT0brJjaI9znJHTvCslBDxEsUUPyP0/a95qsEexcDD0LKojeUgUwxZPEpB+ozEEQVR6lcg==',key_name='tempest-keypair-1529995714',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='113733a7b1f9424bb5243107472b01c6',ramdisk_id='',reservation_id='r-z1ofx0f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-135372045',owner_user_name='tempest-TaggedBootDevicesTest-135372045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:41:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='692d1dd6aa73472a9c63049910360a0b',uuid=bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd", "address": "fa:16:3e:0f:ad:4f", "network": {"id": "9169c3c6-6243-44ce-8070-5991e81046ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1541501115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933d0949-bd", "ovs_interfaceid": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converting VIF {"id": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd", "address": "fa:16:3e:0f:ad:4f", "network": {"id": "9169c3c6-6243-44ce-8070-5991e81046ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1541501115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933d0949-bd", "ovs_interfaceid": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:ad:4f,bridge_name='br-int',has_traffic_filtering=True,id=933d0949-bd1a-4905-ae6a-e15e6b6e72dd,network=Network(9169c3c6-6243-44ce-8070-5991e81046ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap933d0949-bd') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.objects.instance [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lazy-loading 'pci_devices' on Instance uuid bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:42:11 user nova-compute[71498]:   <uuid>bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5</uuid>
Apr 14 01:42:11 user nova-compute[71498]:   <name>instance-00000009</name>
Apr 14 01:42:11 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:42:11 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:42:11 user nova-compute[71498]:   <metadata>
Apr 14 01:42:11 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:42:11 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:42:11 user nova-compute[71498]:       <nova:name>tempest-device-tagging-server-1230095561</nova:name>
Apr 14 01:42:11 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:42:06</nova:creationTime>
Apr 14 01:42:11 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:42:11 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:42:11 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:42:11 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:42:11 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:42:11 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:42:11 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:42:11 user nova-compute[71498]:       <nova:owner>
Apr 14 01:42:11 user nova-compute[71498]:         <nova:user uuid="692d1dd6aa73472a9c63049910360a0b">tempest-TaggedBootDevicesTest-135372045-project-member</nova:user>
Apr 14 01:42:11 user nova-compute[71498]:         <nova:project uuid="113733a7b1f9424bb5243107472b01c6">tempest-TaggedBootDevicesTest-135372045</nova:project>
Apr 14 01:42:11 user nova-compute[71498]:       </nova:owner>
Apr 14 01:42:11 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:42:11 user nova-compute[71498]:       <nova:ports>
Apr 14 01:42:11 user nova-compute[71498]:         <nova:port uuid="3522bbcc-4190-48e3-ab01-ae36f8d6d64e">
Apr 14 01:42:11 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 01:42:11 user nova-compute[71498]:         </nova:port>
Apr 14 01:42:11 user nova-compute[71498]:         <nova:port uuid="eee87019-7923-4e16-8e15-f2a1010616e3">
Apr 14 01:42:11 user nova-compute[71498]:           <nova:ip type="fixed" address="10.1.1.191" ipVersion="4"/>
Apr 14 01:42:11 user nova-compute[71498]:         </nova:port>
Apr 14 01:42:11 user nova-compute[71498]:         <nova:port uuid="fd852601-98a3-4811-8bf5-120906e84646">
Apr 14 01:42:11 user nova-compute[71498]:           <nova:ip type="fixed" address="10.1.1.32" ipVersion="4"/>
Apr 14 01:42:11 user nova-compute[71498]:         </nova:port>
Apr 14 01:42:11 user nova-compute[71498]:         <nova:port uuid="d44e7f03-f338-4efa-b6b4-fb90d22aa37c">
Apr 14 01:42:11 user nova-compute[71498]:           <nova:ip type="fixed" address="10.1.1.199" ipVersion="4"/>
Apr 14 01:42:11 user nova-compute[71498]:         </nova:port>
Apr 14 01:42:11 user nova-compute[71498]:         <nova:port uuid="2b26233c-8774-42ae-9f2f-8794c8e364a1">
Apr 14 01:42:11 user nova-compute[71498]:           <nova:ip type="fixed" address="10.1.1.27" ipVersion="4"/>
Apr 14 01:42:11 user nova-compute[71498]:         </nova:port>
Apr 14 01:42:11 user nova-compute[71498]:         <nova:port uuid="592ca281-1142-433c-996f-54b6bdce948b">
Apr 14 01:42:11 user nova-compute[71498]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 14 01:42:11 user nova-compute[71498]:         </nova:port>
Apr 14 01:42:11 user nova-compute[71498]:         <nova:port uuid="933d0949-bd1a-4905-ae6a-e15e6b6e72dd">
Apr 14 01:42:11 user nova-compute[71498]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 14 01:42:11 user nova-compute[71498]:         </nova:port>
Apr 14 01:42:11 user nova-compute[71498]:       </nova:ports>
Apr 14 01:42:11 user nova-compute[71498]:     </nova:instance>
Apr 14 01:42:11 user nova-compute[71498]:   </metadata>
Apr 14 01:42:11 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:42:11 user nova-compute[71498]:     <system>
Apr 14 01:42:11 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:42:11 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:42:11 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:42:11 user nova-compute[71498]:       <entry name="serial">bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5</entry>
Apr 14 01:42:11 user nova-compute[71498]:       <entry name="uuid">bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5</entry>
Apr 14 01:42:11 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:42:11 user nova-compute[71498]:     </system>
Apr 14 01:42:11 user nova-compute[71498]:   </sysinfo>
Apr 14 01:42:11 user nova-compute[71498]:   <os>
Apr 14 01:42:11 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:42:11 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:42:11 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:42:11 user nova-compute[71498]:   </os>
Apr 14 01:42:11 user nova-compute[71498]:   <features>
Apr 14 01:42:11 user nova-compute[71498]:     <acpi/>
Apr 14 01:42:11 user nova-compute[71498]:     <apic/>
Apr 14 01:42:11 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:42:11 user nova-compute[71498]:   </features>
Apr 14 01:42:11 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:42:11 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:42:11 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:42:11 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:42:11 user nova-compute[71498]:   </clock>
Apr 14 01:42:11 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:42:11 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:42:11 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:42:11 user nova-compute[71498]:   </cpu>
Apr 14 01:42:11 user nova-compute[71498]:   <devices>
Apr 14 01:42:11 user nova-compute[71498]:     <disk type="file" device="cdrom">
Apr 14 01:42:11 user nova-compute[71498]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 01:42:11 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5/disk.config"/>
Apr 14 01:42:11 user nova-compute[71498]:       <target dev="hda" bus="ide"/>
Apr 14 01:42:11 user nova-compute[71498]:     </disk>
Apr 14 01:42:11 user nova-compute[71498]:     <disk type="block" device="disk">
Apr 14 01:42:11 user nova-compute[71498]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:42:11 user nova-compute[71498]:       <source dev="/dev/sdb"/>
Apr 14 01:42:11 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:42:11 user nova-compute[71498]:       <serial>5e9b1e2c-15a4-481a-a713-fa24dca0918e</serial>
Apr 14 01:42:11 user nova-compute[71498]:     </disk>
Apr 14 01:42:11 user nova-compute[71498]:     <disk type="block" device="disk">
Apr 14 01:42:11 user nova-compute[71498]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:42:11 user nova-compute[71498]:       <source dev="/dev/sdc"/>
Apr 14 01:42:11 user nova-compute[71498]:       <target dev="vdb" bus="virtio"/>
Apr 14 01:42:11 user nova-compute[71498]:       <serial>953520b1-6ecb-41ad-8793-851901048f6d</serial>
Apr 14 01:42:11 user nova-compute[71498]:     </disk>
Apr 14 01:42:11 user nova-compute[71498]:     <disk type="block" device="disk">
Apr 14 01:42:11 user nova-compute[71498]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:42:11 user nova-compute[71498]:       <source dev="/dev/sdd"/>
Apr 14 01:42:11 user nova-compute[71498]:       <target dev="vdc" bus="virtio"/>
Apr 14 01:42:11 user nova-compute[71498]:       <serial>da07fe19-d0bc-4451-a0c5-29df607f9b02</serial>
Apr 14 01:42:11 user nova-compute[71498]:     </disk>
Apr 14 01:42:11 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:42:11 user nova-compute[71498]:       <mac address="fa:16:3e:f9:e2:65"/>
Apr 14 01:42:11 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:42:11 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:42:11 user nova-compute[71498]:       <target dev="tap3522bbcc-41"/>
Apr 14 01:42:11 user nova-compute[71498]:     </interface>
Apr 14 01:42:11 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:42:11 user nova-compute[71498]:       <mac address="fa:16:3e:6c:ff:19"/>
Apr 14 01:42:11 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:42:11 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:42:11 user nova-compute[71498]:       <target dev="tapeee87019-79"/>
Apr 14 01:42:11 user nova-compute[71498]:     </interface>
Apr 14 01:42:11 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:42:11 user nova-compute[71498]:       <mac address="fa:16:3e:cd:ab:83"/>
Apr 14 01:42:11 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:42:11 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:42:11 user nova-compute[71498]:       <target dev="tapfd852601-98"/>
Apr 14 01:42:11 user nova-compute[71498]:     </interface>
Apr 14 01:42:11 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:42:11 user nova-compute[71498]:       <mac address="fa:16:3e:8d:5d:e1"/>
Apr 14 01:42:11 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:42:11 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:42:11 user nova-compute[71498]:       <target dev="tapd44e7f03-f3"/>
Apr 14 01:42:11 user nova-compute[71498]:     </interface>
Apr 14 01:42:11 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:42:11 user nova-compute[71498]:       <mac address="fa:16:3e:ae:ed:db"/>
Apr 14 01:42:11 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:42:11 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:42:11 user nova-compute[71498]:       <target dev="tap2b26233c-87"/>
Apr 14 01:42:11 user nova-compute[71498]:     </interface>
Apr 14 01:42:11 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:42:11 user nova-compute[71498]:       <mac address="fa:16:3e:ee:9d:4c"/>
Apr 14 01:42:11 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:42:11 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:42:11 user nova-compute[71498]:       <target dev="tap592ca281-11"/>
Apr 14 01:42:11 user nova-compute[71498]:     </interface>
Apr 14 01:42:11 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:42:11 user nova-compute[71498]:       <mac address="fa:16:3e:0f:ad:4f"/>
Apr 14 01:42:11 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:42:11 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:42:11 user nova-compute[71498]:       <target dev="tap933d0949-bd"/>
Apr 14 01:42:11 user nova-compute[71498]:     </interface>
Apr 14 01:42:11 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:42:11 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5/console.log" append="off"/>
Apr 14 01:42:11 user nova-compute[71498]:     </serial>
Apr 14 01:42:11 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:42:11 user nova-compute[71498]:     <video>
Apr 14 01:42:11 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:42:11 user nova-compute[71498]:     </video>
Apr 14 01:42:11 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:42:11 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:42:11 user nova-compute[71498]:     </rng>
Apr 14 01:42:11 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:42:11 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:42:11 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:42:11 user nova-compute[71498]:     </memballoon>
Apr 14 01:42:11 user nova-compute[71498]:   </devices>
Apr 14 01:42:11 user nova-compute[71498]: </domain>
Apr 14 01:42:11 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1230095561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1230095561',id=9,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPq5zgM+RzDby5P6sRhmB9kf8xO+nt7oF+oBIIGpm1i/teJmlf9WNHKzRFpDDT0brJjaI9znJHTvCslBDxEsUUPyP0/a95qsEexcDD0LKojeUgUwxZPEpB+ozEEQVR6lcg==',key_name='tempest-keypair-1529995714',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='113733a7b1f9424bb5243107472b01c6',ramdisk_id='',reservation_id='r-z1ofx0f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-135372045',owner_user_name='tempest-TaggedBootDevicesTest-135372045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:41:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='692d1dd6aa73472a9c63049910360a0b',uuid=bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e", "address": "fa:16:3e:f9:e2:65", "network": {"id": "92b9d247-3013-4a97-9ca0-41643807ce1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-923461645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3522bbcc-41", "ovs_interfaceid": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converting VIF {"id": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e", "address": "fa:16:3e:f9:e2:65", "network": {"id": "92b9d247-3013-4a97-9ca0-41643807ce1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-923461645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3522bbcc-41", "ovs_interfaceid": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:e2:65,bridge_name='br-int',has_traffic_filtering=True,id=3522bbcc-4190-48e3-ab01-ae36f8d6d64e,network=Network(92b9d247-3013-4a97-9ca0-41643807ce1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3522bbcc-41') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG os_vif [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:e2:65,bridge_name='br-int',has_traffic_filtering=True,id=3522bbcc-4190-48e3-ab01-ae36f8d6d64e,network=Network(92b9d247-3013-4a97-9ca0-41643807ce1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3522bbcc-41') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3522bbcc-41, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3522bbcc-41, col_values=(('external_ids', {'iface-id': '3522bbcc-4190-48e3-ab01-ae36f8d6d64e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:e2:65', 'vm-uuid': 'bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:11 user nova-compute[71498]: INFO os_vif [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:e2:65,bridge_name='br-int',has_traffic_filtering=True,id=3522bbcc-4190-48e3-ab01-ae36f8d6d64e,network=Network(92b9d247-3013-4a97-9ca0-41643807ce1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3522bbcc-41')
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1230095561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1230095561',id=9,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPq5zgM+RzDby5P6sRhmB9kf8xO+nt7oF+oBIIGpm1i/teJmlf9WNHKzRFpDDT0brJjaI9znJHTvCslBDxEsUUPyP0/a95qsEexcDD0LKojeUgUwxZPEpB+ozEEQVR6lcg==',key_name='tempest-keypair-1529995714',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='113733a7b1f9424bb5243107472b01c6',ramdisk_id='',reservation_id='r-z1ofx0f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-135372045',owner_user_name='tempest-TaggedBootDevicesTest-135372045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:41:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='692d1dd6aa73472a9c63049910360a0b',uuid=bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eee87019-7923-4e16-8e15-f2a1010616e3", "address": "fa:16:3e:6c:ff:19", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeee87019-79", "ovs_interfaceid": "eee87019-7923-4e16-8e15-f2a1010616e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converting VIF {"id": "eee87019-7923-4e16-8e15-f2a1010616e3", "address": "fa:16:3e:6c:ff:19", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeee87019-79", "ovs_interfaceid": "eee87019-7923-4e16-8e15-f2a1010616e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:ff:19,bridge_name='br-int',has_traffic_filtering=True,id=eee87019-7923-4e16-8e15-f2a1010616e3,network=Network(08a79a3b-5c3d-4923-b568-4655661083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeee87019-79') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG os_vif [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:ff:19,bridge_name='br-int',has_traffic_filtering=True,id=eee87019-7923-4e16-8e15-f2a1010616e3,network=Network(08a79a3b-5c3d-4923-b568-4655661083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeee87019-79') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeee87019-79, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeee87019-79, col_values=(('external_ids', {'iface-id': 'eee87019-7923-4e16-8e15-f2a1010616e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:ff:19', 'vm-uuid': 'bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:11 user nova-compute[71498]: INFO os_vif [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:ff:19,bridge_name='br-int',has_traffic_filtering=True,id=eee87019-7923-4e16-8e15-f2a1010616e3,network=Network(08a79a3b-5c3d-4923-b568-4655661083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeee87019-79')
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1230095561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1230095561',id=9,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPq5zgM+RzDby5P6sRhmB9kf8xO+nt7oF+oBIIGpm1i/teJmlf9WNHKzRFpDDT0brJjaI9znJHTvCslBDxEsUUPyP0/a95qsEexcDD0LKojeUgUwxZPEpB+ozEEQVR6lcg==',key_name='tempest-keypair-1529995714',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='113733a7b1f9424bb5243107472b01c6',ramdisk_id='',reservation_id='r-z1ofx0f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-135372045',owner_user_name='tempest-TaggedBootDevicesTest-135372045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:41:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='692d1dd6aa73472a9c63049910360a0b',uuid=bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd852601-98a3-4811-8bf5-120906e84646", "address": "fa:16:3e:cd:ab:83", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd852601-98", "ovs_interfaceid": "fd852601-98a3-4811-8bf5-120906e84646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converting VIF {"id": "fd852601-98a3-4811-8bf5-120906e84646", "address": "fa:16:3e:cd:ab:83", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd852601-98", "ovs_interfaceid": "fd852601-98a3-4811-8bf5-120906e84646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:ab:83,bridge_name='br-int',has_traffic_filtering=True,id=fd852601-98a3-4811-8bf5-120906e84646,network=Network(08a79a3b-5c3d-4923-b568-4655661083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd852601-98') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG os_vif [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:ab:83,bridge_name='br-int',has_traffic_filtering=True,id=fd852601-98a3-4811-8bf5-120906e84646,network=Network(08a79a3b-5c3d-4923-b568-4655661083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd852601-98') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd852601-98, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd852601-98, col_values=(('external_ids', {'iface-id': 'fd852601-98a3-4811-8bf5-120906e84646', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:ab:83', 'vm-uuid': 'bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:11 user nova-compute[71498]: INFO os_vif [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:ab:83,bridge_name='br-int',has_traffic_filtering=True,id=fd852601-98a3-4811-8bf5-120906e84646,network=Network(08a79a3b-5c3d-4923-b568-4655661083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd852601-98')
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1230095561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1230095561',id=9,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPq5zgM+RzDby5P6sRhmB9kf8xO+nt7oF+oBIIGpm1i/teJmlf9WNHKzRFpDDT0brJjaI9znJHTvCslBDxEsUUPyP0/a95qsEexcDD0LKojeUgUwxZPEpB+ozEEQVR6lcg==',key_name='tempest-keypair-1529995714',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='113733a7b1f9424bb5243107472b01c6',ramdisk_id='',reservation_id='r-z1ofx0f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-135372045',owner_user_name='tempest-TaggedBootDevicesTest-135372045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:41:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='692d1dd6aa73472a9c63049910360a0b',uuid=bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d44e7f03-f338-4efa-b6b4-fb90d22aa37c", "address": "fa:16:3e:8d:5d:e1", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd44e7f03-f3", "ovs_interfaceid": "d44e7f03-f338-4efa-b6b4-fb90d22aa37c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converting VIF {"id": "d44e7f03-f338-4efa-b6b4-fb90d22aa37c", "address": "fa:16:3e:8d:5d:e1", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd44e7f03-f3", "ovs_interfaceid": "d44e7f03-f338-4efa-b6b4-fb90d22aa37c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:5d:e1,bridge_name='br-int',has_traffic_filtering=True,id=d44e7f03-f338-4efa-b6b4-fb90d22aa37c,network=Network(08a79a3b-5c3d-4923-b568-4655661083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd44e7f03-f3') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG os_vif [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:5d:e1,bridge_name='br-int',has_traffic_filtering=True,id=d44e7f03-f338-4efa-b6b4-fb90d22aa37c,network=Network(08a79a3b-5c3d-4923-b568-4655661083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd44e7f03-f3') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd44e7f03-f3, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd44e7f03-f3, col_values=(('external_ids', {'iface-id': 'd44e7f03-f338-4efa-b6b4-fb90d22aa37c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:5d:e1', 'vm-uuid': 'bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:11 user nova-compute[71498]: INFO os_vif [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:5d:e1,bridge_name='br-int',has_traffic_filtering=True,id=d44e7f03-f338-4efa-b6b4-fb90d22aa37c,network=Network(08a79a3b-5c3d-4923-b568-4655661083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd44e7f03-f3')
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1230095561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1230095561',id=9,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPq5zgM+RzDby5P6sRhmB9kf8xO+nt7oF+oBIIGpm1i/teJmlf9WNHKzRFpDDT0brJjaI9znJHTvCslBDxEsUUPyP0/a95qsEexcDD0LKojeUgUwxZPEpB+ozEEQVR6lcg==',key_name='tempest-keypair-1529995714',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='113733a7b1f9424bb5243107472b01c6',ramdisk_id='',reservation_id='r-z1ofx0f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-135372045',owner_user_name='tempest-TaggedBootDevicesTest-135372045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:41:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='692d1dd6aa73472a9c63049910360a0b',uuid=bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b26233c-8774-42ae-9f2f-8794c8e364a1", "address": "fa:16:3e:ae:ed:db", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b26233c-87", "ovs_interfaceid": "2b26233c-8774-42ae-9f2f-8794c8e364a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converting VIF {"id": "2b26233c-8774-42ae-9f2f-8794c8e364a1", "address": "fa:16:3e:ae:ed:db", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b26233c-87", "ovs_interfaceid": "2b26233c-8774-42ae-9f2f-8794c8e364a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ed:db,bridge_name='br-int',has_traffic_filtering=True,id=2b26233c-8774-42ae-9f2f-8794c8e364a1,network=Network(08a79a3b-5c3d-4923-b568-4655661083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b26233c-87') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG os_vif [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ed:db,bridge_name='br-int',has_traffic_filtering=True,id=2b26233c-8774-42ae-9f2f-8794c8e364a1,network=Network(08a79a3b-5c3d-4923-b568-4655661083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b26233c-87') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b26233c-87, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2b26233c-87, col_values=(('external_ids', {'iface-id': '2b26233c-8774-42ae-9f2f-8794c8e364a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:ed:db', 'vm-uuid': 'bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:11 user nova-compute[71498]: INFO os_vif [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ed:db,bridge_name='br-int',has_traffic_filtering=True,id=2b26233c-8774-42ae-9f2f-8794c8e364a1,network=Network(08a79a3b-5c3d-4923-b568-4655661083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b26233c-87')
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1230095561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1230095561',id=9,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPq5zgM+RzDby5P6sRhmB9kf8xO+nt7oF+oBIIGpm1i/teJmlf9WNHKzRFpDDT0brJjaI9znJHTvCslBDxEsUUPyP0/a95qsEexcDD0LKojeUgUwxZPEpB+ozEEQVR6lcg==',key_name='tempest-keypair-1529995714',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='113733a7b1f9424bb5243107472b01c6',ramdisk_id='',reservation_id='r-z1ofx0f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-135372045',owner_user_name='tempest-TaggedBootDevicesTest-135372045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:41:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='692d1dd6aa73472a9c63049910360a0b',uuid=bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "592ca281-1142-433c-996f-54b6bdce948b", "address": "fa:16:3e:ee:9d:4c", "network": {"id": "9169c3c6-6243-44ce-8070-5991e81046ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1541501115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592ca281-11", "ovs_interfaceid": "592ca281-1142-433c-996f-54b6bdce948b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converting VIF {"id": "592ca281-1142-433c-996f-54b6bdce948b", "address": "fa:16:3e:ee:9d:4c", "network": {"id": "9169c3c6-6243-44ce-8070-5991e81046ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1541501115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592ca281-11", "ovs_interfaceid": "592ca281-1142-433c-996f-54b6bdce948b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:9d:4c,bridge_name='br-int',has_traffic_filtering=True,id=592ca281-1142-433c-996f-54b6bdce948b,network=Network(9169c3c6-6243-44ce-8070-5991e81046ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592ca281-11') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG os_vif [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:9d:4c,bridge_name='br-int',has_traffic_filtering=True,id=592ca281-1142-433c-996f-54b6bdce948b,network=Network(9169c3c6-6243-44ce-8070-5991e81046ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592ca281-11') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap592ca281-11, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap592ca281-11, col_values=(('external_ids', {'iface-id': '592ca281-1142-433c-996f-54b6bdce948b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:9d:4c', 'vm-uuid': 'bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.network.neutron [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Successfully updated port: 9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "refresh_cache-ee4cf01f-8d33-4696-b6ec-7f188ee18026" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquired lock "refresh_cache-ee4cf01f-8d33-4696-b6ec-7f188ee18026" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.network.neutron [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:11 user nova-compute[71498]: INFO os_vif [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:9d:4c,bridge_name='br-int',has_traffic_filtering=True,id=592ca281-1142-433c-996f-54b6bdce948b,network=Network(9169c3c6-6243-44ce-8070-5991e81046ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592ca281-11')
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1230095561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1230095561',id=9,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPq5zgM+RzDby5P6sRhmB9kf8xO+nt7oF+oBIIGpm1i/teJmlf9WNHKzRFpDDT0brJjaI9znJHTvCslBDxEsUUPyP0/a95qsEexcDD0LKojeUgUwxZPEpB+ozEEQVR6lcg==',key_name='tempest-keypair-1529995714',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='113733a7b1f9424bb5243107472b01c6',ramdisk_id='',reservation_id='r-z1ofx0f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-135372045',owner_user_name='tempest-TaggedBootDevicesTest-135372045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:41:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='692d1dd6aa73472a9c63049910360a0b',uuid=bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd", "address": "fa:16:3e:0f:ad:4f", "network": {"id": "9169c3c6-6243-44ce-8070-5991e81046ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1541501115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933d0949-bd", "ovs_interfaceid": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converting VIF {"id": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd", "address": "fa:16:3e:0f:ad:4f", "network": {"id": "9169c3c6-6243-44ce-8070-5991e81046ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1541501115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933d0949-bd", "ovs_interfaceid": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:ad:4f,bridge_name='br-int',has_traffic_filtering=True,id=933d0949-bd1a-4905-ae6a-e15e6b6e72dd,network=Network(9169c3c6-6243-44ce-8070-5991e81046ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap933d0949-bd') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG os_vif [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:ad:4f,bridge_name='br-int',has_traffic_filtering=True,id=933d0949-bd1a-4905-ae6a-e15e6b6e72dd,network=Network(9169c3c6-6243-44ce-8070-5991e81046ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap933d0949-bd') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.compute.manager [req-9f09a9f4-6729-4541-af65-e251a8fdf9af req-793214e2-9560-4677-b91f-519ff37d8692 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Received event network-changed-9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.compute.manager [req-9f09a9f4-6729-4541-af65-e251a8fdf9af req-793214e2-9560-4677-b91f-519ff37d8692 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Refreshing instance network info cache due to event network-changed-9b10b56a-df5a-429e-a551-db729007648a. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-9f09a9f4-6729-4541-af65-e251a8fdf9af req-793214e2-9560-4677-b91f-519ff37d8692 service nova] Acquiring lock "refresh_cache-ee4cf01f-8d33-4696-b6ec-7f188ee18026" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap933d0949-bd, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap933d0949-bd, col_values=(('external_ids', {'iface-id': '933d0949-bd1a-4905-ae6a-e15e6b6e72dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:ad:4f', 'vm-uuid': 'bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.network.neutron [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:11 user nova-compute[71498]: INFO os_vif [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:ad:4f,bridge_name='br-int',has_traffic_filtering=True,id=933d0949-bd1a-4905-ae6a-e15e6b6e72dd,network=Network(9169c3c6-6243-44ce-8070-5991e81046ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap933d0949-bd')
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] No BDM found with device name hda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] No VIF found with MAC fa:16:3e:f9:e2:65, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] No VIF found with MAC fa:16:3e:ae:ed:db, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:42:11 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Using config drive
Apr 14 01:42:11 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Creating config drive at /opt/stack/data/nova/instances/bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5/disk.config
Apr 14 01:42:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbms9wf82 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbms9wf82" returned: 0 in 0.050s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.network.neutron [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Updating instance_info_cache with network_info: [{"id": "9b10b56a-df5a-429e-a551-db729007648a", "address": "fa:16:3e:89:b1:39", "network": {"id": "4f7f7e24-860c-47ce-b635-be72e8fe2913", "bridge": "br-int", "label": "tempest-TestShelveInstance-1817709221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef081a56d11d4b4d82ba5fe6572f3b95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b10b56a-df", "ovs_interfaceid": "9b10b56a-df5a-429e-a551-db729007648a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Releasing lock "refresh_cache-ee4cf01f-8d33-4696-b6ec-7f188ee18026" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.compute.manager [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Instance network_info: |[{"id": "9b10b56a-df5a-429e-a551-db729007648a", "address": "fa:16:3e:89:b1:39", "network": {"id": "4f7f7e24-860c-47ce-b635-be72e8fe2913", "bridge": "br-int", "label": "tempest-TestShelveInstance-1817709221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef081a56d11d4b4d82ba5fe6572f3b95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b10b56a-df", "ovs_interfaceid": "9b10b56a-df5a-429e-a551-db729007648a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-9f09a9f4-6729-4541-af65-e251a8fdf9af req-793214e2-9560-4677-b91f-519ff37d8692 service nova] Acquired lock "refresh_cache-ee4cf01f-8d33-4696-b6ec-7f188ee18026" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:42:11 user nova-compute[71498]: DEBUG nova.network.neutron [req-9f09a9f4-6729-4541-af65-e251a8fdf9af req-793214e2-9560-4677-b91f-519ff37d8692 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Refreshing network info cache for port 9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:42:12 user nova-compute[71498]: DEBUG nova.network.neutron [req-9f09a9f4-6729-4541-af65-e251a8fdf9af req-793214e2-9560-4677-b91f-519ff37d8692 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Updated VIF entry in instance network info cache for port 9b10b56a-df5a-429e-a551-db729007648a. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:42:12 user nova-compute[71498]: DEBUG nova.network.neutron [req-9f09a9f4-6729-4541-af65-e251a8fdf9af req-793214e2-9560-4677-b91f-519ff37d8692 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Updating instance_info_cache with network_info: [{"id": "9b10b56a-df5a-429e-a551-db729007648a", "address": "fa:16:3e:89:b1:39", "network": {"id": "4f7f7e24-860c-47ce-b635-be72e8fe2913", "bridge": "br-int", "label": "tempest-TestShelveInstance-1817709221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef081a56d11d4b4d82ba5fe6572f3b95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b10b56a-df", "ovs_interfaceid": "9b10b56a-df5a-429e-a551-db729007648a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:42:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-9f09a9f4-6729-4541-af65-e251a8fdf9af req-793214e2-9560-4677-b91f-519ff37d8692 service nova] Releasing lock "refresh_cache-ee4cf01f-8d33-4696-b6ec-7f188ee18026" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:42:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:13 user nova-compute[71498]: DEBUG nova.compute.manager [req-074b0be9-ef98-4cd2-ba13-d4a0afc076d5 req-7451e1c6-6d20-4b44-b892-30b453ac3358 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-plugged-3522bbcc-4190-48e3-ab01-ae36f8d6d64e {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:42:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-074b0be9-ef98-4cd2-ba13-d4a0afc076d5 req-7451e1c6-6d20-4b44-b892-30b453ac3358 service nova] Acquiring lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-074b0be9-ef98-4cd2-ba13-d4a0afc076d5 req-7451e1c6-6d20-4b44-b892-30b453ac3358 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-074b0be9-ef98-4cd2-ba13-d4a0afc076d5 req-7451e1c6-6d20-4b44-b892-30b453ac3358 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:13 user nova-compute[71498]: DEBUG nova.compute.manager [req-074b0be9-ef98-4cd2-ba13-d4a0afc076d5 req-7451e1c6-6d20-4b44-b892-30b453ac3358 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] No waiting events found dispatching network-vif-plugged-3522bbcc-4190-48e3-ab01-ae36f8d6d64e {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:42:13 user nova-compute[71498]: WARNING nova.compute.manager [req-074b0be9-ef98-4cd2-ba13-d4a0afc076d5 req-7451e1c6-6d20-4b44-b892-30b453ac3358 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received unexpected event network-vif-plugged-3522bbcc-4190-48e3-ab01-ae36f8d6d64e for instance with vm_state building and task_state spawning.
Apr 14 01:42:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:13 user nova-compute[71498]: DEBUG nova.compute.manager [req-d218abf8-ec01-41da-901a-8687d701df8d req-90afc55c-13e7-451a-8876-a92f12161701 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-plugged-eee87019-7923-4e16-8e15-f2a1010616e3 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:42:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d218abf8-ec01-41da-901a-8687d701df8d req-90afc55c-13e7-451a-8876-a92f12161701 service nova] Acquiring lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d218abf8-ec01-41da-901a-8687d701df8d req-90afc55c-13e7-451a-8876-a92f12161701 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d218abf8-ec01-41da-901a-8687d701df8d req-90afc55c-13e7-451a-8876-a92f12161701 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:13 user nova-compute[71498]: DEBUG nova.compute.manager [req-d218abf8-ec01-41da-901a-8687d701df8d req-90afc55c-13e7-451a-8876-a92f12161701 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] No waiting events found dispatching network-vif-plugged-eee87019-7923-4e16-8e15-f2a1010616e3 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:42:13 user nova-compute[71498]: WARNING nova.compute.manager [req-d218abf8-ec01-41da-901a-8687d701df8d req-90afc55c-13e7-451a-8876-a92f12161701 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received unexpected event network-vif-plugged-eee87019-7923-4e16-8e15-f2a1010616e3 for instance with vm_state building and task_state spawning.
Apr 14 01:42:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:14 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:14 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:14 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:14 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:14 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:14 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:14 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:14 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:14 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:14 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:14 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:14 user nova-compute[71498]: DEBUG nova.compute.manager [req-cc9e9d58-af00-4a00-b10f-87c76d5fc022 req-8b0429e4-240a-40ba-b14d-fd8c09835ec6 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-plugged-2b26233c-8774-42ae-9f2f-8794c8e364a1 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:42:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-cc9e9d58-af00-4a00-b10f-87c76d5fc022 req-8b0429e4-240a-40ba-b14d-fd8c09835ec6 service nova] Acquiring lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-cc9e9d58-af00-4a00-b10f-87c76d5fc022 req-8b0429e4-240a-40ba-b14d-fd8c09835ec6 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-cc9e9d58-af00-4a00-b10f-87c76d5fc022 req-8b0429e4-240a-40ba-b14d-fd8c09835ec6 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:14 user nova-compute[71498]: DEBUG nova.compute.manager [req-cc9e9d58-af00-4a00-b10f-87c76d5fc022 req-8b0429e4-240a-40ba-b14d-fd8c09835ec6 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] No waiting events found dispatching network-vif-plugged-2b26233c-8774-42ae-9f2f-8794c8e364a1 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:42:14 user nova-compute[71498]: WARNING nova.compute.manager [req-cc9e9d58-af00-4a00-b10f-87c76d5fc022 req-8b0429e4-240a-40ba-b14d-fd8c09835ec6 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received unexpected event network-vif-plugged-2b26233c-8774-42ae-9f2f-8794c8e364a1 for instance with vm_state building and task_state spawning.
Apr 14 01:42:14 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:14 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:14 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:15 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:15 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:15 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:15 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:15 user nova-compute[71498]: DEBUG nova.compute.manager [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-plugged-3522bbcc-4190-48e3-ab01-ae36f8d6d64e {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:42:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] Acquiring lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:15 user nova-compute[71498]: DEBUG nova.compute.manager [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] No waiting events found dispatching network-vif-plugged-3522bbcc-4190-48e3-ab01-ae36f8d6d64e {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:42:15 user nova-compute[71498]: WARNING nova.compute.manager [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received unexpected event network-vif-plugged-3522bbcc-4190-48e3-ab01-ae36f8d6d64e for instance with vm_state building and task_state spawning.
Apr 14 01:42:15 user nova-compute[71498]: DEBUG nova.compute.manager [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-plugged-fd852601-98a3-4811-8bf5-120906e84646 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:42:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] Acquiring lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:15 user nova-compute[71498]: DEBUG nova.compute.manager [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] No waiting events found dispatching network-vif-plugged-fd852601-98a3-4811-8bf5-120906e84646 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:42:15 user nova-compute[71498]: WARNING nova.compute.manager [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received unexpected event network-vif-plugged-fd852601-98a3-4811-8bf5-120906e84646 for instance with vm_state building and task_state spawning.
Apr 14 01:42:15 user nova-compute[71498]: DEBUG nova.compute.manager [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-plugged-fd852601-98a3-4811-8bf5-120906e84646 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:42:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] Acquiring lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:15 user nova-compute[71498]: DEBUG nova.compute.manager [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] No waiting events found dispatching network-vif-plugged-fd852601-98a3-4811-8bf5-120906e84646 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:42:15 user nova-compute[71498]: WARNING nova.compute.manager [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received unexpected event network-vif-plugged-fd852601-98a3-4811-8bf5-120906e84646 for instance with vm_state building and task_state spawning.
Apr 14 01:42:15 user nova-compute[71498]: DEBUG nova.compute.manager [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-plugged-d44e7f03-f338-4efa-b6b4-fb90d22aa37c {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:42:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] Acquiring lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:15 user nova-compute[71498]: DEBUG nova.compute.manager [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] No waiting events found dispatching network-vif-plugged-d44e7f03-f338-4efa-b6b4-fb90d22aa37c {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:42:15 user nova-compute[71498]: WARNING nova.compute.manager [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received unexpected event network-vif-plugged-d44e7f03-f338-4efa-b6b4-fb90d22aa37c for instance with vm_state building and task_state spawning.
Apr 14 01:42:15 user nova-compute[71498]: DEBUG nova.compute.manager [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-plugged-d44e7f03-f338-4efa-b6b4-fb90d22aa37c {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:42:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] Acquiring lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:15 user nova-compute[71498]: DEBUG nova.compute.manager [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] No waiting events found dispatching network-vif-plugged-d44e7f03-f338-4efa-b6b4-fb90d22aa37c {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:42:15 user nova-compute[71498]: WARNING nova.compute.manager [req-e6904340-dc66-49bc-920e-d9ae83ef836f req-80b7ed34-5000-47ae-ae10-88b406caae15 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received unexpected event network-vif-plugged-d44e7f03-f338-4efa-b6b4-fb90d22aa37c for instance with vm_state building and task_state spawning.
Apr 14 01:42:15 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:15 user nova-compute[71498]: DEBUG nova.compute.manager [req-0c7668e9-174b-4021-9237-641882336ae2 req-8758b939-8109-4544-9ffc-5330a7fea304 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-plugged-eee87019-7923-4e16-8e15-f2a1010616e3 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:42:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0c7668e9-174b-4021-9237-641882336ae2 req-8758b939-8109-4544-9ffc-5330a7fea304 service nova] Acquiring lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0c7668e9-174b-4021-9237-641882336ae2 req-8758b939-8109-4544-9ffc-5330a7fea304 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0c7668e9-174b-4021-9237-641882336ae2 req-8758b939-8109-4544-9ffc-5330a7fea304 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:15 user nova-compute[71498]: DEBUG nova.compute.manager [req-0c7668e9-174b-4021-9237-641882336ae2 req-8758b939-8109-4544-9ffc-5330a7fea304 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] No waiting events found dispatching network-vif-plugged-eee87019-7923-4e16-8e15-f2a1010616e3 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:42:15 user nova-compute[71498]: WARNING nova.compute.manager [req-0c7668e9-174b-4021-9237-641882336ae2 req-8758b939-8109-4544-9ffc-5330a7fea304 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received unexpected event network-vif-plugged-eee87019-7923-4e16-8e15-f2a1010616e3 for instance with vm_state building and task_state spawning.
Apr 14 01:42:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:16 user nova-compute[71498]: DEBUG nova.compute.manager [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-plugged-2b26233c-8774-42ae-9f2f-8794c8e364a1 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:42:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] Acquiring lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:16 user nova-compute[71498]: DEBUG nova.compute.manager [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] No waiting events found dispatching network-vif-plugged-2b26233c-8774-42ae-9f2f-8794c8e364a1 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:42:16 user nova-compute[71498]: WARNING nova.compute.manager [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received unexpected event network-vif-plugged-2b26233c-8774-42ae-9f2f-8794c8e364a1 for instance with vm_state building and task_state spawning.
Apr 14 01:42:16 user nova-compute[71498]: DEBUG nova.compute.manager [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-plugged-592ca281-1142-433c-996f-54b6bdce948b {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:42:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] Acquiring lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:16 user nova-compute[71498]: DEBUG nova.compute.manager [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] No waiting events found dispatching network-vif-plugged-592ca281-1142-433c-996f-54b6bdce948b {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:42:16 user nova-compute[71498]: WARNING nova.compute.manager [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received unexpected event network-vif-plugged-592ca281-1142-433c-996f-54b6bdce948b for instance with vm_state building and task_state spawning.
Apr 14 01:42:16 user nova-compute[71498]: DEBUG nova.compute.manager [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-plugged-592ca281-1142-433c-996f-54b6bdce948b {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:42:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] Acquiring lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:16 user nova-compute[71498]: DEBUG nova.compute.manager [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] No waiting events found dispatching network-vif-plugged-592ca281-1142-433c-996f-54b6bdce948b {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:42:16 user nova-compute[71498]: WARNING nova.compute.manager [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received unexpected event network-vif-plugged-592ca281-1142-433c-996f-54b6bdce948b for instance with vm_state building and task_state spawning.
Apr 14 01:42:16 user nova-compute[71498]: DEBUG nova.compute.manager [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-plugged-933d0949-bd1a-4905-ae6a-e15e6b6e72dd {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:42:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] Acquiring lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:16 user nova-compute[71498]: DEBUG nova.compute.manager [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] No waiting events found dispatching network-vif-plugged-933d0949-bd1a-4905-ae6a-e15e6b6e72dd {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:42:16 user nova-compute[71498]: WARNING nova.compute.manager [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received unexpected event network-vif-plugged-933d0949-bd1a-4905-ae6a-e15e6b6e72dd for instance with vm_state building and task_state spawning.
Apr 14 01:42:16 user nova-compute[71498]: DEBUG nova.compute.manager [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-plugged-933d0949-bd1a-4905-ae6a-e15e6b6e72dd {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:42:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] Acquiring lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:16 user nova-compute[71498]: DEBUG nova.compute.manager [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] No waiting events found dispatching network-vif-plugged-933d0949-bd1a-4905-ae6a-e15e6b6e72dd {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:42:16 user nova-compute[71498]: WARNING nova.compute.manager [req-0df0f57a-1c6d-4444-beac-f8b9adaed231 req-d200f57b-c2db-49fc-b738-f085fab9d2f0 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received unexpected event network-vif-plugged-933d0949-bd1a-4905-ae6a-e15e6b6e72dd for instance with vm_state building and task_state spawning.
Apr 14 01:42:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436537.4811683, bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:42:17 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] VM Resumed (Lifecycle Event)
Apr 14 01:42:17 user nova-compute[71498]: DEBUG nova.compute.manager [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:42:17 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Instance spawned successfully.
Apr 14 01:42:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:42:17 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:42:17 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436537.4827173, bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:42:17 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] VM Started (Lifecycle Event)
Apr 14 01:42:17 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:42:17 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:42:17 user nova-compute[71498]: INFO nova.compute.manager [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Took 10.71 seconds to spawn the instance on the hypervisor.
Apr 14 01:42:17 user nova-compute[71498]: DEBUG nova.compute.manager [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:42:17 user nova-compute[71498]: INFO nova.compute.manager [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Took 29.80 seconds to build instance.
Apr 14 01:42:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8079896e-8521-4c24-9771-0343217a9e1e tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.906s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG nova.compute.manager [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:42:17 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Creating image(s)
Apr 14 01:42:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Did not create local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Ensure instance console log exists: /opt/stack/data/nova/instances/ee4cf01f-8d33-4696-b6ec-7f188ee18026/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Start _get_guest_xml network_info=[{"id": "9b10b56a-df5a-429e-a551-db729007648a", "address": "fa:16:3e:89:b1:39", "network": {"id": "4f7f7e24-860c-47ce-b635-be72e8fe2913", "bridge": "br-int", "label": "tempest-TestShelveInstance-1817709221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef081a56d11d4b4d82ba5fe6572f3b95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b10b56a-df", "ovs_interfaceid": "9b10b56a-df5a-429e-a551-db729007648a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b8cabddc-b3b7-413f-a15c-6c0f5a91f190', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eLIEctAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ee4cf01f-8d33-4696-b6ec-7f188ee18026', 'attached_at': '', 'detached_at': '', 'volume_id': 'f78596d7-c339-491a-a0d2-470a1c158a53', 'serial': 'f78596d7-c339-491a-a0d2-470a1c158a53'}, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:42:17 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:42:17 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:42:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eLIEctAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:42:17 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:42:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:42:17 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:42:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:42:17 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:42:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3fc4d0-9e3c-4407-a21c-f22f0831d80c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:42:17 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d29f04-398a-4ec6-9805-663e5eaf81ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53] added
Apr 14 01:42:17 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf7d09e-2ded-4dc2-9110-2a76af708e29]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a448bd-2398-4acd-bf13-ea33296ed00a]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eLIEctAV {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eLIEctAV" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[484f6398-e4c4-4aca-8d14-3d18f0cef874]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eLIEctAV'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9fa191-178f-4d4e-99cc-0014e5431766]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[88951182-1520-4abb-b340-d2ad623f4a26]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:42:17 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:42:17 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:42:17 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:42:17 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:42:17 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:42:17 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:42:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:18 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e06237-511f-4c67-a40c-fcc3ffb13d16]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:18 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53, portal: 172.16.0.220,3260]
Apr 14 01:42:18 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53, portal: 172.16.0.220,3260] successful.
Apr 14 01:42:18 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:18 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b95f5ad-c232-4e1f-8feb-dab962138e47]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:18 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:18 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1a59af-e90b-49e3-8d27-cc6ce6b9928d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:18 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:42:18 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:42:18 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:42:18 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:42:18 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:42:18 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:42:18 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:42:18 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:42:18 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:42:18 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:42:18 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:42:18 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:42:18 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:42:18 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:42:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:18 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[583da35f-71d9-48c0-b794-7592453d37a6]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:18 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:42:18 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eLIEctAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:42:19 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:42:19 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26134336433353036', 'path': '/dev/sde'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:42:19 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134336433353036', 'path': '/dev/sde'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:42:19 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:42:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1018221636',display_name='tempest-TestShelveInstance-server-1018221636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1018221636',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8oQGYR+FY0LiM859XrQ9H3YlzTk6smIp49cfjoqSvxd/aONSV1r/k9gt1d5Db4fmA7gXaDRWLZ6VOsvQ07UleStWf5lgaLtfeieMukM+I8PpxvvoXTX8ZP8xMyS5I5RA==',key_name='tempest-TestShelveInstance-711764184',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef081a56d11d4b4d82ba5fe6572f3b95',ramdisk_id='',reservation_id='r-fjanozaf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-437254779',owner_user_name='tempest-TestShelveInstance-437254779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:42:10Z,user_data=None,user_id='447da297b18f4e7f86fa94cd4d5d7918',uuid=ee4cf01f-8d33-4696-b6ec-7f188ee18026,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b10b56a-df5a-429e-a551-db729007648a", "address": "fa:16:3e:89:b1:39", "network": {"id": "4f7f7e24-860c-47ce-b635-be72e8fe2913", "bridge": "br-int", "label": "tempest-TestShelveInstance-1817709221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef081a56d11d4b4d82ba5fe6572f3b95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b10b56a-df", "ovs_interfaceid": "9b10b56a-df5a-429e-a551-db729007648a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:42:19 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Converting VIF {"id": "9b10b56a-df5a-429e-a551-db729007648a", "address": "fa:16:3e:89:b1:39", "network": {"id": "4f7f7e24-860c-47ce-b635-be72e8fe2913", "bridge": "br-int", "label": "tempest-TestShelveInstance-1817709221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef081a56d11d4b4d82ba5fe6572f3b95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b10b56a-df", "ovs_interfaceid": "9b10b56a-df5a-429e-a551-db729007648a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:42:19 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:b1:39,bridge_name='br-int',has_traffic_filtering=True,id=9b10b56a-df5a-429e-a551-db729007648a,network=Network(4f7f7e24-860c-47ce-b635-be72e8fe2913),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b10b56a-df') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:42:19 user nova-compute[71498]: DEBUG nova.objects.instance [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lazy-loading 'pci_devices' on Instance uuid ee4cf01f-8d33-4696-b6ec-7f188ee18026 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:42:19 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:42:19 user nova-compute[71498]:   <uuid>ee4cf01f-8d33-4696-b6ec-7f188ee18026</uuid>
Apr 14 01:42:19 user nova-compute[71498]:   <name>instance-0000000b</name>
Apr 14 01:42:19 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:42:19 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:42:19 user nova-compute[71498]:   <metadata>
Apr 14 01:42:19 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:42:19 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:42:19 user nova-compute[71498]:       <nova:name>tempest-TestShelveInstance-server-1018221636</nova:name>
Apr 14 01:42:19 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:42:17</nova:creationTime>
Apr 14 01:42:19 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:42:19 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:42:19 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:42:19 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:42:19 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:42:19 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:42:19 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:42:19 user nova-compute[71498]:       <nova:owner>
Apr 14 01:42:19 user nova-compute[71498]:         <nova:user uuid="447da297b18f4e7f86fa94cd4d5d7918">tempest-TestShelveInstance-437254779-project-member</nova:user>
Apr 14 01:42:19 user nova-compute[71498]:         <nova:project uuid="ef081a56d11d4b4d82ba5fe6572f3b95">tempest-TestShelveInstance-437254779</nova:project>
Apr 14 01:42:19 user nova-compute[71498]:       </nova:owner>
Apr 14 01:42:19 user nova-compute[71498]:       <nova:ports>
Apr 14 01:42:19 user nova-compute[71498]:         <nova:port uuid="9b10b56a-df5a-429e-a551-db729007648a">
Apr 14 01:42:19 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 01:42:19 user nova-compute[71498]:         </nova:port>
Apr 14 01:42:19 user nova-compute[71498]:       </nova:ports>
Apr 14 01:42:19 user nova-compute[71498]:     </nova:instance>
Apr 14 01:42:19 user nova-compute[71498]:   </metadata>
Apr 14 01:42:19 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:42:19 user nova-compute[71498]:     <system>
Apr 14 01:42:19 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:42:19 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:42:19 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:42:19 user nova-compute[71498]:       <entry name="serial">ee4cf01f-8d33-4696-b6ec-7f188ee18026</entry>
Apr 14 01:42:19 user nova-compute[71498]:       <entry name="uuid">ee4cf01f-8d33-4696-b6ec-7f188ee18026</entry>
Apr 14 01:42:19 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:42:19 user nova-compute[71498]:     </system>
Apr 14 01:42:19 user nova-compute[71498]:   </sysinfo>
Apr 14 01:42:19 user nova-compute[71498]:   <os>
Apr 14 01:42:19 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:42:19 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:42:19 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:42:19 user nova-compute[71498]:   </os>
Apr 14 01:42:19 user nova-compute[71498]:   <features>
Apr 14 01:42:19 user nova-compute[71498]:     <acpi/>
Apr 14 01:42:19 user nova-compute[71498]:     <apic/>
Apr 14 01:42:19 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:42:19 user nova-compute[71498]:   </features>
Apr 14 01:42:19 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:42:19 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:42:19 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:42:19 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:42:19 user nova-compute[71498]:   </clock>
Apr 14 01:42:19 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:42:19 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:42:19 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:42:19 user nova-compute[71498]:   </cpu>
Apr 14 01:42:19 user nova-compute[71498]:   <devices>
Apr 14 01:42:19 user nova-compute[71498]:     <disk type="block" device="disk">
Apr 14 01:42:19 user nova-compute[71498]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:42:19 user nova-compute[71498]:       <source dev="/dev/sde"/>
Apr 14 01:42:19 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:42:19 user nova-compute[71498]:       <serial>f78596d7-c339-491a-a0d2-470a1c158a53</serial>
Apr 14 01:42:19 user nova-compute[71498]:     </disk>
Apr 14 01:42:19 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:42:19 user nova-compute[71498]:       <mac address="fa:16:3e:89:b1:39"/>
Apr 14 01:42:19 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:42:19 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:42:19 user nova-compute[71498]:       <target dev="tap9b10b56a-df"/>
Apr 14 01:42:19 user nova-compute[71498]:     </interface>
Apr 14 01:42:19 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:42:19 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/ee4cf01f-8d33-4696-b6ec-7f188ee18026/console.log" append="off"/>
Apr 14 01:42:19 user nova-compute[71498]:     </serial>
Apr 14 01:42:19 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:42:19 user nova-compute[71498]:     <video>
Apr 14 01:42:19 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:42:19 user nova-compute[71498]:     </video>
Apr 14 01:42:19 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:42:19 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:42:19 user nova-compute[71498]:     </rng>
Apr 14 01:42:19 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:42:19 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:42:19 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:42:19 user nova-compute[71498]:     </memballoon>
Apr 14 01:42:19 user nova-compute[71498]:   </devices>
Apr 14 01:42:19 user nova-compute[71498]: </domain>
Apr 14 01:42:19 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:42:19 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:42:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1018221636',display_name='tempest-TestShelveInstance-server-1018221636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1018221636',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8oQGYR+FY0LiM859XrQ9H3YlzTk6smIp49cfjoqSvxd/aONSV1r/k9gt1d5Db4fmA7gXaDRWLZ6VOsvQ07UleStWf5lgaLtfeieMukM+I8PpxvvoXTX8ZP8xMyS5I5RA==',key_name='tempest-TestShelveInstance-711764184',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef081a56d11d4b4d82ba5fe6572f3b95',ramdisk_id='',reservation_id='r-fjanozaf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-437254779',owner_user_name='tempest-TestShelveInstance-437254779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:42:10Z,user_data=None,user_id='447da297b18f4e7f86fa94cd4d5d7918',uuid=ee4cf01f-8d33-4696-b6ec-7f188ee18026,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b10b56a-df5a-429e-a551-db729007648a", "address": "fa:16:3e:89:b1:39", "network": {"id": "4f7f7e24-860c-47ce-b635-be72e8fe2913", "bridge": "br-int", "label": "tempest-TestShelveInstance-1817709221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef081a56d11d4b4d82ba5fe6572f3b95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b10b56a-df", "ovs_interfaceid": "9b10b56a-df5a-429e-a551-db729007648a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:42:19 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Converting VIF {"id": "9b10b56a-df5a-429e-a551-db729007648a", "address": "fa:16:3e:89:b1:39", "network": {"id": "4f7f7e24-860c-47ce-b635-be72e8fe2913", "bridge": "br-int", "label": "tempest-TestShelveInstance-1817709221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef081a56d11d4b4d82ba5fe6572f3b95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b10b56a-df", "ovs_interfaceid": "9b10b56a-df5a-429e-a551-db729007648a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:42:19 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:b1:39,bridge_name='br-int',has_traffic_filtering=True,id=9b10b56a-df5a-429e-a551-db729007648a,network=Network(4f7f7e24-860c-47ce-b635-be72e8fe2913),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b10b56a-df') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:42:19 user nova-compute[71498]: DEBUG os_vif [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:b1:39,bridge_name='br-int',has_traffic_filtering=True,id=9b10b56a-df5a-429e-a551-db729007648a,network=Network(4f7f7e24-860c-47ce-b635-be72e8fe2913),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b10b56a-df') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:42:19 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:19 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:42:19 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:42:19 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:19 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b10b56a-df, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:42:19 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9b10b56a-df, col_values=(('external_ids', {'iface-id': '9b10b56a-df5a-429e-a551-db729007648a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:b1:39', 'vm-uuid': 'ee4cf01f-8d33-4696-b6ec-7f188ee18026'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:42:19 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:19 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:42:19 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:19 user nova-compute[71498]: INFO os_vif [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:b1:39,bridge_name='br-int',has_traffic_filtering=True,id=9b10b56a-df5a-429e-a551-db729007648a,network=Network(4f7f7e24-860c-47ce-b635-be72e8fe2913),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b10b56a-df')
Apr 14 01:42:19 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:42:19 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] No VIF found with MAC fa:16:3e:89:b1:39, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:42:20 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:20 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:20 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:20 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:20 user nova-compute[71498]: DEBUG nova.compute.manager [req-b79696be-654b-4180-8de0-cc4d9e2b9b4e req-b6fe67b0-ae9a-47ef-941f-ca86e1d840ce service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Received event network-vif-plugged-9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:42:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b79696be-654b-4180-8de0-cc4d9e2b9b4e req-b6fe67b0-ae9a-47ef-941f-ca86e1d840ce service nova] Acquiring lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b79696be-654b-4180-8de0-cc4d9e2b9b4e req-b6fe67b0-ae9a-47ef-941f-ca86e1d840ce service nova] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b79696be-654b-4180-8de0-cc4d9e2b9b4e req-b6fe67b0-ae9a-47ef-941f-ca86e1d840ce service nova] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:20 user nova-compute[71498]: DEBUG nova.compute.manager [req-b79696be-654b-4180-8de0-cc4d9e2b9b4e req-b6fe67b0-ae9a-47ef-941f-ca86e1d840ce service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] No waiting events found dispatching network-vif-plugged-9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:42:20 user nova-compute[71498]: WARNING nova.compute.manager [req-b79696be-654b-4180-8de0-cc4d9e2b9b4e req-b6fe67b0-ae9a-47ef-941f-ca86e1d840ce service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Received unexpected event network-vif-plugged-9b10b56a-df5a-429e-a551-db729007648a for instance with vm_state building and task_state spawning.
Apr 14 01:42:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Acquiring lock "160b86fd-8405-42f5-90b2-8069917e4df1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "160b86fd-8405-42f5-90b2-8069917e4df1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:21 user nova-compute[71498]: DEBUG nova.compute.manager [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 01:42:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:21 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:42:21 user nova-compute[71498]: INFO nova.compute.claims [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Claim successful on node user
Apr 14 01:42:21 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:21 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:21 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:21 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:21 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:42:21 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:42:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:21 user nova-compute[71498]: DEBUG nova.compute.manager [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 01:42:21 user nova-compute[71498]: DEBUG nova.compute.manager [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 01:42:21 user nova-compute[71498]: DEBUG nova.network.neutron [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:42:21 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 01:42:21 user nova-compute[71498]: DEBUG nova.compute.manager [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 01:42:21 user nova-compute[71498]: DEBUG nova.compute.manager [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 01:42:21 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:42:21 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Creating image(s)
Apr 14 01:42:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Acquiring lock "/opt/stack/data/nova/instances/160b86fd-8405-42f5-90b2-8069917e4df1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "/opt/stack/data/nova/instances/160b86fd-8405-42f5-90b2-8069917e4df1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "/opt/stack/data/nova/instances/160b86fd-8405-42f5-90b2-8069917e4df1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.148s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG nova.policy [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ebae9b1685f46aea0064cf83813e4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4910c626438f42e9a5db828ae4dae86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.160s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/160b86fd-8405-42f5-90b2-8069917e4df1/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/160b86fd-8405-42f5-90b2-8069917e4df1/disk 1073741824" returned: 0 in 0.048s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.186s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Checking if we can resize image /opt/stack/data/nova/instances/160b86fd-8405-42f5-90b2-8069917e4df1/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/160b86fd-8405-42f5-90b2-8069917e4df1/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/160b86fd-8405-42f5-90b2-8069917e4df1/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Cannot resize image /opt/stack/data/nova/instances/160b86fd-8405-42f5-90b2-8069917e4df1/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG nova.objects.instance [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lazy-loading 'migration_context' on Instance uuid 160b86fd-8405-42f5-90b2-8069917e4df1 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Ensure instance console log exists: /opt/stack/data/nova/instances/160b86fd-8405-42f5-90b2-8069917e4df1/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436542.825882, ee4cf01f-8d33-4696-b6ec-7f188ee18026 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:42:22 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] VM Resumed (Lifecycle Event)
Apr 14 01:42:22 user nova-compute[71498]: DEBUG nova.compute.manager [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:42:22 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Instance spawned successfully.
Apr 14 01:42:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG nova.compute.manager [req-06a1ee18-8e17-4d4b-9039-7033c833e473 req-47b90fbe-b3df-444a-ac0d-082d4d7127b5 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Received event network-vif-plugged-9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-06a1ee18-8e17-4d4b-9039-7033c833e473 req-47b90fbe-b3df-444a-ac0d-082d4d7127b5 service nova] Acquiring lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-06a1ee18-8e17-4d4b-9039-7033c833e473 req-47b90fbe-b3df-444a-ac0d-082d4d7127b5 service nova] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-06a1ee18-8e17-4d4b-9039-7033c833e473 req-47b90fbe-b3df-444a-ac0d-082d4d7127b5 service nova] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG nova.compute.manager [req-06a1ee18-8e17-4d4b-9039-7033c833e473 req-47b90fbe-b3df-444a-ac0d-082d4d7127b5 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] No waiting events found dispatching network-vif-plugged-9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:42:22 user nova-compute[71498]: WARNING nova.compute.manager [req-06a1ee18-8e17-4d4b-9039-7033c833e473 req-47b90fbe-b3df-444a-ac0d-082d4d7127b5 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Received unexpected event network-vif-plugged-9b10b56a-df5a-429e-a551-db729007648a for instance with vm_state building and task_state spawning.
Apr 14 01:42:22 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:42:22 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:42:22 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436542.8311486, ee4cf01f-8d33-4696-b6ec-7f188ee18026 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:42:22 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] VM Started (Lifecycle Event)
Apr 14 01:42:22 user nova-compute[71498]: DEBUG nova.network.neutron [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Successfully created port: 54ba4ed4-462e-4ba6-896d-748b91cfa41e {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:42:22 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:42:22 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:42:22 user nova-compute[71498]: INFO nova.compute.manager [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Took 5.18 seconds to spawn the instance on the hypervisor.
Apr 14 01:42:22 user nova-compute[71498]: DEBUG nova.compute.manager [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:42:23 user nova-compute[71498]: INFO nova.compute.manager [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Took 13.83 seconds to build instance.
Apr 14 01:42:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fbb1ff9d-d1da-4f0b-b7f0-06aa5f978ae2 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.922s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:23 user nova-compute[71498]: DEBUG nova.network.neutron [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Successfully updated port: 54ba4ed4-462e-4ba6-896d-748b91cfa41e {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:42:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Acquiring lock "refresh_cache-160b86fd-8405-42f5-90b2-8069917e4df1" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:42:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Acquired lock "refresh_cache-160b86fd-8405-42f5-90b2-8069917e4df1" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:42:23 user nova-compute[71498]: DEBUG nova.network.neutron [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:42:23 user nova-compute[71498]: DEBUG nova.compute.manager [req-697a1e1f-be32-42eb-9c2e-b369731a14df req-9c3ea5c4-0961-493a-96cf-9621b21c52a4 service nova] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Received event network-changed-54ba4ed4-462e-4ba6-896d-748b91cfa41e {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:42:23 user nova-compute[71498]: DEBUG nova.compute.manager [req-697a1e1f-be32-42eb-9c2e-b369731a14df req-9c3ea5c4-0961-493a-96cf-9621b21c52a4 service nova] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Refreshing instance network info cache due to event network-changed-54ba4ed4-462e-4ba6-896d-748b91cfa41e. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:42:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-697a1e1f-be32-42eb-9c2e-b369731a14df req-9c3ea5c4-0961-493a-96cf-9621b21c52a4 service nova] Acquiring lock "refresh_cache-160b86fd-8405-42f5-90b2-8069917e4df1" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:42:23 user nova-compute[71498]: DEBUG nova.network.neutron [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:42:23 user nova-compute[71498]: DEBUG nova.network.neutron [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Updating instance_info_cache with network_info: [{"id": "54ba4ed4-462e-4ba6-896d-748b91cfa41e", "address": "fa:16:3e:e9:b9:b3", "network": {"id": "3f3dcd60-d01f-4287-9d8c-990be91e165c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3663dea83d234eeca8dc09f5d706a616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ba4ed4-46", "ovs_interfaceid": "54ba4ed4-462e-4ba6-896d-748b91cfa41e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Releasing lock "refresh_cache-160b86fd-8405-42f5-90b2-8069917e4df1" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG nova.compute.manager [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Instance network_info: |[{"id": "54ba4ed4-462e-4ba6-896d-748b91cfa41e", "address": "fa:16:3e:e9:b9:b3", "network": {"id": "3f3dcd60-d01f-4287-9d8c-990be91e165c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3663dea83d234eeca8dc09f5d706a616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ba4ed4-46", "ovs_interfaceid": "54ba4ed4-462e-4ba6-896d-748b91cfa41e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-697a1e1f-be32-42eb-9c2e-b369731a14df req-9c3ea5c4-0961-493a-96cf-9621b21c52a4 service nova] Acquired lock "refresh_cache-160b86fd-8405-42f5-90b2-8069917e4df1" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG nova.network.neutron [req-697a1e1f-be32-42eb-9c2e-b369731a14df req-9c3ea5c4-0961-493a-96cf-9621b21c52a4 service nova] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Refreshing network info cache for port 54ba4ed4-462e-4ba6-896d-748b91cfa41e {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Start _get_guest_xml network_info=[{"id": "54ba4ed4-462e-4ba6-896d-748b91cfa41e", "address": "fa:16:3e:e9:b9:b3", "network": {"id": "3f3dcd60-d01f-4287-9d8c-990be91e165c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3663dea83d234eeca8dc09f5d706a616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ba4ed4-46", "ovs_interfaceid": "54ba4ed4-462e-4ba6-896d-748b91cfa41e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:42:24 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:42:24 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:42:24 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:42:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1371662919',display_name='tempest-VolumesNegativeTest-instance-1371662919',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1371662919',id=12,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4910c626438f42e9a5db828ae4dae86c',ramdisk_id='',reservation_id='r-kdf6md0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-116646311',owner_user_name='tempest-VolumesNegativeTest-116646311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:42:22Z,user_data=None,user_id='8ebae9b1685f46aea0064cf83813e4d8',uuid=160b86fd-8405-42f5-90b2-8069917e4df1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54ba4ed4-462e-4ba6-896d-748b91cfa41e", "address": "fa:16:3e:e9:b9:b3", "network": {"id": "3f3dcd60-d01f-4287-9d8c-990be91e165c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3663dea83d234eeca8dc09f5d706a616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ba4ed4-46", "ovs_interfaceid": "54ba4ed4-462e-4ba6-896d-748b91cfa41e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Converting VIF {"id": "54ba4ed4-462e-4ba6-896d-748b91cfa41e", "address": "fa:16:3e:e9:b9:b3", "network": {"id": "3f3dcd60-d01f-4287-9d8c-990be91e165c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3663dea83d234eeca8dc09f5d706a616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ba4ed4-46", "ovs_interfaceid": "54ba4ed4-462e-4ba6-896d-748b91cfa41e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:b9:b3,bridge_name='br-int',has_traffic_filtering=True,id=54ba4ed4-462e-4ba6-896d-748b91cfa41e,network=Network(3f3dcd60-d01f-4287-9d8c-990be91e165c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ba4ed4-46') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG nova.objects.instance [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lazy-loading 'pci_devices' on Instance uuid 160b86fd-8405-42f5-90b2-8069917e4df1 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:42:24 user nova-compute[71498]:   <uuid>160b86fd-8405-42f5-90b2-8069917e4df1</uuid>
Apr 14 01:42:24 user nova-compute[71498]:   <name>instance-0000000c</name>
Apr 14 01:42:24 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:42:24 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:42:24 user nova-compute[71498]:   <metadata>
Apr 14 01:42:24 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:42:24 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:42:24 user nova-compute[71498]:       <nova:name>tempest-VolumesNegativeTest-instance-1371662919</nova:name>
Apr 14 01:42:24 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:42:24</nova:creationTime>
Apr 14 01:42:24 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:42:24 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:42:24 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:42:24 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:42:24 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:42:24 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:42:24 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:42:24 user nova-compute[71498]:       <nova:owner>
Apr 14 01:42:24 user nova-compute[71498]:         <nova:user uuid="8ebae9b1685f46aea0064cf83813e4d8">tempest-VolumesNegativeTest-116646311-project-member</nova:user>
Apr 14 01:42:24 user nova-compute[71498]:         <nova:project uuid="4910c626438f42e9a5db828ae4dae86c">tempest-VolumesNegativeTest-116646311</nova:project>
Apr 14 01:42:24 user nova-compute[71498]:       </nova:owner>
Apr 14 01:42:24 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:42:24 user nova-compute[71498]:       <nova:ports>
Apr 14 01:42:24 user nova-compute[71498]:         <nova:port uuid="54ba4ed4-462e-4ba6-896d-748b91cfa41e">
Apr 14 01:42:24 user nova-compute[71498]:           <nova:ip type="fixed" address="192.168.233.192" ipVersion="4"/>
Apr 14 01:42:24 user nova-compute[71498]:         </nova:port>
Apr 14 01:42:24 user nova-compute[71498]:       </nova:ports>
Apr 14 01:42:24 user nova-compute[71498]:     </nova:instance>
Apr 14 01:42:24 user nova-compute[71498]:   </metadata>
Apr 14 01:42:24 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:42:24 user nova-compute[71498]:     <system>
Apr 14 01:42:24 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:42:24 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:42:24 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:42:24 user nova-compute[71498]:       <entry name="serial">160b86fd-8405-42f5-90b2-8069917e4df1</entry>
Apr 14 01:42:24 user nova-compute[71498]:       <entry name="uuid">160b86fd-8405-42f5-90b2-8069917e4df1</entry>
Apr 14 01:42:24 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:42:24 user nova-compute[71498]:     </system>
Apr 14 01:42:24 user nova-compute[71498]:   </sysinfo>
Apr 14 01:42:24 user nova-compute[71498]:   <os>
Apr 14 01:42:24 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:42:24 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:42:24 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:42:24 user nova-compute[71498]:   </os>
Apr 14 01:42:24 user nova-compute[71498]:   <features>
Apr 14 01:42:24 user nova-compute[71498]:     <acpi/>
Apr 14 01:42:24 user nova-compute[71498]:     <apic/>
Apr 14 01:42:24 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:42:24 user nova-compute[71498]:   </features>
Apr 14 01:42:24 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:42:24 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:42:24 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:42:24 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:42:24 user nova-compute[71498]:   </clock>
Apr 14 01:42:24 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:42:24 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:42:24 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:42:24 user nova-compute[71498]:   </cpu>
Apr 14 01:42:24 user nova-compute[71498]:   <devices>
Apr 14 01:42:24 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:42:24 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:42:24 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/160b86fd-8405-42f5-90b2-8069917e4df1/disk"/>
Apr 14 01:42:24 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:42:24 user nova-compute[71498]:     </disk>
Apr 14 01:42:24 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:42:24 user nova-compute[71498]:       <mac address="fa:16:3e:e9:b9:b3"/>
Apr 14 01:42:24 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:42:24 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:42:24 user nova-compute[71498]:       <target dev="tap54ba4ed4-46"/>
Apr 14 01:42:24 user nova-compute[71498]:     </interface>
Apr 14 01:42:24 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:42:24 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/160b86fd-8405-42f5-90b2-8069917e4df1/console.log" append="off"/>
Apr 14 01:42:24 user nova-compute[71498]:     </serial>
Apr 14 01:42:24 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:42:24 user nova-compute[71498]:     <video>
Apr 14 01:42:24 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:42:24 user nova-compute[71498]:     </video>
Apr 14 01:42:24 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:42:24 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:42:24 user nova-compute[71498]:     </rng>
Apr 14 01:42:24 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:42:24 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:42:24 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:42:24 user nova-compute[71498]:     </memballoon>
Apr 14 01:42:24 user nova-compute[71498]:   </devices>
Apr 14 01:42:24 user nova-compute[71498]: </domain>
Apr 14 01:42:24 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:42:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1371662919',display_name='tempest-VolumesNegativeTest-instance-1371662919',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1371662919',id=12,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4910c626438f42e9a5db828ae4dae86c',ramdisk_id='',reservation_id='r-kdf6md0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-116646311',owner_user_name='tempest-VolumesNegativeTest-116646311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:42:22Z,user_data=None,user_id='8ebae9b1685f46aea0064cf83813e4d8',uuid=160b86fd-8405-42f5-90b2-8069917e4df1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54ba4ed4-462e-4ba6-896d-748b91cfa41e", "address": "fa:16:3e:e9:b9:b3", "network": {"id": "3f3dcd60-d01f-4287-9d8c-990be91e165c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3663dea83d234eeca8dc09f5d706a616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ba4ed4-46", "ovs_interfaceid": "54ba4ed4-462e-4ba6-896d-748b91cfa41e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Converting VIF {"id": "54ba4ed4-462e-4ba6-896d-748b91cfa41e", "address": "fa:16:3e:e9:b9:b3", "network": {"id": "3f3dcd60-d01f-4287-9d8c-990be91e165c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3663dea83d234eeca8dc09f5d706a616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ba4ed4-46", "ovs_interfaceid": "54ba4ed4-462e-4ba6-896d-748b91cfa41e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:b9:b3,bridge_name='br-int',has_traffic_filtering=True,id=54ba4ed4-462e-4ba6-896d-748b91cfa41e,network=Network(3f3dcd60-d01f-4287-9d8c-990be91e165c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ba4ed4-46') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG os_vif [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:b9:b3,bridge_name='br-int',has_traffic_filtering=True,id=54ba4ed4-462e-4ba6-896d-748b91cfa41e,network=Network(3f3dcd60-d01f-4287-9d8c-990be91e165c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ba4ed4-46') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54ba4ed4-46, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap54ba4ed4-46, col_values=(('external_ids', {'iface-id': '54ba4ed4-462e-4ba6-896d-748b91cfa41e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:b9:b3', 'vm-uuid': '160b86fd-8405-42f5-90b2-8069917e4df1'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:24 user nova-compute[71498]: INFO os_vif [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:b9:b3,bridge_name='br-int',has_traffic_filtering=True,id=54ba4ed4-462e-4ba6-896d-748b91cfa41e,network=Network(3f3dcd60-d01f-4287-9d8c-990be91e165c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ba4ed4-46')
Apr 14 01:42:24 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] No VIF found with MAC fa:16:3e:e9:b9:b3, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG nova.network.neutron [req-697a1e1f-be32-42eb-9c2e-b369731a14df req-9c3ea5c4-0961-493a-96cf-9621b21c52a4 service nova] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Updated VIF entry in instance network info cache for port 54ba4ed4-462e-4ba6-896d-748b91cfa41e. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG nova.network.neutron [req-697a1e1f-be32-42eb-9c2e-b369731a14df req-9c3ea5c4-0961-493a-96cf-9621b21c52a4 service nova] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Updating instance_info_cache with network_info: [{"id": "54ba4ed4-462e-4ba6-896d-748b91cfa41e", "address": "fa:16:3e:e9:b9:b3", "network": {"id": "3f3dcd60-d01f-4287-9d8c-990be91e165c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3663dea83d234eeca8dc09f5d706a616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ba4ed4-46", "ovs_interfaceid": "54ba4ed4-462e-4ba6-896d-748b91cfa41e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:42:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-697a1e1f-be32-42eb-9c2e-b369731a14df req-9c3ea5c4-0961-493a-96cf-9621b21c52a4 service nova] Releasing lock "refresh_cache-160b86fd-8405-42f5-90b2-8069917e4df1" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:42:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:25 user nova-compute[71498]: DEBUG nova.compute.manager [req-73f9ade4-b636-4641-a08d-9eb26de59f81 req-73ada80e-a41f-445d-8f8e-be5a405ebc07 service nova] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Received event network-vif-plugged-54ba4ed4-462e-4ba6-896d-748b91cfa41e {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:42:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-73f9ade4-b636-4641-a08d-9eb26de59f81 req-73ada80e-a41f-445d-8f8e-be5a405ebc07 service nova] Acquiring lock "160b86fd-8405-42f5-90b2-8069917e4df1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-73f9ade4-b636-4641-a08d-9eb26de59f81 req-73ada80e-a41f-445d-8f8e-be5a405ebc07 service nova] Lock "160b86fd-8405-42f5-90b2-8069917e4df1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-73f9ade4-b636-4641-a08d-9eb26de59f81 req-73ada80e-a41f-445d-8f8e-be5a405ebc07 service nova] Lock "160b86fd-8405-42f5-90b2-8069917e4df1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:25 user nova-compute[71498]: DEBUG nova.compute.manager [req-73f9ade4-b636-4641-a08d-9eb26de59f81 req-73ada80e-a41f-445d-8f8e-be5a405ebc07 service nova] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] No waiting events found dispatching network-vif-plugged-54ba4ed4-462e-4ba6-896d-748b91cfa41e {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:42:25 user nova-compute[71498]: WARNING nova.compute.manager [req-73f9ade4-b636-4641-a08d-9eb26de59f81 req-73ada80e-a41f-445d-8f8e-be5a405ebc07 service nova] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Received unexpected event network-vif-plugged-54ba4ed4-462e-4ba6-896d-748b91cfa41e for instance with vm_state building and task_state spawning.
Apr 14 01:42:26 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:26 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:26 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:27 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436547.7908041, 160b86fd-8405-42f5-90b2-8069917e4df1 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:42:27 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] VM Resumed (Lifecycle Event)
Apr 14 01:42:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:42:27 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:42:27 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Instance spawned successfully.
Apr 14 01:42:27 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:42:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:42:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:42:27 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:42:27 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:42:27 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:42:27 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:42:27 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:42:27 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:42:27 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:42:27 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436547.7919407, 160b86fd-8405-42f5-90b2-8069917e4df1 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:42:27 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] VM Started (Lifecycle Event)
Apr 14 01:42:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:42:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:42:27 user nova-compute[71498]: INFO nova.compute.manager [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Took 6.03 seconds to spawn the instance on the hypervisor.
Apr 14 01:42:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:42:27 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:42:27 user nova-compute[71498]: DEBUG nova.compute.manager [req-f8b44aa9-4dbf-4f5f-9069-91aa060e408c req-079e7cc5-aa83-43a2-b29c-3abb656b25b0 service nova] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Received event network-vif-plugged-54ba4ed4-462e-4ba6-896d-748b91cfa41e {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:42:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f8b44aa9-4dbf-4f5f-9069-91aa060e408c req-079e7cc5-aa83-43a2-b29c-3abb656b25b0 service nova] Acquiring lock "160b86fd-8405-42f5-90b2-8069917e4df1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f8b44aa9-4dbf-4f5f-9069-91aa060e408c req-079e7cc5-aa83-43a2-b29c-3abb656b25b0 service nova] Lock "160b86fd-8405-42f5-90b2-8069917e4df1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f8b44aa9-4dbf-4f5f-9069-91aa060e408c req-079e7cc5-aa83-43a2-b29c-3abb656b25b0 service nova] Lock "160b86fd-8405-42f5-90b2-8069917e4df1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:27 user nova-compute[71498]: DEBUG nova.compute.manager [req-f8b44aa9-4dbf-4f5f-9069-91aa060e408c req-079e7cc5-aa83-43a2-b29c-3abb656b25b0 service nova] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] No waiting events found dispatching network-vif-plugged-54ba4ed4-462e-4ba6-896d-748b91cfa41e {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:42:27 user nova-compute[71498]: WARNING nova.compute.manager [req-f8b44aa9-4dbf-4f5f-9069-91aa060e408c req-079e7cc5-aa83-43a2-b29c-3abb656b25b0 service nova] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Received unexpected event network-vif-plugged-54ba4ed4-462e-4ba6-896d-748b91cfa41e for instance with vm_state building and task_state spawning.
Apr 14 01:42:27 user nova-compute[71498]: INFO nova.compute.manager [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Took 6.85 seconds to build instance.
Apr 14 01:42:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-06742fc4-caca-494a-a9ec-33a24ba8628d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "160b86fd-8405-42f5-90b2-8069917e4df1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:28 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:42:28 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:42:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:28 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 01:42:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/039d0702-d115-4c25-ab88-d669c6320820/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/039d0702-d115-4c25-ab88-d669c6320820/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/039d0702-d115-4c25-ab88-d669c6320820/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/039d0702-d115-4c25-ab88-d669c6320820/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/disk --force-share --output=json" returned: 0 in 0.411s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d10278-cf24-4fde-86eb-664ba86cbd8f/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d10278-cf24-4fde-86eb-664ba86cbd8f/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d10278-cf24-4fde-86eb-664ba86cbd8f/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1d10278-cf24-4fde-86eb-664ba86cbd8f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:42:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/160b86fd-8405-42f5-90b2-8069917e4df1/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/160b86fd-8405-42f5-90b2-8069917e4df1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/160b86fd-8405-42f5-90b2-8069917e4df1/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/160b86fd-8405-42f5-90b2-8069917e4df1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:42:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:42:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:42:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9397a9e2-b5e9-47e7-b25e-5c40379a60eb/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9397a9e2-b5e9-47e7-b25e-5c40379a60eb/disk --force-share --output=json" returned: 0 in 0.592s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9397a9e2-b5e9-47e7-b25e-5c40379a60eb/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9397a9e2-b5e9-47e7-b25e-5c40379a60eb/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:33 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:42:33 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:42:33 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=7208MB free_disk=26.573726654052734GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 01:42:33 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:33 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:33 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance da60f4f1-2474-453f-8f84-c95daf02431a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:42:33 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:42:33 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 039d0702-d115-4c25-ab88-d669c6320820 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:42:33 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:42:33 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance f68784e7-578c-4a12-87d4-f35fbc5a1d59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:42:33 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance f1d10278-cf24-4fde-86eb-664ba86cbd8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:42:33 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance f45130b1-9e83-47a0-b335-a6e74875b79e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:42:33 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:42:33 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:42:33 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 9397a9e2-b5e9-47e7-b25e-5c40379a60eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:42:33 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance ee4cf01f-8d33-4696-b6ec-7f188ee18026 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:42:33 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 160b86fd-8405-42f5-90b2-8069917e4df1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:42:33 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 01:42:33 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 01:42:33 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:42:33 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:42:33 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 01:42:33 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.740s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:34 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "2dfd39c9-8535-40d0-863d-c30fc98103e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "2dfd39c9-8535-40d0-863d-c30fc98103e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:34 user nova-compute[71498]: DEBUG nova.compute.manager [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 01:42:34 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:42:34 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:42:34 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 01:42:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:34 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:42:34 user nova-compute[71498]: INFO nova.compute.claims [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Claim successful on node user
Apr 14 01:42:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-8e042a42-7cc2-4d72-b7ed-2b80339f2c85" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:42:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-8e042a42-7cc2-4d72-b7ed-2b80339f2c85" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:42:35 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 01:42:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-971acb90-6a43-42ba-850c-dabdc3263634 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:42:35 user nova-compute[71498]: INFO nova.compute.manager [None req-971acb90-6a43-42ba-850c-dabdc3263634 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] instance snapshotting
Apr 14 01:42:35 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-971acb90-6a43-42ba-850c-dabdc3263634 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Beginning live snapshot process
Apr 14 01:42:35 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:42:35 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:42:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.613s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 01:42:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 01:42:35 user nova-compute[71498]: DEBUG nova.network.neutron [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:42:35 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Updating instance_info_cache with network_info: [{"id": "ed749832-992f-44d3-8316-87f59088b737", "address": "fa:16:3e:98:9d:2e", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped749832-99", "ovs_interfaceid": "ed749832-992f-44d3-8316-87f59088b737", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:42:35 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 01:42:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-8e042a42-7cc2-4d72-b7ed-2b80339f2c85" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:42:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 01:42:35 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:42:35 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:42:35 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:42:35 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:42:35 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:42:35 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:42:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 01:42:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 01:42:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-971acb90-6a43-42ba-850c-dabdc3263634 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json -f qcow2 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:35 user nova-compute[71498]: DEBUG nova.policy [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '236828e284154097a25f59eaedf47c29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907f632263e04bf2a6c8ff1bae77a5c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:42:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 01:42:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:42:35 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Creating image(s)
Apr 14 01:42:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "/opt/stack/data/nova/instances/2dfd39c9-8535-40d0-863d-c30fc98103e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "/opt/stack/data/nova/instances/2dfd39c9-8535-40d0-863d-c30fc98103e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "/opt/stack/data/nova/instances/2dfd39c9-8535-40d0-863d-c30fc98103e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-971acb90-6a43-42ba-850c-dabdc3263634 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json -f qcow2" returned: 0 in 0.189s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-971acb90-6a43-42ba-850c-dabdc3263634 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json -f qcow2 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.160s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-971acb90-6a43-42ba-850c-dabdc3263634 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json -f qcow2" returned: 0 in 0.154s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-971acb90-6a43-42ba-850c-dabdc3263634 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.354s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-971acb90-6a43-42ba-850c-dabdc3263634 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.321s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/2dfd39c9-8535-40d0-863d-c30fc98103e6/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-971acb90-6a43-42ba-850c-dabdc3263634 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpngqd95ri/0e44ef8babbb4339b9f1224d6700145a.delta 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/2dfd39c9-8535-40d0-863d-c30fc98103e6/disk 1073741824" returned: 0 in 0.069s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.429s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:36 user nova-compute[71498]: DEBUG nova.network.neutron [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Successfully created port: 2baffc32-6ecf-4d00-b556-31dc99113a1a {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:42:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-971acb90-6a43-42ba-850c-dabdc3263634 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpngqd95ri/0e44ef8babbb4339b9f1224d6700145a.delta 1073741824" returned: 0 in 0.102s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:36 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-971acb90-6a43-42ba-850c-dabdc3263634 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 01:42:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-971acb90-6a43-42ba-850c-dabdc3263634 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Checking UEFI support for host arch (x86_64) {{(pid=71498) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1722}}
Apr 14 01:42:36 user nova-compute[71498]: INFO nova.virt.libvirt.host [None req-971acb90-6a43-42ba-850c-dabdc3263634 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] UEFI support detected
Apr 14 01:42:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.159s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:36 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2dfd39c9-8535-40d0-863d-c30fc98103e6/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 01:42:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dfd39c9-8535-40d0-863d-c30fc98103e6/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dfd39c9-8535-40d0-863d-c30fc98103e6/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:36 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Cannot resize image /opt/stack/data/nova/instances/2dfd39c9-8535-40d0-863d-c30fc98103e6/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 01:42:36 user nova-compute[71498]: DEBUG nova.objects.instance [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lazy-loading 'migration_context' on Instance uuid 2dfd39c9-8535-40d0-863d-c30fc98103e6 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:42:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 01:42:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Ensure instance console log exists: /opt/stack/data/nova/instances/2dfd39c9-8535-40d0-863d-c30fc98103e6/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:42:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-971acb90-6a43-42ba-850c-dabdc3263634 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71498) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 01:42:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:37 user nova-compute[71498]: DEBUG nova.network.neutron [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Successfully updated port: 2baffc32-6ecf-4d00-b556-31dc99113a1a {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:42:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "refresh_cache-2dfd39c9-8535-40d0-863d-c30fc98103e6" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:42:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquired lock "refresh_cache-2dfd39c9-8535-40d0-863d-c30fc98103e6" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:42:37 user nova-compute[71498]: DEBUG nova.network.neutron [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:42:37 user nova-compute[71498]: DEBUG nova.compute.manager [req-1b46f4f0-e1a8-443a-b12b-4e81cacc49a4 req-adb3f233-05c8-451f-9625-ef084d44687a service nova] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Received event network-changed-2baffc32-6ecf-4d00-b556-31dc99113a1a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:42:37 user nova-compute[71498]: DEBUG nova.compute.manager [req-1b46f4f0-e1a8-443a-b12b-4e81cacc49a4 req-adb3f233-05c8-451f-9625-ef084d44687a service nova] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Refreshing instance network info cache due to event network-changed-2baffc32-6ecf-4d00-b556-31dc99113a1a. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:42:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1b46f4f0-e1a8-443a-b12b-4e81cacc49a4 req-adb3f233-05c8-451f-9625-ef084d44687a service nova] Acquiring lock "refresh_cache-2dfd39c9-8535-40d0-863d-c30fc98103e6" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:42:37 user nova-compute[71498]: DEBUG nova.network.neutron [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:42:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-971acb90-6a43-42ba-850c-dabdc3263634 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71498) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 01:42:37 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-971acb90-6a43-42ba-850c-dabdc3263634 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 01:42:38 user nova-compute[71498]: DEBUG nova.privsep.utils [None req-971acb90-6a43-42ba-850c-dabdc3263634 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71498) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-971acb90-6a43-42ba-850c-dabdc3263634 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpngqd95ri/0e44ef8babbb4339b9f1224d6700145a.delta /opt/stack/data/nova/instances/snapshots/tmpngqd95ri/0e44ef8babbb4339b9f1224d6700145a {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG nova.network.neutron [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Updating instance_info_cache with network_info: [{"id": "2baffc32-6ecf-4d00-b556-31dc99113a1a", "address": "fa:16:3e:2b:71:ed", "network": {"id": "93155729-11d3-4eff-bbd2-8860a881e233", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047423124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "907f632263e04bf2a6c8ff1bae77a5c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2baffc32-6e", "ovs_interfaceid": "2baffc32-6ecf-4d00-b556-31dc99113a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Releasing lock "refresh_cache-2dfd39c9-8535-40d0-863d-c30fc98103e6" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG nova.compute.manager [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Instance network_info: |[{"id": "2baffc32-6ecf-4d00-b556-31dc99113a1a", "address": "fa:16:3e:2b:71:ed", "network": {"id": "93155729-11d3-4eff-bbd2-8860a881e233", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047423124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "907f632263e04bf2a6c8ff1bae77a5c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2baffc32-6e", "ovs_interfaceid": "2baffc32-6ecf-4d00-b556-31dc99113a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1b46f4f0-e1a8-443a-b12b-4e81cacc49a4 req-adb3f233-05c8-451f-9625-ef084d44687a service nova] Acquired lock "refresh_cache-2dfd39c9-8535-40d0-863d-c30fc98103e6" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG nova.network.neutron [req-1b46f4f0-e1a8-443a-b12b-4e81cacc49a4 req-adb3f233-05c8-451f-9625-ef084d44687a service nova] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Refreshing network info cache for port 2baffc32-6ecf-4d00-b556-31dc99113a1a {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Start _get_guest_xml network_info=[{"id": "2baffc32-6ecf-4d00-b556-31dc99113a1a", "address": "fa:16:3e:2b:71:ed", "network": {"id": "93155729-11d3-4eff-bbd2-8860a881e233", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047423124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "907f632263e04bf2a6c8ff1bae77a5c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2baffc32-6e", "ovs_interfaceid": "2baffc32-6ecf-4d00-b556-31dc99113a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:42:38 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:42:38 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:42:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:42:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1686309236',display_name='tempest-ServersNegativeTestJSON-server-1686309236',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1686309236',id=13,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='907f632263e04bf2a6c8ff1bae77a5c7',ramdisk_id='',reservation_id='r-bl7bmbcz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1259366012',owner_user_name='tempest-ServersNegativeTestJSON-1259366012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:42:36Z,user_data=None,user_id='236828e284154097a25f59eaedf47c29',uuid=2dfd39c9-8535-40d0-863d-c30fc98103e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2baffc32-6ecf-4d00-b556-31dc99113a1a", "address": "fa:16:3e:2b:71:ed", "network": {"id": "93155729-11d3-4eff-bbd2-8860a881e233", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047423124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "907f632263e04bf2a6c8ff1bae77a5c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2baffc32-6e", "ovs_interfaceid": "2baffc32-6ecf-4d00-b556-31dc99113a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Converting VIF {"id": "2baffc32-6ecf-4d00-b556-31dc99113a1a", "address": "fa:16:3e:2b:71:ed", "network": {"id": "93155729-11d3-4eff-bbd2-8860a881e233", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047423124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "907f632263e04bf2a6c8ff1bae77a5c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2baffc32-6e", "ovs_interfaceid": "2baffc32-6ecf-4d00-b556-31dc99113a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:71:ed,bridge_name='br-int',has_traffic_filtering=True,id=2baffc32-6ecf-4d00-b556-31dc99113a1a,network=Network(93155729-11d3-4eff-bbd2-8860a881e233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2baffc32-6e') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG nova.objects.instance [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lazy-loading 'pci_devices' on Instance uuid 2dfd39c9-8535-40d0-863d-c30fc98103e6 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:42:38 user nova-compute[71498]:   <uuid>2dfd39c9-8535-40d0-863d-c30fc98103e6</uuid>
Apr 14 01:42:38 user nova-compute[71498]:   <name>instance-0000000d</name>
Apr 14 01:42:38 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:42:38 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:42:38 user nova-compute[71498]:   <metadata>
Apr 14 01:42:38 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:42:38 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:42:38 user nova-compute[71498]:       <nova:name>tempest-ServersNegativeTestJSON-server-1686309236</nova:name>
Apr 14 01:42:38 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:42:38</nova:creationTime>
Apr 14 01:42:38 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:42:38 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:42:38 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:42:38 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:42:38 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:42:38 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:42:38 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:42:38 user nova-compute[71498]:       <nova:owner>
Apr 14 01:42:38 user nova-compute[71498]:         <nova:user uuid="236828e284154097a25f59eaedf47c29">tempest-ServersNegativeTestJSON-1259366012-project-member</nova:user>
Apr 14 01:42:38 user nova-compute[71498]:         <nova:project uuid="907f632263e04bf2a6c8ff1bae77a5c7">tempest-ServersNegativeTestJSON-1259366012</nova:project>
Apr 14 01:42:38 user nova-compute[71498]:       </nova:owner>
Apr 14 01:42:38 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:42:38 user nova-compute[71498]:       <nova:ports>
Apr 14 01:42:38 user nova-compute[71498]:         <nova:port uuid="2baffc32-6ecf-4d00-b556-31dc99113a1a">
Apr 14 01:42:38 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 01:42:38 user nova-compute[71498]:         </nova:port>
Apr 14 01:42:38 user nova-compute[71498]:       </nova:ports>
Apr 14 01:42:38 user nova-compute[71498]:     </nova:instance>
Apr 14 01:42:38 user nova-compute[71498]:   </metadata>
Apr 14 01:42:38 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:42:38 user nova-compute[71498]:     <system>
Apr 14 01:42:38 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:42:38 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:42:38 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:42:38 user nova-compute[71498]:       <entry name="serial">2dfd39c9-8535-40d0-863d-c30fc98103e6</entry>
Apr 14 01:42:38 user nova-compute[71498]:       <entry name="uuid">2dfd39c9-8535-40d0-863d-c30fc98103e6</entry>
Apr 14 01:42:38 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:42:38 user nova-compute[71498]:     </system>
Apr 14 01:42:38 user nova-compute[71498]:   </sysinfo>
Apr 14 01:42:38 user nova-compute[71498]:   <os>
Apr 14 01:42:38 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:42:38 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:42:38 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:42:38 user nova-compute[71498]:   </os>
Apr 14 01:42:38 user nova-compute[71498]:   <features>
Apr 14 01:42:38 user nova-compute[71498]:     <acpi/>
Apr 14 01:42:38 user nova-compute[71498]:     <apic/>
Apr 14 01:42:38 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:42:38 user nova-compute[71498]:   </features>
Apr 14 01:42:38 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:42:38 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:42:38 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:42:38 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:42:38 user nova-compute[71498]:   </clock>
Apr 14 01:42:38 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:42:38 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:42:38 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:42:38 user nova-compute[71498]:   </cpu>
Apr 14 01:42:38 user nova-compute[71498]:   <devices>
Apr 14 01:42:38 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:42:38 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:42:38 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/2dfd39c9-8535-40d0-863d-c30fc98103e6/disk"/>
Apr 14 01:42:38 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:42:38 user nova-compute[71498]:     </disk>
Apr 14 01:42:38 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:42:38 user nova-compute[71498]:       <mac address="fa:16:3e:2b:71:ed"/>
Apr 14 01:42:38 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:42:38 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:42:38 user nova-compute[71498]:       <target dev="tap2baffc32-6e"/>
Apr 14 01:42:38 user nova-compute[71498]:     </interface>
Apr 14 01:42:38 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:42:38 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/2dfd39c9-8535-40d0-863d-c30fc98103e6/console.log" append="off"/>
Apr 14 01:42:38 user nova-compute[71498]:     </serial>
Apr 14 01:42:38 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:42:38 user nova-compute[71498]:     <video>
Apr 14 01:42:38 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:42:38 user nova-compute[71498]:     </video>
Apr 14 01:42:38 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:42:38 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:42:38 user nova-compute[71498]:     </rng>
Apr 14 01:42:38 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:42:38 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:42:38 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:42:38 user nova-compute[71498]:     </memballoon>
Apr 14 01:42:38 user nova-compute[71498]:   </devices>
Apr 14 01:42:38 user nova-compute[71498]: </domain>
Apr 14 01:42:38 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:42:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1686309236',display_name='tempest-ServersNegativeTestJSON-server-1686309236',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1686309236',id=13,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='907f632263e04bf2a6c8ff1bae77a5c7',ramdisk_id='',reservation_id='r-bl7bmbcz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1259366012',owner_user_name='tempest-ServersNegativeTestJSON-1259366012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:42:36Z,user_data=None,user_id='236828e284154097a25f59eaedf47c29',uuid=2dfd39c9-8535-40d0-863d-c30fc98103e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2baffc32-6ecf-4d00-b556-31dc99113a1a", "address": "fa:16:3e:2b:71:ed", "network": {"id": "93155729-11d3-4eff-bbd2-8860a881e233", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047423124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "907f632263e04bf2a6c8ff1bae77a5c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2baffc32-6e", "ovs_interfaceid": "2baffc32-6ecf-4d00-b556-31dc99113a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Converting VIF {"id": "2baffc32-6ecf-4d00-b556-31dc99113a1a", "address": "fa:16:3e:2b:71:ed", "network": {"id": "93155729-11d3-4eff-bbd2-8860a881e233", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047423124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "907f632263e04bf2a6c8ff1bae77a5c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2baffc32-6e", "ovs_interfaceid": "2baffc32-6ecf-4d00-b556-31dc99113a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:71:ed,bridge_name='br-int',has_traffic_filtering=True,id=2baffc32-6ecf-4d00-b556-31dc99113a1a,network=Network(93155729-11d3-4eff-bbd2-8860a881e233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2baffc32-6e') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG os_vif [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:71:ed,bridge_name='br-int',has_traffic_filtering=True,id=2baffc32-6ecf-4d00-b556-31dc99113a1a,network=Network(93155729-11d3-4eff-bbd2-8860a881e233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2baffc32-6e') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2baffc32-6e, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2baffc32-6e, col_values=(('external_ids', {'iface-id': '2baffc32-6ecf-4d00-b556-31dc99113a1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:71:ed', 'vm-uuid': '2dfd39c9-8535-40d0-863d-c30fc98103e6'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-971acb90-6a43-42ba-850c-dabdc3263634 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpngqd95ri/0e44ef8babbb4339b9f1224d6700145a.delta /opt/stack/data/nova/instances/snapshots/tmpngqd95ri/0e44ef8babbb4339b9f1224d6700145a" returned: 0 in 0.298s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:38 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-971acb90-6a43-42ba-850c-dabdc3263634 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Snapshot extracted, beginning image upload
Apr 14 01:42:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:38 user nova-compute[71498]: INFO os_vif [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:71:ed,bridge_name='br-int',has_traffic_filtering=True,id=2baffc32-6ecf-4d00-b556-31dc99113a1a,network=Network(93155729-11d3-4eff-bbd2-8860a881e233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2baffc32-6e')
Apr 14 01:42:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] No VIF found with MAC fa:16:3e:2b:71:ed, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG nova.network.neutron [req-1b46f4f0-e1a8-443a-b12b-4e81cacc49a4 req-adb3f233-05c8-451f-9625-ef084d44687a service nova] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Updated VIF entry in instance network info cache for port 2baffc32-6ecf-4d00-b556-31dc99113a1a. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG nova.network.neutron [req-1b46f4f0-e1a8-443a-b12b-4e81cacc49a4 req-adb3f233-05c8-451f-9625-ef084d44687a service nova] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Updating instance_info_cache with network_info: [{"id": "2baffc32-6ecf-4d00-b556-31dc99113a1a", "address": "fa:16:3e:2b:71:ed", "network": {"id": "93155729-11d3-4eff-bbd2-8860a881e233", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047423124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "907f632263e04bf2a6c8ff1bae77a5c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2baffc32-6e", "ovs_interfaceid": "2baffc32-6ecf-4d00-b556-31dc99113a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:42:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1b46f4f0-e1a8-443a-b12b-4e81cacc49a4 req-adb3f233-05c8-451f-9625-ef084d44687a service nova] Releasing lock "refresh_cache-2dfd39c9-8535-40d0-863d-c30fc98103e6" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:42:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Acquiring lock "039d0702-d115-4c25-ab88-d669c6320820" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "039d0702-d115-4c25-ab88-d669c6320820" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:39 user nova-compute[71498]: DEBUG nova.objects.instance [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lazy-loading 'flavor' on Instance uuid 039d0702-d115-4c25-ab88-d669c6320820 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:42:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "039d0702-d115-4c25-ab88-d669c6320820" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Acquiring lock "039d0702-d115-4c25-ab88-d669c6320820" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "039d0702-d115-4c25-ab88-d669c6320820" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:39 user nova-compute[71498]: INFO nova.compute.manager [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Attaching volume 91568232-871f-4584-be95-10c420297fe0 to /dev/vdb
Apr 14 01:42:39 user nova-compute[71498]: DEBUG os_brick.utils [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:42:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8556badd-c39b-4cb5-a97c-938d9fe840e3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.087s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[09aa1e5a-227f-48c8-aa9e-1ba2db0fb16c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a43b73d-5934-4f30-83ca-279dfd849f30]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b830344-d014-416b-b26f-b5ff4ab3f141]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:42:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:42:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:42:39 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:42:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcc7679-e591-4eb9-94f3-798723b64d91]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:42:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:42:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:42:39 user nova-compute[71498]: DEBUG os_brick.utils [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] <== get_connector_properties: return (223ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:42:39 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Updating existing volume attachment record: c57408e2-41e5-44de-bfed-3b05c5d447ef {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:42:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-46dd76bf-e034-4275-96e6-1d2ba563e444 req-05573bc0-f193-406e-baaa-6e7def27bfa4 service nova] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Received event network-vif-plugged-2baffc32-6ecf-4d00-b556-31dc99113a1a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:42:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-46dd76bf-e034-4275-96e6-1d2ba563e444 req-05573bc0-f193-406e-baaa-6e7def27bfa4 service nova] Acquiring lock "2dfd39c9-8535-40d0-863d-c30fc98103e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-46dd76bf-e034-4275-96e6-1d2ba563e444 req-05573bc0-f193-406e-baaa-6e7def27bfa4 service nova] Lock "2dfd39c9-8535-40d0-863d-c30fc98103e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-46dd76bf-e034-4275-96e6-1d2ba563e444 req-05573bc0-f193-406e-baaa-6e7def27bfa4 service nova] Lock "2dfd39c9-8535-40d0-863d-c30fc98103e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-46dd76bf-e034-4275-96e6-1d2ba563e444 req-05573bc0-f193-406e-baaa-6e7def27bfa4 service nova] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] No waiting events found dispatching network-vif-plugged-2baffc32-6ecf-4d00-b556-31dc99113a1a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:42:40 user nova-compute[71498]: WARNING nova.compute.manager [req-46dd76bf-e034-4275-96e6-1d2ba563e444 req-05573bc0-f193-406e-baaa-6e7def27bfa4 service nova] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Received unexpected event network-vif-plugged-2baffc32-6ecf-4d00-b556-31dc99113a1a for instance with vm_state building and task_state spawning.
Apr 14 01:42:41 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-971acb90-6a43-42ba-850c-dabdc3263634 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Snapshot image upload complete
Apr 14 01:42:41 user nova-compute[71498]: INFO nova.compute.manager [None req-971acb90-6a43-42ba-850c-dabdc3263634 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Took 6.00 seconds to snapshot the instance on the hypervisor.
Apr 14 01:42:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-01efdaca-2368-43f4-95d7-a09e02b1edca req-f60b7cf1-73af-45d8-af02-9db398b9e92b service nova] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Received event network-vif-plugged-2baffc32-6ecf-4d00-b556-31dc99113a1a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:42:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-01efdaca-2368-43f4-95d7-a09e02b1edca req-f60b7cf1-73af-45d8-af02-9db398b9e92b service nova] Acquiring lock "2dfd39c9-8535-40d0-863d-c30fc98103e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-01efdaca-2368-43f4-95d7-a09e02b1edca req-f60b7cf1-73af-45d8-af02-9db398b9e92b service nova] Lock "2dfd39c9-8535-40d0-863d-c30fc98103e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-01efdaca-2368-43f4-95d7-a09e02b1edca req-f60b7cf1-73af-45d8-af02-9db398b9e92b service nova] Lock "2dfd39c9-8535-40d0-863d-c30fc98103e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-01efdaca-2368-43f4-95d7-a09e02b1edca req-f60b7cf1-73af-45d8-af02-9db398b9e92b service nova] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] No waiting events found dispatching network-vif-plugged-2baffc32-6ecf-4d00-b556-31dc99113a1a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:42:42 user nova-compute[71498]: WARNING nova.compute.manager [req-01efdaca-2368-43f4-95d7-a09e02b1edca req-f60b7cf1-73af-45d8-af02-9db398b9e92b service nova] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Received unexpected event network-vif-plugged-2baffc32-6ecf-4d00-b556-31dc99113a1a for instance with vm_state building and task_state spawning.
Apr 14 01:42:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-531fb349-1bea-474a-902d-b361ddfaf4b7 req-7fc9ab18-3e9b-4301-81b0-3e96cc8b35a1 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Received event network-changed-7942720d-0958-4826-bedf-0a7eebfe45b6 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:42:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-531fb349-1bea-474a-902d-b361ddfaf4b7 req-7fc9ab18-3e9b-4301-81b0-3e96cc8b35a1 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Refreshing instance network info cache due to event network-changed-7942720d-0958-4826-bedf-0a7eebfe45b6. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:42:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-531fb349-1bea-474a-902d-b361ddfaf4b7 req-7fc9ab18-3e9b-4301-81b0-3e96cc8b35a1 service nova] Acquiring lock "refresh_cache-3a3fb53f-7b4a-48d3-85ab-418bad435c07" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:42:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-531fb349-1bea-474a-902d-b361ddfaf4b7 req-7fc9ab18-3e9b-4301-81b0-3e96cc8b35a1 service nova] Acquired lock "refresh_cache-3a3fb53f-7b4a-48d3-85ab-418bad435c07" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:42:42 user nova-compute[71498]: DEBUG nova.network.neutron [req-531fb349-1bea-474a-902d-b361ddfaf4b7 req-7fc9ab18-3e9b-4301-81b0-3e96cc8b35a1 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Refreshing network info cache for port 7942720d-0958-4826-bedf-0a7eebfe45b6 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:42:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:42:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:42:42 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436562.6224463, 2dfd39c9-8535-40d0-863d-c30fc98103e6 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:42:42 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] VM Resumed (Lifecycle Event)
Apr 14 01:42:42 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Instance spawned successfully.
Apr 14 01:42:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:42:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:42:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:42:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:42:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:42:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:42:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:42:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:42:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:42:42 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:42:42 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436562.6231506, 2dfd39c9-8535-40d0-863d-c30fc98103e6 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:42:42 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] VM Started (Lifecycle Event)
Apr 14 01:42:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:42:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:42:42 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:42:42 user nova-compute[71498]: INFO nova.compute.manager [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Took 6.90 seconds to spawn the instance on the hypervisor.
Apr 14 01:42:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:42:42 user nova-compute[71498]: INFO nova.compute.manager [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Took 7.94 seconds to build instance.
Apr 14 01:42:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3e494492-1761-4289-8769-875ed49cdac2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "2dfd39c9-8535-40d0-863d-c30fc98103e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.078s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:43 user nova-compute[71498]: DEBUG nova.network.neutron [req-531fb349-1bea-474a-902d-b361ddfaf4b7 req-7fc9ab18-3e9b-4301-81b0-3e96cc8b35a1 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Updated VIF entry in instance network info cache for port 7942720d-0958-4826-bedf-0a7eebfe45b6. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:42:43 user nova-compute[71498]: DEBUG nova.network.neutron [req-531fb349-1bea-474a-902d-b361ddfaf4b7 req-7fc9ab18-3e9b-4301-81b0-3e96cc8b35a1 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Updating instance_info_cache with network_info: [{"id": "7942720d-0958-4826-bedf-0a7eebfe45b6", "address": "fa:16:3e:0c:0e:df", "network": {"id": "95555a4e-9d95-4509-a683-f61ea2dc38a1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-560359898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4833ddea1fa74866b97ef52a730605aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7942720d-09", "ovs_interfaceid": "7942720d-0958-4826-bedf-0a7eebfe45b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:42:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-531fb349-1bea-474a-902d-b361ddfaf4b7 req-7fc9ab18-3e9b-4301-81b0-3e96cc8b35a1 service nova] Releasing lock "refresh_cache-3a3fb53f-7b4a-48d3-85ab-418bad435c07" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:42:43 user nova-compute[71498]: DEBUG nova.compute.manager [None req-6c3362b7-dcec-487a-b4ff-3a207ad70547 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:42:43 user nova-compute[71498]: INFO nova.compute.manager [None req-6c3362b7-dcec-487a-b4ff-3a207ad70547 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] instance snapshotting
Apr 14 01:42:43 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-6c3362b7-dcec-487a-b4ff-3a207ad70547 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Beginning live snapshot process
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-6c3362b7-dcec-487a-b4ff-3a207ad70547 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk --force-share --output=json -f qcow2 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-6c3362b7-dcec-487a-b4ff-3a207ad70547 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk --force-share --output=json -f qcow2" returned: 0 in 0.136s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-6c3362b7-dcec-487a-b4ff-3a207ad70547 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk --force-share --output=json -f qcow2 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-6c3362b7-dcec-487a-b4ff-3a207ad70547 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk --force-share --output=json -f qcow2" returned: 0 in 0.132s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-6c3362b7-dcec-487a-b4ff-3a207ad70547 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-6c3362b7-dcec-487a-b4ff-3a207ad70547 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.149s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-6c3362b7-dcec-487a-b4ff-3a207ad70547 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbofg3l1p/6d5ad4af050b40ceb71c6da28006828d.delta 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-6c3362b7-dcec-487a-b4ff-3a207ad70547 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbofg3l1p/6d5ad4af050b40ceb71c6da28006828d.delta 1073741824" returned: 0 in 0.051s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:44 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-6c3362b7-dcec-487a-b4ff-3a207ad70547 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 01:42:44 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QXIsxKJu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:42:44 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:42:44 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:42:44 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:42:44 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:42:44 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e541d53-9f74-4c63-bf28-6217d09cd886]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:42:44 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbf996d-55ac-4937-bb33-ef73dd3ef0e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0] added
Apr 14 01:42:44 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bd3b84-7f28-4ded-bd52-36372816d1a4]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b1ff27-be6e-4c38-9957-e1ab03c58af0]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QXIsxKJu {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QXIsxKJu" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4a2ae1-d35f-4a7a-a4ca-69292b6980d2]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QXIsxKJu'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b997ed-8724-4cc7-9db5-cc562e855d90]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b6874e-ed93-4786-aebf-2d196f54b88a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:42:44 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:42:44 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:42:44 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:42:44 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:42:44 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:42:44 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:42:44 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:42:44 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea77180-ddec-4570-a8d1-1d2a5ee7767b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0, portal: 172.16.0.220,3260]
Apr 14 01:42:44 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0, portal: 172.16.0.220,3260] successful.
Apr 14 01:42:44 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8780895-091b-4787-b4c8-778cd196218c]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[123eac34-f381-415b-8d8c-de2667069a73]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:42:44 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:42:44 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:42:44 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:42:44 user nova-compute[71498]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 (non-flash)
Apr 14 01:42:44 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:42:44 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:42:44 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:42:44 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:42:44 user nova-compute[71498]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 (non-flash)
Apr 14 01:42:44 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.028s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cec2ba-189e-4454-9b40-a1e8c9556d7a]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:42:44 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QXIsxKJu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:42:45 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-6c3362b7-dcec-487a-b4ff-3a207ad70547 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71498) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 01:42:45 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-6c3362b7-dcec-487a-b4ff-3a207ad70547 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71498) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 01:42:45 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-6c3362b7-dcec-487a-b4ff-3a207ad70547 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 01:42:45 user nova-compute[71498]: DEBUG nova.privsep.utils [None req-6c3362b7-dcec-487a-b4ff-3a207ad70547 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71498) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 01:42:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-6c3362b7-dcec-487a-b4ff-3a207ad70547 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbofg3l1p/6d5ad4af050b40ceb71c6da28006828d.delta /opt/stack/data/nova/instances/snapshots/tmpbofg3l1p/6d5ad4af050b40ceb71c6da28006828d {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:42:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '26131636538306666', 'path': '/dev/sdf'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:42:46 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131636538306666', 'path': '/dev/sdf'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:42:46 user nova-compute[71498]: DEBUG nova.objects.instance [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lazy-loading 'flavor' on Instance uuid 039d0702-d115-4c25-ab88-d669c6320820 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:42:46 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 01:42:46 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:42:46 user nova-compute[71498]:   <source dev="/dev/sdf"/>
Apr 14 01:42:46 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:42:46 user nova-compute[71498]:   <serial>91568232-871f-4584-be95-10c420297fe0</serial>
Apr 14 01:42:46 user nova-compute[71498]: </disk>
Apr 14 01:42:46 user nova-compute[71498]:  {{(pid=71498) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 01:42:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-6c3362b7-dcec-487a-b4ff-3a207ad70547 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbofg3l1p/6d5ad4af050b40ceb71c6da28006828d.delta /opt/stack/data/nova/instances/snapshots/tmpbofg3l1p/6d5ad4af050b40ceb71c6da28006828d" returned: 0 in 0.245s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:46 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-6c3362b7-dcec-487a-b4ff-3a207ad70547 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Snapshot extracted, beginning image upload
Apr 14 01:42:46 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:42:46 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:42:46 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] No VIF found with MAC fa:16:3e:84:ba:f4, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:42:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-63cefeba-b52d-455b-b02e-d47665c00e52 tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "039d0702-d115-4c25-ab88-d669c6320820" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.112s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Acquiring lock "039d0702-d115-4c25-ab88-d669c6320820" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "039d0702-d115-4c25-ab88-d669c6320820" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Acquiring lock "039d0702-d115-4c25-ab88-d669c6320820-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "039d0702-d115-4c25-ab88-d669c6320820-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "039d0702-d115-4c25-ab88-d669c6320820-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:47 user nova-compute[71498]: INFO nova.compute.manager [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Terminating instance
Apr 14 01:42:47 user nova-compute[71498]: DEBUG nova.compute.manager [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 01:42:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG nova.compute.manager [req-feb44056-8792-4fde-a5f7-896c15e79143 req-2780f474-1986-4dda-91eb-5dc9fcdfaa1f service nova] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Received event network-vif-unplugged-5b6ccf71-1fe5-4324-a31c-f530be337523 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-feb44056-8792-4fde-a5f7-896c15e79143 req-2780f474-1986-4dda-91eb-5dc9fcdfaa1f service nova] Acquiring lock "039d0702-d115-4c25-ab88-d669c6320820-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-feb44056-8792-4fde-a5f7-896c15e79143 req-2780f474-1986-4dda-91eb-5dc9fcdfaa1f service nova] Lock "039d0702-d115-4c25-ab88-d669c6320820-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-feb44056-8792-4fde-a5f7-896c15e79143 req-2780f474-1986-4dda-91eb-5dc9fcdfaa1f service nova] Lock "039d0702-d115-4c25-ab88-d669c6320820-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG nova.compute.manager [req-feb44056-8792-4fde-a5f7-896c15e79143 req-2780f474-1986-4dda-91eb-5dc9fcdfaa1f service nova] [instance: 039d0702-d115-4c25-ab88-d669c6320820] No waiting events found dispatching network-vif-unplugged-5b6ccf71-1fe5-4324-a31c-f530be337523 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG nova.compute.manager [req-feb44056-8792-4fde-a5f7-896c15e79143 req-2780f474-1986-4dda-91eb-5dc9fcdfaa1f service nova] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Received event network-vif-unplugged-5b6ccf71-1fe5-4324-a31c-f530be337523 for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:48 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-6c3362b7-dcec-487a-b4ff-3a207ad70547 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Snapshot image upload complete
Apr 14 01:42:48 user nova-compute[71498]: INFO nova.compute.manager [None req-6c3362b7-dcec-487a-b4ff-3a207ad70547 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Took 4.62 seconds to snapshot the instance on the hypervisor.
Apr 14 01:42:48 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Instance destroyed successfully.
Apr 14 01:42:48 user nova-compute[71498]: DEBUG nova.objects.instance [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lazy-loading 'resources' on Instance uuid 039d0702-d115-4c25-ab88-d669c6320820 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:40:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1756590565',display_name='tempest-DeleteServersTestJSON-server-1756590565',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1756590565',id=3,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:41:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50fbd5c190254145815a39079b57881c',ramdisk_id='',reservation_id='r-0q5kkt30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1374716489',owner_user_name='tempest-DeleteServersTestJSON-1374716489-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:41:05Z,user_data=None,user_id='2fae797718f548fba18e7bc01829f489',uuid=039d0702-d115-4c25-ab88-d669c6320820,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b6ccf71-1fe5-4324-a31c-f530be337523", "address": "fa:16:3e:84:ba:f4", "network": {"id": "fc6463bc-9492-414e-930d-3c5dc5ae31a0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-58429192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50fbd5c190254145815a39079b57881c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b6ccf71-1f", "ovs_interfaceid": "5b6ccf71-1fe5-4324-a31c-f530be337523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Converting VIF {"id": "5b6ccf71-1fe5-4324-a31c-f530be337523", "address": "fa:16:3e:84:ba:f4", "network": {"id": "fc6463bc-9492-414e-930d-3c5dc5ae31a0", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-58429192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50fbd5c190254145815a39079b57881c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b6ccf71-1f", "ovs_interfaceid": "5b6ccf71-1fe5-4324-a31c-f530be337523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:ba:f4,bridge_name='br-int',has_traffic_filtering=True,id=5b6ccf71-1fe5-4324-a31c-f530be337523,network=Network(fc6463bc-9492-414e-930d-3c5dc5ae31a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b6ccf71-1f') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG os_vif [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:ba:f4,bridge_name='br-int',has_traffic_filtering=True,id=5b6ccf71-1fe5-4324-a31c-f530be337523,network=Network(fc6463bc-9492-414e-930d-3c5dc5ae31a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b6ccf71-1f') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b6ccf71-1f, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:42:48 user nova-compute[71498]: INFO os_vif [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:ba:f4,bridge_name='br-int',has_traffic_filtering=True,id=5b6ccf71-1fe5-4324-a31c-f530be337523,network=Network(fc6463bc-9492-414e-930d-3c5dc5ae31a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b6ccf71-1f')
Apr 14 01:42:48 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QXIsxKJu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:42:48 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:42:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[feef0045-53c7-4da3-a787-ae7b06cbbcca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:42:48 user nova-compute[71498]: No targets found.
Apr 14 01:42:48 user nova-compute[71498]: iSNS:
Apr 14 01:42:48 user nova-compute[71498]: No targets found.
Apr 14 01:42:48 user nova-compute[71498]: STATIC:
Apr 14 01:42:48 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02
Apr 14 01:42:48 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:42:48 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:42:48 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53
Apr 14 01:42:48 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:42:48 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:42:48 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0
Apr 14 01:42:48 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:42:48 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:42:48 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e
Apr 14 01:42:48 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:42:48 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:42:48 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d
Apr 14 01:42:48 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:42:48 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:42:48 user nova-compute[71498]: FIRMWARE:
Apr 14 01:42:48 user nova-compute[71498]: No targets found.
Apr 14 01:42:48 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:42:48 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:42:48 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[64624534-3979-470c-887b-a7b19da1e78a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[090afc22-e447-485f-8c17-5b4cf845173b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:42:48 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:42:48 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:42:48 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:42:48 user nova-compute[71498]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 (non-flash)
Apr 14 01:42:48 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:42:48 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:42:48 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:42:48 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:42:48 user nova-compute[71498]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 (non-flash)
Apr 14 01:42:48 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52014edf30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0'): ({'sdf'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Removing single pathed devices sdf {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d8b3d8-a8a3-4d8f-a26f-f20ac9e5fb9d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[81aef050-6039-4d47-8bed-b1e7c9049dcd]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Flushing IO for device /dev/sdf {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc418a0-ed03-463b-ad64-8df7662e8fac]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c6960b-2adf-41e3-b91c-fced7f575c02]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] SCSI volumes sdf have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5015f0-1613-48b4-a3ed-fa35ba1a80fb]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5610e6e9-e598-4731-bac4-1884d3303127]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0, portal: 172.16.0.220,3260]
Apr 14 01:42:48 user nova-compute[71498]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0, portal: 172.16.0.220,3260] successful.
Apr 14 01:42:48 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91568232-871f-4584-be95-10c420297fe0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b6b505-fcc8-42e3-8e7f-3137ab5aae25]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] <== disconnect_volume: return (303ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:42:48 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:42:48 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Deleting instance files /opt/stack/data/nova/instances/039d0702-d115-4c25-ab88-d669c6320820_del
Apr 14 01:42:48 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Deletion of /opt/stack/data/nova/instances/039d0702-d115-4c25-ab88-d669c6320820_del complete
Apr 14 01:42:49 user nova-compute[71498]: INFO nova.compute.manager [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Took 1.20 seconds to destroy the instance on the hypervisor.
Apr 14 01:42:49 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 01:42:49 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 01:42:49 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 039d0702-d115-4c25-ab88-d669c6320820] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 01:42:49 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:42:49 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Took 0.54 seconds to deallocate network for instance.
Apr 14 01:42:49 user nova-compute[71498]: DEBUG nova.compute.manager [req-fd9405f6-e737-47e2-86df-5c9ab7fc15ba req-f5556ec9-5203-4bc6-b314-c49a6f6a54f2 service nova] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Received event network-vif-deleted-5b6ccf71-1fe5-4324-a31c-f530be337523 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:42:50 user nova-compute[71498]: DEBUG nova.compute.manager [req-d01cb49b-325c-4ad7-bb78-6da562bfaeb1 req-36a38e38-5a31-4894-a3f8-1ca590662e6c service nova] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Received event network-vif-plugged-5b6ccf71-1fe5-4324-a31c-f530be337523 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:42:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d01cb49b-325c-4ad7-bb78-6da562bfaeb1 req-36a38e38-5a31-4894-a3f8-1ca590662e6c service nova] Acquiring lock "039d0702-d115-4c25-ab88-d669c6320820-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d01cb49b-325c-4ad7-bb78-6da562bfaeb1 req-36a38e38-5a31-4894-a3f8-1ca590662e6c service nova] Lock "039d0702-d115-4c25-ab88-d669c6320820-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d01cb49b-325c-4ad7-bb78-6da562bfaeb1 req-36a38e38-5a31-4894-a3f8-1ca590662e6c service nova] Lock "039d0702-d115-4c25-ab88-d669c6320820-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:50 user nova-compute[71498]: DEBUG nova.compute.manager [req-d01cb49b-325c-4ad7-bb78-6da562bfaeb1 req-36a38e38-5a31-4894-a3f8-1ca590662e6c service nova] [instance: 039d0702-d115-4c25-ab88-d669c6320820] No waiting events found dispatching network-vif-plugged-5b6ccf71-1fe5-4324-a31c-f530be337523 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:42:50 user nova-compute[71498]: WARNING nova.compute.manager [req-d01cb49b-325c-4ad7-bb78-6da562bfaeb1 req-36a38e38-5a31-4894-a3f8-1ca590662e6c service nova] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Received unexpected event network-vif-plugged-5b6ccf71-1fe5-4324-a31c-f530be337523 for instance with vm_state active and task_state deleting.
Apr 14 01:42:50 user nova-compute[71498]: INFO nova.compute.manager [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Took 0.80 seconds to detach 1 volumes for instance.
Apr 14 01:42:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:50 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:42:50 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:42:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:50 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Deleted allocations for instance 039d0702-d115-4c25-ab88-d669c6320820
Apr 14 01:42:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-23a6e185-509a-4dcc-98b3-ef485ed1a00c tempest-DeleteServersTestJSON-1374716489 tempest-DeleteServersTestJSON-1374716489-project-member] Lock "039d0702-d115-4c25-ab88-d669c6320820" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.126s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:55 user nova-compute[71498]: DEBUG nova.compute.manager [req-138b0ec5-69a7-48ac-95b9-995587624ac3 req-8eb03bcf-ac0b-4213-8c8c-c6da5ee805ef service nova] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Received event network-changed-08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:42:55 user nova-compute[71498]: DEBUG nova.compute.manager [req-138b0ec5-69a7-48ac-95b9-995587624ac3 req-8eb03bcf-ac0b-4213-8c8c-c6da5ee805ef service nova] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Refreshing instance network info cache due to event network-changed-08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:42:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-138b0ec5-69a7-48ac-95b9-995587624ac3 req-8eb03bcf-ac0b-4213-8c8c-c6da5ee805ef service nova] Acquiring lock "refresh_cache-f68784e7-578c-4a12-87d4-f35fbc5a1d59" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:42:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-138b0ec5-69a7-48ac-95b9-995587624ac3 req-8eb03bcf-ac0b-4213-8c8c-c6da5ee805ef service nova] Acquired lock "refresh_cache-f68784e7-578c-4a12-87d4-f35fbc5a1d59" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:42:55 user nova-compute[71498]: DEBUG nova.network.neutron [req-138b0ec5-69a7-48ac-95b9-995587624ac3 req-8eb03bcf-ac0b-4213-8c8c-c6da5ee805ef service nova] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Refreshing network info cache for port 08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:42:55 user nova-compute[71498]: DEBUG nova.network.neutron [req-138b0ec5-69a7-48ac-95b9-995587624ac3 req-8eb03bcf-ac0b-4213-8c8c-c6da5ee805ef service nova] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Updated VIF entry in instance network info cache for port 08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:42:55 user nova-compute[71498]: DEBUG nova.network.neutron [req-138b0ec5-69a7-48ac-95b9-995587624ac3 req-8eb03bcf-ac0b-4213-8c8c-c6da5ee805ef service nova] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Updating instance_info_cache with network_info: [{"id": "08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd", "address": "fa:16:3e:f5:7f:82", "network": {"id": "6569db42-40ba-4426-a76b-b3e64ecae5b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1148770119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a409270d6d4d408de33c5e71a56da9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c0ebf7-58", "ovs_interfaceid": "08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:42:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-138b0ec5-69a7-48ac-95b9-995587624ac3 req-8eb03bcf-ac0b-4213-8c8c-c6da5ee805ef service nova] Releasing lock "refresh_cache-f68784e7-578c-4a12-87d4-f35fbc5a1d59" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:42:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "f68784e7-578c-4a12-87d4-f35fbc5a1d59" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "f68784e7-578c-4a12-87d4-f35fbc5a1d59" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:56 user nova-compute[71498]: DEBUG nova.objects.instance [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lazy-loading 'flavor' on Instance uuid f68784e7-578c-4a12-87d4-f35fbc5a1d59 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:42:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "f68784e7-578c-4a12-87d4-f35fbc5a1d59" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:42:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "f68784e7-578c-4a12-87d4-f35fbc5a1d59" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:42:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "f68784e7-578c-4a12-87d4-f35fbc5a1d59" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:42:56 user nova-compute[71498]: INFO nova.compute.manager [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Attaching volume e51f02c1-71b8-4c63-9bae-d2210e2363dc to /dev/vdb
Apr 14 01:42:56 user nova-compute[71498]: DEBUG os_brick.utils [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:42:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:56 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6256e087-c84f-4677-9c11-04719a689f2c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:56 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e99b16c-1618-47e5-bd89-04771b014572]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:42:56 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b78b59a-0f2b-4bfc-bb0c-8abbd7d64881]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:56 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb44b6d-bf00-4baa-a1ca-a497992cbfd9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:42:57 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:42:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:42:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:42:57 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:42:57 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e845e2bd-cdae-4681-982e-49de3154f6f7]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:42:57 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:42:57 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:42:57 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:42:57 user nova-compute[71498]: DEBUG os_brick.utils [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:42:57 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Updating existing volume attachment record: 6ff41919-53cf-46b4-b3cb-f8e36cb38f7a {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:42:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:42:58 user nova-compute[71498]: DEBUG nova.compute.manager [req-041e0a0d-af5d-4b3d-a3f1-abbefc93f6fa req-b63ab185-f016-49c1-b9a3-965681f4f359 service nova] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Received event network-changed-ed3a6f44-e7a4-41b0-9769-71beee125cb1 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:42:58 user nova-compute[71498]: DEBUG nova.compute.manager [req-041e0a0d-af5d-4b3d-a3f1-abbefc93f6fa req-b63ab185-f016-49c1-b9a3-965681f4f359 service nova] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Refreshing instance network info cache due to event network-changed-ed3a6f44-e7a4-41b0-9769-71beee125cb1. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:42:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-041e0a0d-af5d-4b3d-a3f1-abbefc93f6fa req-b63ab185-f016-49c1-b9a3-965681f4f359 service nova] Acquiring lock "refresh_cache-f1d10278-cf24-4fde-86eb-664ba86cbd8f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:42:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-041e0a0d-af5d-4b3d-a3f1-abbefc93f6fa req-b63ab185-f016-49c1-b9a3-965681f4f359 service nova] Acquired lock "refresh_cache-f1d10278-cf24-4fde-86eb-664ba86cbd8f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:42:58 user nova-compute[71498]: DEBUG nova.network.neutron [req-041e0a0d-af5d-4b3d-a3f1-abbefc93f6fa req-b63ab185-f016-49c1-b9a3-965681f4f359 service nova] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Refreshing network info cache for port ed3a6f44-e7a4-41b0-9769-71beee125cb1 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:42:59 user nova-compute[71498]: DEBUG nova.network.neutron [req-041e0a0d-af5d-4b3d-a3f1-abbefc93f6fa req-b63ab185-f016-49c1-b9a3-965681f4f359 service nova] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Updated VIF entry in instance network info cache for port ed3a6f44-e7a4-41b0-9769-71beee125cb1. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:42:59 user nova-compute[71498]: DEBUG nova.network.neutron [req-041e0a0d-af5d-4b3d-a3f1-abbefc93f6fa req-b63ab185-f016-49c1-b9a3-965681f4f359 service nova] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Updating instance_info_cache with network_info: [{"id": "ed3a6f44-e7a4-41b0-9769-71beee125cb1", "address": "fa:16:3e:88:7b:f9", "network": {"id": "e70b6880-528f-41d8-b154-89eabc02efdb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1224931198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d9a3bf2a3b4480a990adc9821005f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped3a6f44-e7", "ovs_interfaceid": "ed3a6f44-e7a4-41b0-9769-71beee125cb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:42:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-041e0a0d-af5d-4b3d-a3f1-abbefc93f6fa req-b63ab185-f016-49c1-b9a3-965681f4f359 service nova] Releasing lock "refresh_cache-f1d10278-cf24-4fde-86eb-664ba86cbd8f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:43:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "f1d10278-cf24-4fde-86eb-664ba86cbd8f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "f1d10278-cf24-4fde-86eb-664ba86cbd8f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:00 user nova-compute[71498]: DEBUG nova.objects.instance [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lazy-loading 'flavor' on Instance uuid f1d10278-cf24-4fde-86eb-664ba86cbd8f {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:43:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "f1d10278-cf24-4fde-86eb-664ba86cbd8f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "f1d10278-cf24-4fde-86eb-664ba86cbd8f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "f1d10278-cf24-4fde-86eb-664ba86cbd8f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:00 user nova-compute[71498]: INFO nova.compute.manager [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Attaching volume 9b374309-f641-4369-af29-2e732c69b1e9 to /dev/sdc
Apr 14 01:43:00 user nova-compute[71498]: DEBUG os_brick.utils [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:43:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:00 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[06594579-1ffd-4799-89da-d3bf0b4ee2ad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:00 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a52b28-9e0b-4b0c-bbc8-4fa49e46ee0b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:00 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[670a0a94-7ca2-405c-b6f5-8b8bd30d0d9d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:00 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc8b58a-8076-4fca-8ab3-559452218dbe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:43:01 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbc2d03-4d99-4d08-9825-31663fad0235]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG os_brick.utils [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Updating existing volume attachment record: 249bd7c9-8144-42a9-8052-77c2c7c345fc {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THiIXmcP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:43:01 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:43:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:43:01 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:43:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:43:01 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1702b7de-5fb3-402a-8db1-400a0c75d705]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:43:01 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08de45f-2525-4184-9af7-9cd6b10da0bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc] added
Apr 14 01:43:01 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d6c6c9-885c-496d-8747-a065ac799e5a]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[673d76ee-0bfd-4198-bb65-4ae345021327]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v THiIXmcP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v THiIXmcP" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be4f7d6-291c-487e-b164-4e556752da65]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'THiIXmcP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b433588-b269-422d-bca4-2d23d560fd8a]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7d2ba7-57ef-45b5-89ee-b09a07d30a6e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:01 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:01 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:01 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:01 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:01 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:01 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:01 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:01 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ef6a02-c7e1-4f31-bfc0-6a8398ed8484]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc, portal: 172.16.0.220,3260]
Apr 14 01:43:01 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc, portal: 172.16.0.220,3260] successful.
Apr 14 01:43:01 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d912ce-16df-4ff2-9cd5-279dc5f7af10]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddde567-9ef2-43f9-8b1a-dfbd6982a463]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:01 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:01 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:01 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:01 user nova-compute[71498]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc (non-flash)
Apr 14 01:43:01 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:01 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:01 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:01 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:01 user nova-compute[71498]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc (non-flash)
Apr 14 01:43:01 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.048s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[619a7ae5-4f47-4345-8f63-393a432fb492]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:43:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THiIXmcP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:43:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:02 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:43:02 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '26563613437386666', 'path': '/dev/sdf'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:43:02 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563613437386666', 'path': '/dev/sdf'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:43:02 user nova-compute[71498]: DEBUG nova.compute.manager [req-66337c38-f99d-47c4-8a2c-76e3b7149c38 req-80a90b22-c44d-4530-b2c3-2ba0457dcc8a service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Received event network-changed-6762a294-eced-41bd-87c0-ac112e954d3a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:02 user nova-compute[71498]: DEBUG nova.compute.manager [req-66337c38-f99d-47c4-8a2c-76e3b7149c38 req-80a90b22-c44d-4530-b2c3-2ba0457dcc8a service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Refreshing instance network info cache due to event network-changed-6762a294-eced-41bd-87c0-ac112e954d3a. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:43:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-66337c38-f99d-47c4-8a2c-76e3b7149c38 req-80a90b22-c44d-4530-b2c3-2ba0457dcc8a service nova] Acquiring lock "refresh_cache-f45130b1-9e83-47a0-b335-a6e74875b79e" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:43:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-66337c38-f99d-47c4-8a2c-76e3b7149c38 req-80a90b22-c44d-4530-b2c3-2ba0457dcc8a service nova] Acquired lock "refresh_cache-f45130b1-9e83-47a0-b335-a6e74875b79e" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:43:02 user nova-compute[71498]: DEBUG nova.network.neutron [req-66337c38-f99d-47c4-8a2c-76e3b7149c38 req-80a90b22-c44d-4530-b2c3-2ba0457dcc8a service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Refreshing network info cache for port 6762a294-eced-41bd-87c0-ac112e954d3a {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:43:02 user nova-compute[71498]: DEBUG nova.objects.instance [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lazy-loading 'flavor' on Instance uuid f68784e7-578c-4a12-87d4-f35fbc5a1d59 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:43:02 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 01:43:02 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:43:02 user nova-compute[71498]:   <source dev="/dev/sdf"/>
Apr 14 01:43:02 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:43:02 user nova-compute[71498]:   <serial>e51f02c1-71b8-4c63-9bae-d2210e2363dc</serial>
Apr 14 01:43:02 user nova-compute[71498]: </disk>
Apr 14 01:43:02 user nova-compute[71498]:  {{(pid=71498) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 01:43:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "interface-f45130b1-9e83-47a0-b335-a6e74875b79e-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "interface-f45130b1-9e83-47a0-b335-a6e74875b79e-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:03 user nova-compute[71498]: DEBUG nova.objects.instance [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lazy-loading 'flavor' on Instance uuid f45130b1-9e83-47a0-b335-a6e74875b79e {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:43:03 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:43:03 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:43:03 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] No VIF found with MAC fa:16:3e:f5:7f:82, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:43:03 user nova-compute[71498]: DEBUG nova.objects.instance [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lazy-loading 'pci_requests' on Instance uuid f45130b1-9e83-47a0-b335-a6e74875b79e {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:43:03 user nova-compute[71498]: DEBUG nova.network.neutron [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:43:03 user nova-compute[71498]: DEBUG nova.network.neutron [req-66337c38-f99d-47c4-8a2c-76e3b7149c38 req-80a90b22-c44d-4530-b2c3-2ba0457dcc8a service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Updated VIF entry in instance network info cache for port 6762a294-eced-41bd-87c0-ac112e954d3a. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:43:03 user nova-compute[71498]: DEBUG nova.network.neutron [req-66337c38-f99d-47c4-8a2c-76e3b7149c38 req-80a90b22-c44d-4530-b2c3-2ba0457dcc8a service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Updating instance_info_cache with network_info: [{"id": "6762a294-eced-41bd-87c0-ac112e954d3a", "address": "fa:16:3e:41:81:59", "network": {"id": "c7acaa49-fce0-41b5-8dd6-d5ef02e27e23", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1296085277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58f0122cc9864fcea660891e2826ca7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6762a294-ec", "ovs_interfaceid": "6762a294-eced-41bd-87c0-ac112e954d3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:43:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ae274dd9-c121-44dc-8696-92dd6cd6b1f3 tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "f68784e7-578c-4a12-87d4-f35fbc5a1d59" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.599s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-66337c38-f99d-47c4-8a2c-76e3b7149c38 req-80a90b22-c44d-4530-b2c3-2ba0457dcc8a service nova] Releasing lock "refresh_cache-f45130b1-9e83-47a0-b335-a6e74875b79e" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:43:03 user nova-compute[71498]: DEBUG nova.policy [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2bada5cdb7704f6b956eb48b3729388d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58f0122cc9864fcea660891e2826ca7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:43:03 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681436568.6008778, 039d0702-d115-4c25-ab88-d669c6320820 => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:43:03 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 039d0702-d115-4c25-ab88-d669c6320820] VM Stopped (Lifecycle Event)
Apr 14 01:43:03 user nova-compute[71498]: DEBUG nova.compute.manager [None req-44b5cfe6-6e29-46b5-900e-b04d34ba23aa None None] [instance: 039d0702-d115-4c25-ab88-d669c6320820] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:43:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:04 user nova-compute[71498]: DEBUG nova.network.neutron [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Successfully created port: ade69726-e7ad-4fda-8bd1-b5ca2df4d24f {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:43:04 user nova-compute[71498]: DEBUG nova.network.neutron [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Successfully updated port: ade69726-e7ad-4fda-8bd1-b5ca2df4d24f {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:43:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "refresh_cache-f45130b1-9e83-47a0-b335-a6e74875b79e" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:43:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquired lock "refresh_cache-f45130b1-9e83-47a0-b335-a6e74875b79e" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:43:04 user nova-compute[71498]: DEBUG nova.network.neutron [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:43:04 user nova-compute[71498]: DEBUG nova.compute.manager [req-1f829449-d01c-4673-9ac0-06ffa11036e7 req-f01db5c4-ad6d-4750-b6cd-05a06e328faa service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Received event network-changed-ade69726-e7ad-4fda-8bd1-b5ca2df4d24f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG nova.compute.manager [req-1f829449-d01c-4673-9ac0-06ffa11036e7 req-f01db5c4-ad6d-4750-b6cd-05a06e328faa service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Refreshing instance network info cache due to event network-changed-ade69726-e7ad-4fda-8bd1-b5ca2df4d24f. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1f829449-d01c-4673-9ac0-06ffa11036e7 req-f01db5c4-ad6d-4750-b6cd-05a06e328faa service nova] Acquiring lock "refresh_cache-f45130b1-9e83-47a0-b335-a6e74875b79e" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "f68784e7-578c-4a12-87d4-f35fbc5a1d59" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "f68784e7-578c-4a12-87d4-f35fbc5a1d59" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:05 user nova-compute[71498]: INFO nova.compute.manager [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Detaching volume e51f02c1-71b8-4c63-9bae-d2210e2363dc
Apr 14 01:43:05 user nova-compute[71498]: INFO nova.virt.block_device [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Attempting to driver detach volume e51f02c1-71b8-4c63-9bae-d2210e2363dc from mountpoint /dev/vdb
Apr 14 01:43:05 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Attempting to detach device vdb from instance f68784e7-578c-4a12-87d4-f35fbc5a1d59 from the persistent domain config. {{(pid=71498) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 01:43:05 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:43:05 user nova-compute[71498]:   <source dev="/dev/sdf"/>
Apr 14 01:43:05 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:43:05 user nova-compute[71498]:   <serial>e51f02c1-71b8-4c63-9bae-d2210e2363dc</serial>
Apr 14 01:43:05 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 01:43:05 user nova-compute[71498]: </disk>
Apr 14 01:43:05 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:43:05 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Successfully detached device vdb from instance f68784e7-578c-4a12-87d4-f35fbc5a1d59 from the persistent domain config.
Apr 14 01:43:05 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f68784e7-578c-4a12-87d4-f35fbc5a1d59 from the live domain config. {{(pid=71498) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 01:43:05 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:43:05 user nova-compute[71498]:   <source dev="/dev/sdf"/>
Apr 14 01:43:05 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:43:05 user nova-compute[71498]:   <serial>e51f02c1-71b8-4c63-9bae-d2210e2363dc</serial>
Apr 14 01:43:05 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 01:43:05 user nova-compute[71498]: </disk>
Apr 14 01:43:05 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG nova.network.neutron [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Updating instance_info_cache with network_info: [{"id": "6762a294-eced-41bd-87c0-ac112e954d3a", "address": "fa:16:3e:41:81:59", "network": {"id": "c7acaa49-fce0-41b5-8dd6-d5ef02e27e23", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1296085277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58f0122cc9864fcea660891e2826ca7b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6762a294-ec", "ovs_interfaceid": "6762a294-eced-41bd-87c0-ac112e954d3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ade69726-e7ad-4fda-8bd1-b5ca2df4d24f", "address": "fa:16:3e:48:18:8c", "network": {"id": "d7d68554-fe8e-4ca1-9390-0f7412e761b9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1349339291", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "58f0122cc9864fcea660891e2826ca7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade69726-e7", "ovs_interfaceid": "ade69726-e7ad-4fda-8bd1-b5ca2df4d24f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Releasing lock "refresh_cache-f45130b1-9e83-47a0-b335-a6e74875b79e" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1f829449-d01c-4673-9ac0-06ffa11036e7 req-f01db5c4-ad6d-4750-b6cd-05a06e328faa service nova] Acquired lock "refresh_cache-f45130b1-9e83-47a0-b335-a6e74875b79e" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG nova.network.neutron [req-1f829449-d01c-4673-9ac0-06ffa11036e7 req-f01db5c4-ad6d-4750-b6cd-05a06e328faa service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Refreshing network info cache for port ade69726-e7ad-4fda-8bd1-b5ca2df4d24f {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:41:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1373277645',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1373277645',id=7,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUT3ZOn0Mn2ktm54d2qA9xktIMZqL7Q40F6rrStB8sUhSSG/BBymdkGPGHtlWKKsqIfu1Qyxy455mqWjjowlE5hNoX4c7IQemPoagPLG/KJKleE/aVTRO8q8iRe5UAbxg==',key_name='tempest-keypair-658101980',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:41:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='58f0122cc9864fcea660891e2826ca7b',ramdisk_id='',reservation_id='r-svkr1ynm',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-242857735',owner_user_name='tempest-TaggedAttachmentsTest-242857735-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:41:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bada5cdb7704f6b956eb48b3729388d',uuid=f45130b1-9e83-47a0-b335-a6e74875b79e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ade69726-e7ad-4fda-8bd1-b5ca2df4d24f", "address": "fa:16:3e:48:18:8c", "network": {"id": "d7d68554-fe8e-4ca1-9390-0f7412e761b9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1349339291", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "58f0122cc9864fcea660891e2826ca7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade69726-e7", "ovs_interfaceid": "ade69726-e7ad-4fda-8bd1-b5ca2df4d24f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Converting VIF {"id": "ade69726-e7ad-4fda-8bd1-b5ca2df4d24f", "address": "fa:16:3e:48:18:8c", "network": {"id": "d7d68554-fe8e-4ca1-9390-0f7412e761b9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1349339291", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "58f0122cc9864fcea660891e2826ca7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade69726-e7", "ovs_interfaceid": "ade69726-e7ad-4fda-8bd1-b5ca2df4d24f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:18:8c,bridge_name='br-int',has_traffic_filtering=True,id=ade69726-e7ad-4fda-8bd1-b5ca2df4d24f,network=Network(d7d68554-fe8e-4ca1-9390-0f7412e761b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade69726-e7') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG os_vif [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:18:8c,bridge_name='br-int',has_traffic_filtering=True,id=ade69726-e7ad-4fda-8bd1-b5ca2df4d24f,network=Network(d7d68554-fe8e-4ca1-9390-0f7412e761b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade69726-e7') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapade69726-e7, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapade69726-e7, col_values=(('external_ids', {'iface-id': 'ade69726-e7ad-4fda-8bd1-b5ca2df4d24f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:18:8c', 'vm-uuid': 'f45130b1-9e83-47a0-b335-a6e74875b79e'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:05 user nova-compute[71498]: INFO os_vif [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:18:8c,bridge_name='br-int',has_traffic_filtering=True,id=ade69726-e7ad-4fda-8bd1-b5ca2df4d24f,network=Network(d7d68554-fe8e-4ca1-9390-0f7412e761b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade69726-e7')
Apr 14 01:43:05 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:41:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1373277645',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1373277645',id=7,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUT3ZOn0Mn2ktm54d2qA9xktIMZqL7Q40F6rrStB8sUhSSG/BBymdkGPGHtlWKKsqIfu1Qyxy455mqWjjowlE5hNoX4c7IQemPoagPLG/KJKleE/aVTRO8q8iRe5UAbxg==',key_name='tempest-keypair-658101980',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:41:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='58f0122cc9864fcea660891e2826ca7b',ramdisk_id='',reservation_id='r-svkr1ynm',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-242857735',owner_user_name='tempest-TaggedAttachmentsTest-242857735-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:41:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bada5cdb7704f6b956eb48b3729388d',uuid=f45130b1-9e83-47a0-b335-a6e74875b79e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ade69726-e7ad-4fda-8bd1-b5ca2df4d24f", "address": "fa:16:3e:48:18:8c", "network": {"id": "d7d68554-fe8e-4ca1-9390-0f7412e761b9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1349339291", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "58f0122cc9864fcea660891e2826ca7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade69726-e7", "ovs_interfaceid": "ade69726-e7ad-4fda-8bd1-b5ca2df4d24f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Converting VIF {"id": "ade69726-e7ad-4fda-8bd1-b5ca2df4d24f", "address": "fa:16:3e:48:18:8c", "network": {"id": "d7d68554-fe8e-4ca1-9390-0f7412e761b9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1349339291", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "58f0122cc9864fcea660891e2826ca7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade69726-e7", "ovs_interfaceid": "ade69726-e7ad-4fda-8bd1-b5ca2df4d24f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:18:8c,bridge_name='br-int',has_traffic_filtering=True,id=ade69726-e7ad-4fda-8bd1-b5ca2df4d24f,network=Network(d7d68554-fe8e-4ca1-9390-0f7412e761b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade69726-e7') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] attach device xml: <interface type="ethernet">
Apr 14 01:43:05 user nova-compute[71498]:   <mac address="fa:16:3e:48:18:8c"/>
Apr 14 01:43:05 user nova-compute[71498]:   <model type="virtio"/>
Apr 14 01:43:05 user nova-compute[71498]:   <mtu size="1442"/>
Apr 14 01:43:05 user nova-compute[71498]:   <target dev="tapade69726-e7"/>
Apr 14 01:43:05 user nova-compute[71498]: </interface>
Apr 14 01:43:05 user nova-compute[71498]:  {{(pid=71498) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NrlyjRDc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:43:05 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:43:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:43:05 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:43:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:43:05 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:43:05 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[70096592-e935-4526-9db9-f79d093773b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:43:05 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[002e7fe8-3e91-4957-b2a9-388f67a81eb5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9] added
Apr 14 01:43:05 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75a2f54-fe7c-4788-a0e2-f5d86c7e7429]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Received event <DeviceRemovedEvent: 1681436585.836371, f68784e7-578c-4a12-87d4-f35fbc5a1d59 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71498) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22bebc1-f79a-45fa-bceb-3b59f99b1e66]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NrlyjRDc {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f68784e7-578c-4a12-87d4-f35fbc5a1d59 {{(pid=71498) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 01:43:05 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Successfully detached device vdb from instance f68784e7-578c-4a12-87d4-f35fbc5a1d59 from the live domain config.
Apr 14 01:43:05 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THiIXmcP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:43:05 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:43:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NrlyjRDc" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4f9078-750a-4094-8db5-31f7ba892a7b]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NrlyjRDc'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9f5364-d972-43ff-a5d9-6f543a92216f]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[928d0977-3cc1-4708-993a-2b8991ac5b5b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:05 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:05 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:05 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:05 user nova-compute[71498]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc (non-flash)
Apr 14 01:43:05 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:05 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:05 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:05 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:05 user nova-compute[71498]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc (non-flash)
Apr 14 01:43:05 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:43:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 -p 172.16.0.220:3260 --login" returned: 0 in 0.135s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[64424fcf-639e-4274-b29a-fad72be3a6c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9, portal: 172.16.0.220,3260]
Apr 14 01:43:06 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9, portal: 172.16.0.220,3260] successful.
Apr 14 01:43:06 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e8735a-e717-432d-931f-0664f265b50d]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ce12e9-47df-47ad-861d-bb56c335686a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:06 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:06 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:06 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:06 user nova-compute[71498]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc (non-flash)
Apr 14 01:43:06 user nova-compute[71498]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 (non-flash)
Apr 14 01:43:06 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:06 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:06 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:06 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:06 user nova-compute[71498]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc (non-flash)
Apr 14 01:43:06 user nova-compute[71498]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 (non-flash)
Apr 14 01:43:06 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.390s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG nova.compute.manager [req-638a7fda-55f3-401d-9a41-277d90ce0dd6 req-3c749f83-e6d8-4cec-94d6-3d28b5a6ee56 service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Received event network-vif-plugged-ade69726-e7ad-4fda-8bd1-b5ca2df4d24f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-638a7fda-55f3-401d-9a41-277d90ce0dd6 req-3c749f83-e6d8-4cec-94d6-3d28b5a6ee56 service nova] Acquiring lock "f45130b1-9e83-47a0-b335-a6e74875b79e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-638a7fda-55f3-401d-9a41-277d90ce0dd6 req-3c749f83-e6d8-4cec-94d6-3d28b5a6ee56 service nova] Lock "f45130b1-9e83-47a0-b335-a6e74875b79e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-638a7fda-55f3-401d-9a41-277d90ce0dd6 req-3c749f83-e6d8-4cec-94d6-3d28b5a6ee56 service nova] Lock "f45130b1-9e83-47a0-b335-a6e74875b79e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG nova.compute.manager [req-638a7fda-55f3-401d-9a41-277d90ce0dd6 req-3c749f83-e6d8-4cec-94d6-3d28b5a6ee56 service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] No waiting events found dispatching network-vif-plugged-ade69726-e7ad-4fda-8bd1-b5ca2df4d24f {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:43:06 user nova-compute[71498]: WARNING nova.compute.manager [req-638a7fda-55f3-401d-9a41-277d90ce0dd6 req-3c749f83-e6d8-4cec-94d6-3d28b5a6ee56 service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Received unexpected event network-vif-plugged-ade69726-e7ad-4fda-8bd1-b5ca2df4d24f for instance with vm_state active and task_state None.
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0ee8dd-03e2-414c-ac6c-b3a0e1c15060]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NrlyjRDc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] No BDM found with device name hda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] No VIF found with MAC fa:16:3e:41:81:59, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG nova.network.neutron [req-1f829449-d01c-4673-9ac0-06ffa11036e7 req-f01db5c4-ad6d-4750-b6cd-05a06e328faa service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Updated VIF entry in instance network info cache for port ade69726-e7ad-4fda-8bd1-b5ca2df4d24f. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG nova.network.neutron [req-1f829449-d01c-4673-9ac0-06ffa11036e7 req-f01db5c4-ad6d-4750-b6cd-05a06e328faa service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Updating instance_info_cache with network_info: [{"id": "6762a294-eced-41bd-87c0-ac112e954d3a", "address": "fa:16:3e:41:81:59", "network": {"id": "c7acaa49-fce0-41b5-8dd6-d5ef02e27e23", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1296085277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58f0122cc9864fcea660891e2826ca7b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6762a294-ec", "ovs_interfaceid": "6762a294-eced-41bd-87c0-ac112e954d3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ade69726-e7ad-4fda-8bd1-b5ca2df4d24f", "address": "fa:16:3e:48:18:8c", "network": {"id": "d7d68554-fe8e-4ca1-9390-0f7412e761b9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1349339291", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "58f0122cc9864fcea660891e2826ca7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade69726-e7", "ovs_interfaceid": "ade69726-e7ad-4fda-8bd1-b5ca2df4d24f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1f829449-d01c-4673-9ac0-06ffa11036e7 req-f01db5c4-ad6d-4750-b6cd-05a06e328faa service nova] Releasing lock "refresh_cache-f45130b1-9e83-47a0-b335-a6e74875b79e" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:43:06 user nova-compute[71498]:   <nova:package version="0.0.0"/>
Apr 14 01:43:06 user nova-compute[71498]:   <nova:name>tempest-device-tagging-server-1373277645</nova:name>
Apr 14 01:43:06 user nova-compute[71498]:   <nova:creationTime>2023-04-14 01:43:06</nova:creationTime>
Apr 14 01:43:06 user nova-compute[71498]:   <nova:flavor name="m1.nano">
Apr 14 01:43:06 user nova-compute[71498]:     <nova:memory>128</nova:memory>
Apr 14 01:43:06 user nova-compute[71498]:     <nova:disk>1</nova:disk>
Apr 14 01:43:06 user nova-compute[71498]:     <nova:swap>0</nova:swap>
Apr 14 01:43:06 user nova-compute[71498]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:43:06 user nova-compute[71498]:     <nova:vcpus>1</nova:vcpus>
Apr 14 01:43:06 user nova-compute[71498]:   </nova:flavor>
Apr 14 01:43:06 user nova-compute[71498]:   <nova:owner>
Apr 14 01:43:06 user nova-compute[71498]:     <nova:user uuid="2bada5cdb7704f6b956eb48b3729388d">tempest-TaggedAttachmentsTest-242857735-project-member</nova:user>
Apr 14 01:43:06 user nova-compute[71498]:     <nova:project uuid="58f0122cc9864fcea660891e2826ca7b">tempest-TaggedAttachmentsTest-242857735</nova:project>
Apr 14 01:43:06 user nova-compute[71498]:   </nova:owner>
Apr 14 01:43:06 user nova-compute[71498]:   <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:43:06 user nova-compute[71498]:   <nova:ports>
Apr 14 01:43:06 user nova-compute[71498]:     <nova:port uuid="6762a294-eced-41bd-87c0-ac112e954d3a">
Apr 14 01:43:06 user nova-compute[71498]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 01:43:06 user nova-compute[71498]:     </nova:port>
Apr 14 01:43:06 user nova-compute[71498]:     <nova:port uuid="ade69726-e7ad-4fda-8bd1-b5ca2df4d24f">
Apr 14 01:43:06 user nova-compute[71498]:       <nova:ip type="fixed" address="10.10.10.13" ipVersion="4"/>
Apr 14 01:43:06 user nova-compute[71498]:     </nova:port>
Apr 14 01:43:06 user nova-compute[71498]:   </nova:ports>
Apr 14 01:43:06 user nova-compute[71498]: </nova:instance>
Apr 14 01:43:06 user nova-compute[71498]:  {{(pid=71498) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-97d4732b-fb8b-4d19-8ab9-cda82400fb8a tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "interface-f45130b1-9e83-47a0-b335-a6e74875b79e-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.102s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "f45130b1-9e83-47a0-b335-a6e74875b79e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "f45130b1-9e83-47a0-b335-a6e74875b79e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG nova.objects.instance [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lazy-loading 'flavor' on Instance uuid f45130b1-9e83-47a0-b335-a6e74875b79e {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "f45130b1-9e83-47a0-b335-a6e74875b79e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "f45130b1-9e83-47a0-b335-a6e74875b79e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "f45130b1-9e83-47a0-b335-a6e74875b79e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:06 user nova-compute[71498]: INFO nova.compute.manager [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Attaching volume 217c01bb-a21b-4ff9-9e57-99dba019914b to /dev/vdb
Apr 14 01:43:06 user nova-compute[71498]: DEBUG os_brick.utils [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[34af1e61-1167-4efe-8c80-92b9a26dddfb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5e336f-6403-4a0f-b467-9e03836e89a0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac34c63-8216-4664-9628-8b7ef9ba814c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88aef03-2c41-4a33-8f4b-fcec90f50e46]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:43:06 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:43:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c6f398-9247-4d51-864b-d8afa1e34810]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG os_brick.utils [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:43:06 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Updating existing volume attachment record: 176c9c33-d97c-416c-8fe7-2ff01b1b5d80 {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.437s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] <== connect_volume: return (1438ms) {'type': 'block', 'scsi_wwn': '26336373762326361', 'path': '/dev/sdg'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336373762326361', 'path': '/dev/sdg'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.313s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG nova.objects.instance [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lazy-loading 'flavor' on Instance uuid f1d10278-cf24-4fde-86eb-664ba86cbd8f {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce0c1bd-d9ee-4b58-9ecf-b54754f6f7d0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:43:07 user nova-compute[71498]: No targets found.
Apr 14 01:43:07 user nova-compute[71498]: iSNS:
Apr 14 01:43:07 user nova-compute[71498]: No targets found.
Apr 14 01:43:07 user nova-compute[71498]: STATIC:
Apr 14 01:43:07 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02
Apr 14 01:43:07 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:07 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:07 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9
Apr 14 01:43:07 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:07 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:07 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53
Apr 14 01:43:07 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:07 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:07 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc
Apr 14 01:43:07 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:07 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:07 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e
Apr 14 01:43:07 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:07 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:07 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d
Apr 14 01:43:07 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:07 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:07 user nova-compute[71498]: FIRMWARE:
Apr 14 01:43:07 user nova-compute[71498]: No targets found.
Apr 14 01:43:07 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:43:07 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:43:07 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 01:43:07 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:43:07 user nova-compute[71498]:   <source dev="/dev/sdg"/>
Apr 14 01:43:07 user nova-compute[71498]:   <target dev="sdc" bus="scsi"/>
Apr 14 01:43:07 user nova-compute[71498]:   <serial>9b374309-f641-4369-af29-2e732c69b1e9</serial>
Apr 14 01:43:07 user nova-compute[71498]:   <address type="drive" controller="0" unit="2"/>
Apr 14 01:43:07 user nova-compute[71498]: </disk>
Apr 14 01:43:07 user nova-compute[71498]:  {{(pid=71498) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e711e474-cd45-4b29-9a81-cb70fa8cfc52]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba84103-b14a-492c-87c2-e3ebedb0dcba]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:07 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:07 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:07 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:07 user nova-compute[71498]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc (non-flash)
Apr 14 01:43:07 user nova-compute[71498]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 (non-flash)
Apr 14 01:43:07 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:07 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:07 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:07 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:07 user nova-compute[71498]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc (non-flash)
Apr 14 01:43:07 user nova-compute[71498]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 (non-flash)
Apr 14 01:43:07 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51f42acca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc'): ({'sdf'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Removing single pathed devices sdf {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4f5c3d-52d9-48c4-9896-36819f401515]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada7ee06-97b7-4e03-9ac9-9ce0ee089e3d]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Flushing IO for device /dev/sdf {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c351bc-c292-43b0-ba7c-dfea430ac6d3]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.056s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fa92ff-01ee-4554-a2bf-082160ed95b4]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] SCSI volumes sdf have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6709d44-7abb-4b46-b7cc-59fb1710a0df]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[526b257c-fe06-49fd-a2b3-6b1574258328]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc, portal: 172.16.0.220,3260]
Apr 14 01:43:07 user nova-compute[71498]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc, portal: 172.16.0.220,3260] successful.
Apr 14 01:43:07 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e51f02c1-71b8-4c63-9bae-d2210e2363dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff79e16-56d8-4180-98d0-86ff59e4cecd]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] <== disconnect_volume: return (1674ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] No BDM found with device name sda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] No BDM found with device name sdc, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] No VIF found with MAC fa:16:3e:88:7b:f9, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:43:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-de80350f-ffc8-44ba-98b2-1b899e678d2c tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "f1d10278-cf24-4fde-86eb-664ba86cbd8f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.011s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:08 user nova-compute[71498]: DEBUG nova.compute.manager [req-ce342292-36bd-4d56-9afc-104a1d6fe848 req-f796ad30-0acc-426c-8327-e0df2fc6b27e service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Received event network-vif-plugged-ade69726-e7ad-4fda-8bd1-b5ca2df4d24f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ce342292-36bd-4d56-9afc-104a1d6fe848 req-f796ad30-0acc-426c-8327-e0df2fc6b27e service nova] Acquiring lock "f45130b1-9e83-47a0-b335-a6e74875b79e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ce342292-36bd-4d56-9afc-104a1d6fe848 req-f796ad30-0acc-426c-8327-e0df2fc6b27e service nova] Lock "f45130b1-9e83-47a0-b335-a6e74875b79e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ce342292-36bd-4d56-9afc-104a1d6fe848 req-f796ad30-0acc-426c-8327-e0df2fc6b27e service nova] Lock "f45130b1-9e83-47a0-b335-a6e74875b79e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:08 user nova-compute[71498]: DEBUG nova.compute.manager [req-ce342292-36bd-4d56-9afc-104a1d6fe848 req-f796ad30-0acc-426c-8327-e0df2fc6b27e service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] No waiting events found dispatching network-vif-plugged-ade69726-e7ad-4fda-8bd1-b5ca2df4d24f {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:43:08 user nova-compute[71498]: WARNING nova.compute.manager [req-ce342292-36bd-4d56-9afc-104a1d6fe848 req-f796ad30-0acc-426c-8327-e0df2fc6b27e service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Received unexpected event network-vif-plugged-ade69726-e7ad-4fda-8bd1-b5ca2df4d24f for instance with vm_state active and task_state None.
Apr 14 01:43:08 user nova-compute[71498]: DEBUG nova.objects.instance [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lazy-loading 'flavor' on Instance uuid f68784e7-578c-4a12-87d4-f35fbc5a1d59 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:43:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-147be135-9f14-4e93-a84d-8f39b5108b4d tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "f68784e7-578c-4a12-87d4-f35fbc5a1d59" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.192s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:08 user nova-compute[71498]: DEBUG nova.compute.manager [req-657897a2-c176-4e81-aae7-b7e34dc62551 req-f63aee70-cbce-4ca5-a616-8017e574b78b service nova] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Received event network-changed-72f288aa-49e2-407b-9e41-47c8fd81286f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:08 user nova-compute[71498]: DEBUG nova.compute.manager [req-657897a2-c176-4e81-aae7-b7e34dc62551 req-f63aee70-cbce-4ca5-a616-8017e574b78b service nova] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Refreshing instance network info cache due to event network-changed-72f288aa-49e2-407b-9e41-47c8fd81286f. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:43:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-657897a2-c176-4e81-aae7-b7e34dc62551 req-f63aee70-cbce-4ca5-a616-8017e574b78b service nova] Acquiring lock "refresh_cache-3decf8d9-7bb3-4395-a8b2-91c8dcf1880c" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:43:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-657897a2-c176-4e81-aae7-b7e34dc62551 req-f63aee70-cbce-4ca5-a616-8017e574b78b service nova] Acquired lock "refresh_cache-3decf8d9-7bb3-4395-a8b2-91c8dcf1880c" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:43:08 user nova-compute[71498]: DEBUG nova.network.neutron [req-657897a2-c176-4e81-aae7-b7e34dc62551 req-f63aee70-cbce-4ca5-a616-8017e574b78b service nova] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Refreshing network info cache for port 72f288aa-49e2-407b-9e41-47c8fd81286f {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:43:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "f1d10278-cf24-4fde-86eb-664ba86cbd8f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "f1d10278-cf24-4fde-86eb-664ba86cbd8f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:08 user nova-compute[71498]: INFO nova.compute.manager [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Detaching volume 9b374309-f641-4369-af29-2e732c69b1e9
Apr 14 01:43:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:08 user nova-compute[71498]: DEBUG nova.objects.instance [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lazy-loading 'flavor' on Instance uuid 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:43:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:08 user nova-compute[71498]: INFO nova.virt.block_device [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Attempting to driver detach volume 9b374309-f641-4369-af29-2e732c69b1e9 from mountpoint /dev/sdc
Apr 14 01:43:08 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Attempting to detach device sdc from instance f1d10278-cf24-4fde-86eb-664ba86cbd8f from the persistent domain config. {{(pid=71498) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 01:43:08 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 01:43:08 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:43:08 user nova-compute[71498]:   <source dev="/dev/sdg"/>
Apr 14 01:43:08 user nova-compute[71498]:   <target dev="sdc" bus="scsi"/>
Apr 14 01:43:08 user nova-compute[71498]:   <serial>9b374309-f641-4369-af29-2e732c69b1e9</serial>
Apr 14 01:43:08 user nova-compute[71498]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 14 01:43:08 user nova-compute[71498]: </disk>
Apr 14 01:43:08 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:43:08 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Successfully detached device sdc from instance f1d10278-cf24-4fde-86eb-664ba86cbd8f from the persistent domain config.
Apr 14 01:43:08 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance f1d10278-cf24-4fde-86eb-664ba86cbd8f from the live domain config. {{(pid=71498) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 01:43:08 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 01:43:08 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:43:08 user nova-compute[71498]:   <source dev="/dev/sdg"/>
Apr 14 01:43:08 user nova-compute[71498]:   <target dev="sdc" bus="scsi"/>
Apr 14 01:43:08 user nova-compute[71498]:   <serial>9b374309-f641-4369-af29-2e732c69b1e9</serial>
Apr 14 01:43:08 user nova-compute[71498]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 14 01:43:08 user nova-compute[71498]: </disk>
Apr 14 01:43:08 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:43:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:08 user nova-compute[71498]: INFO nova.compute.manager [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Attaching volume 7113332c-fb29-4657-be57-be86d245b411 to /dev/vdb
Apr 14 01:43:09 user nova-compute[71498]: DEBUG os_brick.utils [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb9e561-512c-4e2c-8509-c553ee56e872]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[77446582-89a5-473a-a609-556b03a41ae3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c58d3ed-cff8-4da8-a115-73992be858e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[97668c2d-bb82-423e-8cba-8a939bf983c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG nova.network.neutron [req-657897a2-c176-4e81-aae7-b7e34dc62551 req-f63aee70-cbce-4ca5-a616-8017e574b78b service nova] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Updated VIF entry in instance network info cache for port 72f288aa-49e2-407b-9e41-47c8fd81286f. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG nova.network.neutron [req-657897a2-c176-4e81-aae7-b7e34dc62551 req-f63aee70-cbce-4ca5-a616-8017e574b78b service nova] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Updating instance_info_cache with network_info: [{"id": "72f288aa-49e2-407b-9e41-47c8fd81286f", "address": "fa:16:3e:17:11:af", "network": {"id": "335d6a15-36dc-4fbc-ae2a-08b44984eb3a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1640804392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e707623638044e983b557119edd7673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72f288aa-49", "ovs_interfaceid": "72f288aa-49e2-407b-9e41-47c8fd81286f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:43:09 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f39463e-781c-4099-9ee0-32915bca0adb]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG os_brick.utils [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Updating existing volume attachment record: 05f13a2d-ad9d-41cb-8bd8-382568ae9c2b {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-657897a2-c176-4e81-aae7-b7e34dc62551 req-f63aee70-cbce-4ca5-a616-8017e574b78b service nova] Releasing lock "refresh_cache-3decf8d9-7bb3-4395-a8b2-91c8dcf1880c" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Received event <DeviceRemovedEvent: 1681436589.2748115, f1d10278-cf24-4fde-86eb-664ba86cbd8f => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71498) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance f1d10278-cf24-4fde-86eb-664ba86cbd8f {{(pid=71498) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 01:43:09 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Successfully detached device sdc from instance f1d10278-cf24-4fde-86eb-664ba86cbd8f from the live domain config.
Apr 14 01:43:09 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NrlyjRDc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:43:09 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:43:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b749e5-300e-4908-bc77-c34e36e0e008]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:43:09 user nova-compute[71498]: No targets found.
Apr 14 01:43:09 user nova-compute[71498]: iSNS:
Apr 14 01:43:09 user nova-compute[71498]: No targets found.
Apr 14 01:43:09 user nova-compute[71498]: STATIC:
Apr 14 01:43:09 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02
Apr 14 01:43:09 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:09 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:09 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9
Apr 14 01:43:09 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:09 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:09 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53
Apr 14 01:43:09 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:09 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:09 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e
Apr 14 01:43:09 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:09 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:09 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d
Apr 14 01:43:09 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:09 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:09 user nova-compute[71498]: FIRMWARE:
Apr 14 01:43:09 user nova-compute[71498]: No targets found.
Apr 14 01:43:09 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:43:09 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:43:09 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a2cdb7-4d5f-4f29-ab98-633f7fea1424]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ce97ed-2de6-444c-9670-83fdf28511dd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:09 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:09 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:09 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:09 user nova-compute[71498]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 (non-flash)
Apr 14 01:43:09 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:09 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:09 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:09 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:09 user nova-compute[71498]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 (non-flash)
Apr 14 01:43:09 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51f42727a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9'): ({'sdg'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Removing single pathed devices sdg {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3fa480-8daf-413d-8d1a-bff2fda1bfdc]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd7dd11-85d4-4d80-aa2a-34e148d108be]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Flushing IO for device /dev/sdg {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[279aeb66-95e9-40df-b111-6ee851a97f66]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2aa73cd-98cf-4074-a76e-48790d1ed5f0]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] SCSI volumes sdg have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3568e9fd-fab1-41c6-abfa-16b350379824]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adc50b7-8863-4544-87d8-13c59995ffcd]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9, portal: 172.16.0.220,3260]
Apr 14 01:43:09 user nova-compute[71498]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9, portal: 172.16.0.220,3260] successful.
Apr 14 01:43:09 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b374309-f641-4369-af29-2e732c69b1e9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbe4a18-991b-4d46-b6e5-e1d76e0e059b]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] <== disconnect_volume: return (324ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:43:09 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:43:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG nova.objects.instance [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lazy-loading 'flavor' on Instance uuid f1d10278-cf24-4fde-86eb-664ba86cbd8f {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b9bb3cd1-b483-4159-b22a-c60e2834cac4 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "f1d10278-cf24-4fde-86eb-664ba86cbd8f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.375s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YbsqhwAf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:43:12 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:43:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:43:12 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:43:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:43:12 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f9a2c3-8d3f-4873-afb6-7ee60c40152c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:43:12 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b34dd32-3296-455f-a8a6-8342fbd8f39c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b] added
Apr 14 01:43:12 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.059s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[309006d4-f962-4018-86c8-d99964b1b852]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a8225e-e2f6-4682-9cc1-fdd9061027c7]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YbsqhwAf {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YbsqhwAf" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdfa4e5-8772-46bc-adad-d293a770f0b9]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YbsqhwAf'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d385fc-f6a6-4e2e-870f-294c7a5ef366]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eea0a11-05f4-4f8e-9b13-48f5356f1a99]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:12 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:12 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:12 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:12 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:12 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:12 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:12 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:12 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ff542a40-f1d9-4b3c-b100-bb8403d5e6b3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "f1d10278-cf24-4fde-86eb-664ba86cbd8f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ff542a40-f1d9-4b3c-b100-bb8403d5e6b3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "f1d10278-cf24-4fde-86eb-664ba86cbd8f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ff542a40-f1d9-4b3c-b100-bb8403d5e6b3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "f1d10278-cf24-4fde-86eb-664ba86cbd8f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ff542a40-f1d9-4b3c-b100-bb8403d5e6b3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "f1d10278-cf24-4fde-86eb-664ba86cbd8f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ff542a40-f1d9-4b3c-b100-bb8403d5e6b3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "f1d10278-cf24-4fde-86eb-664ba86cbd8f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:12 user nova-compute[71498]: INFO nova.compute.manager [None req-ff542a40-f1d9-4b3c-b100-bb8403d5e6b3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Terminating instance
Apr 14 01:43:12 user nova-compute[71498]: DEBUG nova.compute.manager [None req-ff542a40-f1d9-4b3c-b100-bb8403d5e6b3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[83901564-039b-4495-babe-ce7cc8c113ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b, portal: 172.16.0.220,3260]
Apr 14 01:43:12 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b, portal: 172.16.0.220,3260] successful.
Apr 14 01:43:12 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a96a079-656f-4131-aaae-8ad466c28c8b]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f96e3a2-b591-4d9c-8abb-663b8f72e36f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:12 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:12 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:12 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:12 user nova-compute[71498]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b (non-flash)
Apr 14 01:43:12 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:12 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:12 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:12 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:12 user nova-compute[71498]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b (non-flash)
Apr 14 01:43:12 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] HCTL ('37', '-', '-', 0) found on session 9 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.025s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15798db-2efa-4c2d-808c-61bf6571859b]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Searching for a device in session 9 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YbsqhwAf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG nova.compute.manager [req-921aa67a-5d3e-4815-9e31-df7932e08478 req-7fbb3cf8-161f-4444-8cd7-9a2630460671 service nova] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Received event network-vif-unplugged-ed3a6f44-e7a4-41b0-9769-71beee125cb1 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-921aa67a-5d3e-4815-9e31-df7932e08478 req-7fbb3cf8-161f-4444-8cd7-9a2630460671 service nova] Acquiring lock "f1d10278-cf24-4fde-86eb-664ba86cbd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-921aa67a-5d3e-4815-9e31-df7932e08478 req-7fbb3cf8-161f-4444-8cd7-9a2630460671 service nova] Lock "f1d10278-cf24-4fde-86eb-664ba86cbd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-921aa67a-5d3e-4815-9e31-df7932e08478 req-7fbb3cf8-161f-4444-8cd7-9a2630460671 service nova] Lock "f1d10278-cf24-4fde-86eb-664ba86cbd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG nova.compute.manager [req-921aa67a-5d3e-4815-9e31-df7932e08478 req-7fbb3cf8-161f-4444-8cd7-9a2630460671 service nova] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] No waiting events found dispatching network-vif-unplugged-ed3a6f44-e7a4-41b0-9769-71beee125cb1 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:43:12 user nova-compute[71498]: DEBUG nova.compute.manager [req-921aa67a-5d3e-4815-9e31-df7932e08478 req-7fbb3cf8-161f-4444-8cd7-9a2630460671 service nova] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Received event network-vif-unplugged-ed3a6f44-e7a4-41b0-9769-71beee125cb1 for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:43:13 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Instance destroyed successfully.
Apr 14 01:43:13 user nova-compute[71498]: DEBUG nova.objects.instance [None req-ff542a40-f1d9-4b3c-b100-bb8403d5e6b3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lazy-loading 'resources' on Instance uuid f1d10278-cf24-4fde-86eb-664ba86cbd8f {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-ff542a40-f1d9-4b3c-b100-bb8403d5e6b3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:41:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1295717929',display_name='tempest-AttachSCSIVolumeTestJSON-server-1295717929',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1295717929',id=6,image_ref='8ac72bf7-6709-4b09-92e0-a06bd5d54f4d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkA+tu4xg/6rZ+pvXuvXfIBfdfqlnJ3g+nPNNirxTLXyVXJfO8nlfKhzRDd8JVflZJBNfMF2WhhlVStReA2haNPNG8030TsTlfh5bzCyX6wU3jLESQSqScW09J0bJ51Kw==',key_name='tempest-keypair-698129803',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:41:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d9a3bf2a3b4480a990adc9821005f7f',ramdisk_id='',reservation_id='r-9hhx54e5',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8ac72bf7-6709-4b09-92e0-a06bd5d54f4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-716976075',owner_user_name='tempest-AttachSCSIVolumeTestJSON-716976075-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:41:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a1f606719a5435dbcb6092e0708b2cb',uuid=f1d10278-cf24-4fde-86eb-664ba86cbd8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed3a6f44-e7a4-41b0-9769-71beee125cb1", "address": "fa:16:3e:88:7b:f9", "network": {"id": "e70b6880-528f-41d8-b154-89eabc02efdb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1224931198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d9a3bf2a3b4480a990adc9821005f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped3a6f44-e7", "ovs_interfaceid": "ed3a6f44-e7a4-41b0-9769-71beee125cb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-ff542a40-f1d9-4b3c-b100-bb8403d5e6b3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Converting VIF {"id": "ed3a6f44-e7a4-41b0-9769-71beee125cb1", "address": "fa:16:3e:88:7b:f9", "network": {"id": "e70b6880-528f-41d8-b154-89eabc02efdb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1224931198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d9a3bf2a3b4480a990adc9821005f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped3a6f44-e7", "ovs_interfaceid": "ed3a6f44-e7a4-41b0-9769-71beee125cb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-ff542a40-f1d9-4b3c-b100-bb8403d5e6b3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:7b:f9,bridge_name='br-int',has_traffic_filtering=True,id=ed3a6f44-e7a4-41b0-9769-71beee125cb1,network=Network(e70b6880-528f-41d8-b154-89eabc02efdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped3a6f44-e7') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG os_vif [None req-ff542a40-f1d9-4b3c-b100-bb8403d5e6b3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:7b:f9,bridge_name='br-int',has_traffic_filtering=True,id=ed3a6f44-e7a4-41b0-9769-71beee125cb1,network=Network(e70b6880-528f-41d8-b154-89eabc02efdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped3a6f44-e7') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped3a6f44-e7, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:13 user nova-compute[71498]: INFO os_vif [None req-ff542a40-f1d9-4b3c-b100-bb8403d5e6b3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:7b:f9,bridge_name='br-int',has_traffic_filtering=True,id=ed3a6f44-e7a4-41b0-9769-71beee125cb1,network=Network(e70b6880-528f-41d8-b154-89eabc02efdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped3a6f44-e7')
Apr 14 01:43:13 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-ff542a40-f1d9-4b3c-b100-bb8403d5e6b3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Deleting instance files /opt/stack/data/nova/instances/f1d10278-cf24-4fde-86eb-664ba86cbd8f_del
Apr 14 01:43:13 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-ff542a40-f1d9-4b3c-b100-bb8403d5e6b3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Deletion of /opt/stack/data/nova/instances/f1d10278-cf24-4fde-86eb-664ba86cbd8f_del complete
Apr 14 01:43:13 user nova-compute[71498]: INFO nova.compute.manager [None req-ff542a40-f1d9-4b3c-b100-bb8403d5e6b3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 14 01:43:13 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-ff542a40-f1d9-4b3c-b100-bb8403d5e6b3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.434s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] <== connect_volume: return (1435ms) {'type': 'block', 'scsi_wwn': '23063383063363434', 'path': '/dev/sdf'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063383063363434', 'path': '/dev/sdf'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG nova.objects.instance [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lazy-loading 'flavor' on Instance uuid f45130b1-9e83-47a0-b335-a6e74875b79e {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TAEDvFux', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:43:13 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:43:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:43:13 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:43:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:43:13 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:43:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 01:43:13 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:43:13 user nova-compute[71498]:   <source dev="/dev/sdf"/>
Apr 14 01:43:13 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:43:13 user nova-compute[71498]:   <serial>217c01bb-a21b-4ff9-9e57-99dba019914b</serial>
Apr 14 01:43:13 user nova-compute[71498]: </disk>
Apr 14 01:43:13 user nova-compute[71498]:  {{(pid=71498) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[322725c4-a960-4e04-8cde-d08fd8de2485]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:43:13 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0a59f1-b398-43dc-be18-ed7a5ae2a72e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411] added
Apr 14 01:43:13 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d72fa7a-90b1-4df5-ad50-7c3e124f4a88]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0b4f10-2a94-4219-aa3e-e1033cbf0c93]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TAEDvFux {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TAEDvFux" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb4022f-5b21-4b31-8d4a-4f66a6faf627]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TAEDvFux'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e93f5a-6f7d-4bbe-afc7-c69283e579ea]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a73d5d-370c-4666-ae66-2b18fe9144e3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:13 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:13 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:13 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:13 user nova-compute[71498]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b (non-flash)
Apr 14 01:43:13 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:13 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:13 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:13 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:13 user nova-compute[71498]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b (non-flash)
Apr 14 01:43:13 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:43:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:14 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc168653-3636-4779-8240-91611c40ca9f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:14 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411, portal: 172.16.0.220,3260]
Apr 14 01:43:14 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411, portal: 172.16.0.220,3260] successful.
Apr 14 01:43:14 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:14 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf307100-cabc-41f0-a392-89afa3f81095]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:14 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:14 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8e508a-de58-4cb8-b85f-8f39de1dc1e1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:14 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 (non-flash)
Apr 14 01:43:14 user nova-compute[71498]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:14 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:14 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:14 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:14 user nova-compute[71498]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b (non-flash)
Apr 14 01:43:14 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:43:14 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 (non-flash)
Apr 14 01:43:14 user nova-compute[71498]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:14 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:14 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:14 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:14 user nova-compute[71498]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b (non-flash)
Apr 14 01:43:14 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:43:14 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:43:14 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:43:14 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] HCTL ('38', '-', '-', 0) found on session 10 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:43:14 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:43:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.027s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:14 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1658433a-9c34-4d00-918c-acd29080ce7c]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:14 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Searching for a device in session 10 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:43:14 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TAEDvFux', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:43:14 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:43:14 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] No BDM found with device name hda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:43:14 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] No VIF found with MAC fa:16:3e:41:81:59, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:43:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9ef211e4-d203-48f6-9b58-28859ad244eb tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "f45130b1-9e83-47a0-b335-a6e74875b79e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.582s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:14 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:43:14 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Took 1.24 seconds to deallocate network for instance.
Apr 14 01:43:14 user nova-compute[71498]: DEBUG nova.compute.manager [req-a2d5e138-4de6-4929-b6f7-152093cb181f req-e27a0751-500c-4480-bbf0-b709dc5a3936 service nova] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Received event network-vif-deleted-ed3a6f44-e7a4-41b0-9769-71beee125cb1 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:14 user nova-compute[71498]: INFO nova.compute.manager [req-a2d5e138-4de6-4929-b6f7-152093cb181f req-e27a0751-500c-4480-bbf0-b709dc5a3936 service nova] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Neutron deleted interface ed3a6f44-e7a4-41b0-9769-71beee125cb1; detaching it from the instance and deleting it from the info cache
Apr 14 01:43:14 user nova-compute[71498]: DEBUG nova.network.neutron [req-a2d5e138-4de6-4929-b6f7-152093cb181f req-e27a0751-500c-4480-bbf0-b709dc5a3936 service nova] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:43:14 user nova-compute[71498]: DEBUG nova.compute.manager [req-a2d5e138-4de6-4929-b6f7-152093cb181f req-e27a0751-500c-4480-bbf0-b709dc5a3936 service nova] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Detach interface failed, port_id=ed3a6f44-e7a4-41b0-9769-71beee125cb1, reason: Instance f1d10278-cf24-4fde-86eb-664ba86cbd8f could not be found. {{(pid=71498) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 01:43:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ff542a40-f1d9-4b3c-b100-bb8403d5e6b3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ff542a40-f1d9-4b3c-b100-bb8403d5e6b3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "f45130b1-9e83-47a0-b335-a6e74875b79e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "f45130b1-9e83-47a0-b335-a6e74875b79e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:14 user nova-compute[71498]: INFO nova.compute.manager [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Detaching volume 217c01bb-a21b-4ff9-9e57-99dba019914b
Apr 14 01:43:15 user nova-compute[71498]: DEBUG nova.compute.manager [req-b2b5a75a-ca9d-4127-9922-9cb7c336a81b req-ac8688f0-bdee-4051-832a-4180d4298f6e service nova] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Received event network-vif-plugged-ed3a6f44-e7a4-41b0-9769-71beee125cb1 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b2b5a75a-ca9d-4127-9922-9cb7c336a81b req-ac8688f0-bdee-4051-832a-4180d4298f6e service nova] Acquiring lock "f1d10278-cf24-4fde-86eb-664ba86cbd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b2b5a75a-ca9d-4127-9922-9cb7c336a81b req-ac8688f0-bdee-4051-832a-4180d4298f6e service nova] Lock "f1d10278-cf24-4fde-86eb-664ba86cbd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b2b5a75a-ca9d-4127-9922-9cb7c336a81b req-ac8688f0-bdee-4051-832a-4180d4298f6e service nova] Lock "f1d10278-cf24-4fde-86eb-664ba86cbd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG nova.compute.manager [req-b2b5a75a-ca9d-4127-9922-9cb7c336a81b req-ac8688f0-bdee-4051-832a-4180d4298f6e service nova] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] No waiting events found dispatching network-vif-plugged-ed3a6f44-e7a4-41b0-9769-71beee125cb1 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:43:15 user nova-compute[71498]: WARNING nova.compute.manager [req-b2b5a75a-ca9d-4127-9922-9cb7c336a81b req-ac8688f0-bdee-4051-832a-4180d4298f6e service nova] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Received unexpected event network-vif-plugged-ed3a6f44-e7a4-41b0-9769-71beee125cb1 for instance with vm_state deleted and task_state None.
Apr 14 01:43:15 user nova-compute[71498]: INFO nova.virt.block_device [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Attempting to driver detach volume 217c01bb-a21b-4ff9-9e57-99dba019914b from mountpoint /dev/vdb
Apr 14 01:43:15 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-ff542a40-f1d9-4b3c-b100-bb8403d5e6b3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Attempting to detach device vdb from instance f45130b1-9e83-47a0-b335-a6e74875b79e from the persistent domain config. {{(pid=71498) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 01:43:15 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:43:15 user nova-compute[71498]:   <source dev="/dev/sdf"/>
Apr 14 01:43:15 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:43:15 user nova-compute[71498]:   <serial>217c01bb-a21b-4ff9-9e57-99dba019914b</serial>
Apr 14 01:43:15 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 01:43:15 user nova-compute[71498]: </disk>
Apr 14 01:43:15 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-ff542a40-f1d9-4b3c-b100-bb8403d5e6b3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:43:15 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Successfully detached device vdb from instance f45130b1-9e83-47a0-b335-a6e74875b79e from the persistent domain config.
Apr 14 01:43:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f45130b1-9e83-47a0-b335-a6e74875b79e from the live domain config. {{(pid=71498) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 01:43:15 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:43:15 user nova-compute[71498]:   <source dev="/dev/sdf"/>
Apr 14 01:43:15 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:43:15 user nova-compute[71498]:   <serial>217c01bb-a21b-4ff9-9e57-99dba019914b</serial>
Apr 14 01:43:15 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 01:43:15 user nova-compute[71498]: </disk>
Apr 14 01:43:15 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ff542a40-f1d9-4b3c-b100-bb8403d5e6b3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.375s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '26132356465313339', 'path': '/dev/sdg'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132356465313339', 'path': '/dev/sdg'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG nova.objects.instance [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lazy-loading 'flavor' on Instance uuid 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:43:15 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-ff542a40-f1d9-4b3c-b100-bb8403d5e6b3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Deleted allocations for instance f1d10278-cf24-4fde-86eb-664ba86cbd8f
Apr 14 01:43:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 01:43:15 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:43:15 user nova-compute[71498]:   <source dev="/dev/sdg"/>
Apr 14 01:43:15 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:43:15 user nova-compute[71498]:   <serial>7113332c-fb29-4657-be57-be86d245b411</serial>
Apr 14 01:43:15 user nova-compute[71498]: </disk>
Apr 14 01:43:15 user nova-compute[71498]:  {{(pid=71498) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ff542a40-f1d9-4b3c-b100-bb8403d5e6b3 tempest-AttachSCSIVolumeTestJSON-716976075 tempest-AttachSCSIVolumeTestJSON-716976075-project-member] Lock "f1d10278-cf24-4fde-86eb-664ba86cbd8f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.647s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Received event <DeviceRemovedEvent: 1681436595.42695, f45130b1-9e83-47a0-b335-a6e74875b79e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71498) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f45130b1-9e83-47a0-b335-a6e74875b79e {{(pid=71498) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 01:43:15 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Successfully detached device vdb from instance f45130b1-9e83-47a0-b335-a6e74875b79e from the live domain config.
Apr 14 01:43:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YbsqhwAf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:43:15 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:43:15 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a18dcf8-24a4-4d9c-b7ea-b4a1d0956846]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:43:15 user nova-compute[71498]: No targets found.
Apr 14 01:43:15 user nova-compute[71498]: iSNS:
Apr 14 01:43:15 user nova-compute[71498]: No targets found.
Apr 14 01:43:15 user nova-compute[71498]: STATIC:
Apr 14 01:43:15 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02
Apr 14 01:43:15 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:15 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:15 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53
Apr 14 01:43:15 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:15 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:15 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e
Apr 14 01:43:15 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:15 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:15 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b
Apr 14 01:43:15 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:15 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:15 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411
Apr 14 01:43:15 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:15 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:15 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d
Apr 14 01:43:15 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:15 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:15 user nova-compute[71498]: FIRMWARE:
Apr 14 01:43:15 user nova-compute[71498]: No targets found.
Apr 14 01:43:15 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:43:15 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:43:15 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9863985-981b-4cea-8c72-3dbff804b6ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d21ec05-e7c5-4733-a5c9-517272612c06]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 (non-flash)
Apr 14 01:43:15 user nova-compute[71498]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:15 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:15 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:15 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:15 user nova-compute[71498]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b (non-flash)
Apr 14 01:43:15 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 (non-flash)
Apr 14 01:43:15 user nova-compute[71498]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:15 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:15 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:15 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:15 user nova-compute[71498]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b (non-flash)
Apr 14 01:43:15 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51f4508550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b'): ({'sdf'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Removing single pathed devices sdf {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1421414a-ec8f-4e67-8a16-98dfbe6327a1]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[827a416c-9947-4cb3-9bee-86b1d5d54ca5]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Flushing IO for device /dev/sdf {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c72fac8-b215-448d-b397-0ec3f124f1c4]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0309a30-d26d-4c0a-8ec0-72763906ddc4]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] SCSI volumes sdf have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[692c7ca5-14c6-430a-88ee-8616897fc815]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[80116f4f-7fcb-4624-ad30-69a2373f5783]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b, portal: 172.16.0.220,3260]
Apr 14 01:43:15 user nova-compute[71498]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b, portal: 172.16.0.220,3260] successful.
Apr 14 01:43:15 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:217c01bb-a21b-4ff9-9e57-99dba019914b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68b1f34-8e4c-41bf-ad53-712643c3072d]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] <== disconnect_volume: return (329ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] No VIF found with MAC fa:16:3e:17:11:af, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:43:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-6a491f7d-dbe0-40d7-923c-98ba8d2ef666 tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.951s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:16 user nova-compute[71498]: DEBUG nova.objects.instance [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lazy-loading 'flavor' on Instance uuid f45130b1-9e83-47a0-b335-a6e74875b79e {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:43:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8a5aed0e-cd8d-4300-a816-dadb0c9ff1ae tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "f45130b1-9e83-47a0-b335-a6e74875b79e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.657s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Acquiring lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG os_brick.utils [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6197d0f1-80d6-4ffb-a77b-b3b0a697ef54]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1893f9c-5c75-459a-b9d4-a61cadee99de]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[570a7229-f84d-4425-aba1-48f48e079b79]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb07cda-acec-4e27-95c6-6bf3df2a261c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:43:17 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:43:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8548b0-a7b0-4a0a-8bd1-62fd89923c80]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG os_brick.utils [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "interface-f45130b1-9e83-47a0-b335-a6e74875b79e-ade69726-e7ad-4fda-8bd1-b5ca2df4d24f" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "interface-f45130b1-9e83-47a0-b335-a6e74875b79e-ade69726-e7ad-4fda-8bd1-b5ca2df4d24f" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG nova.objects.instance [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lazy-loading 'flavor' on Instance uuid f45130b1-9e83-47a0-b335-a6e74875b79e {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:41:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1373277645',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1373277645',id=7,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUT3ZOn0Mn2ktm54d2qA9xktIMZqL7Q40F6rrStB8sUhSSG/BBymdkGPGHtlWKKsqIfu1Qyxy455mqWjjowlE5hNoX4c7IQemPoagPLG/KJKleE/aVTRO8q8iRe5UAbxg==',key_name='tempest-keypair-658101980',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:41:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='58f0122cc9864fcea660891e2826ca7b',ramdisk_id='',reservation_id='r-svkr1ynm',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-242857735',owner_user_name='tempest-TaggedAttachmentsTest-242857735-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:41:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bada5cdb7704f6b956eb48b3729388d',uuid=f45130b1-9e83-47a0-b335-a6e74875b79e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ade69726-e7ad-4fda-8bd1-b5ca2df4d24f", "address": "fa:16:3e:48:18:8c", "network": {"id": "d7d68554-fe8e-4ca1-9390-0f7412e761b9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1349339291", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "58f0122cc9864fcea660891e2826ca7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade69726-e7", "ovs_interfaceid": "ade69726-e7ad-4fda-8bd1-b5ca2df4d24f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Converting VIF {"id": "ade69726-e7ad-4fda-8bd1-b5ca2df4d24f", "address": "fa:16:3e:48:18:8c", "network": {"id": "d7d68554-fe8e-4ca1-9390-0f7412e761b9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1349339291", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "58f0122cc9864fcea660891e2826ca7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade69726-e7", "ovs_interfaceid": "ade69726-e7ad-4fda-8bd1-b5ca2df4d24f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:18:8c,bridge_name='br-int',has_traffic_filtering=True,id=ade69726-e7ad-4fda-8bd1-b5ca2df4d24f,network=Network(d7d68554-fe8e-4ca1-9390-0f7412e761b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade69726-e7') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:48:18:8c"/><model type="virtio"/><mtu size="1442"/><target dev="tapade69726-e7"/></interface> {{(pid=71498) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:48:18:8c"/><model type="virtio"/><mtu size="1442"/><target dev="tapade69726-e7"/></interface> {{(pid=71498) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Attempting to detach device tapade69726-e7 from instance f45130b1-9e83-47a0-b335-a6e74875b79e from the persistent domain config. {{(pid=71498) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] detach device xml: <interface type="ethernet">
Apr 14 01:43:17 user nova-compute[71498]:   <mac address="fa:16:3e:48:18:8c"/>
Apr 14 01:43:17 user nova-compute[71498]:   <model type="virtio"/>
Apr 14 01:43:17 user nova-compute[71498]:   <mtu size="1442"/>
Apr 14 01:43:17 user nova-compute[71498]:   <target dev="tapade69726-e7"/>
Apr 14 01:43:17 user nova-compute[71498]: </interface>
Apr 14 01:43:17 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:43:17 user nova-compute[71498]: INFO nova.compute.manager [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Swapping volume 7113332c-fb29-4657-be57-be86d245b411 for ddd73274-308f-4d71-9930-9ed144269534
Apr 14 01:43:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:48:18:8c"/><model type="virtio"/><mtu size="1442"/><target dev="tapade69726-e7"/></interface> {{(pid=71498) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:48:18:8c"/><model type="virtio"/><mtu size="1442"/><target dev="tapade69726-e7"/></interface>not found in domain: <domain type='kvm' id='7'>
Apr 14 01:43:17 user nova-compute[71498]:   <name>instance-00000007</name>
Apr 14 01:43:17 user nova-compute[71498]:   <uuid>f45130b1-9e83-47a0-b335-a6e74875b79e</uuid>
Apr 14 01:43:17 user nova-compute[71498]:   <metadata>
Apr 14 01:43:17 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:43:17 user nova-compute[71498]:   <nova:package version="0.0.0"/>
Apr 14 01:43:17 user nova-compute[71498]:   <nova:name>tempest-device-tagging-server-1373277645</nova:name>
Apr 14 01:43:17 user nova-compute[71498]:   <nova:creationTime>2023-04-14 01:43:06</nova:creationTime>
Apr 14 01:43:17 user nova-compute[71498]:   <nova:flavor name="m1.nano">
Apr 14 01:43:17 user nova-compute[71498]:     <nova:memory>128</nova:memory>
Apr 14 01:43:17 user nova-compute[71498]:     <nova:disk>1</nova:disk>
Apr 14 01:43:17 user nova-compute[71498]:     <nova:swap>0</nova:swap>
Apr 14 01:43:17 user nova-compute[71498]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:43:17 user nova-compute[71498]:     <nova:vcpus>1</nova:vcpus>
Apr 14 01:43:17 user nova-compute[71498]:   </nova:flavor>
Apr 14 01:43:17 user nova-compute[71498]:   <nova:owner>
Apr 14 01:43:17 user nova-compute[71498]:     <nova:user uuid="2bada5cdb7704f6b956eb48b3729388d">tempest-TaggedAttachmentsTest-242857735-project-member</nova:user>
Apr 14 01:43:17 user nova-compute[71498]:     <nova:project uuid="58f0122cc9864fcea660891e2826ca7b">tempest-TaggedAttachmentsTest-242857735</nova:project>
Apr 14 01:43:17 user nova-compute[71498]:   </nova:owner>
Apr 14 01:43:17 user nova-compute[71498]:   <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:43:17 user nova-compute[71498]:   <nova:ports>
Apr 14 01:43:17 user nova-compute[71498]:     <nova:port uuid="6762a294-eced-41bd-87c0-ac112e954d3a">
Apr 14 01:43:17 user nova-compute[71498]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 01:43:17 user nova-compute[71498]:     </nova:port>
Apr 14 01:43:17 user nova-compute[71498]:     <nova:port uuid="ade69726-e7ad-4fda-8bd1-b5ca2df4d24f">
Apr 14 01:43:17 user nova-compute[71498]:       <nova:ip type="fixed" address="10.10.10.13" ipVersion="4"/>
Apr 14 01:43:17 user nova-compute[71498]:     </nova:port>
Apr 14 01:43:17 user nova-compute[71498]:   </nova:ports>
Apr 14 01:43:17 user nova-compute[71498]: </nova:instance>
Apr 14 01:43:17 user nova-compute[71498]:   </metadata>
Apr 14 01:43:17 user nova-compute[71498]:   <memory unit='KiB'>131072</memory>
Apr 14 01:43:17 user nova-compute[71498]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 14 01:43:17 user nova-compute[71498]:   <vcpu placement='static'>1</vcpu>
Apr 14 01:43:17 user nova-compute[71498]:   <resource>
Apr 14 01:43:17 user nova-compute[71498]:     <partition>/machine</partition>
Apr 14 01:43:17 user nova-compute[71498]:   </resource>
Apr 14 01:43:17 user nova-compute[71498]:   <sysinfo type='smbios'>
Apr 14 01:43:17 user nova-compute[71498]:     <system>
Apr 14 01:43:17 user nova-compute[71498]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 14 01:43:17 user nova-compute[71498]:       <entry name='product'>OpenStack Nova</entry>
Apr 14 01:43:17 user nova-compute[71498]:       <entry name='version'>0.0.0</entry>
Apr 14 01:43:17 user nova-compute[71498]:       <entry name='serial'>f45130b1-9e83-47a0-b335-a6e74875b79e</entry>
Apr 14 01:43:17 user nova-compute[71498]:       <entry name='uuid'>f45130b1-9e83-47a0-b335-a6e74875b79e</entry>
Apr 14 01:43:17 user nova-compute[71498]:       <entry name='family'>Virtual Machine</entry>
Apr 14 01:43:17 user nova-compute[71498]:     </system>
Apr 14 01:43:17 user nova-compute[71498]:   </sysinfo>
Apr 14 01:43:17 user nova-compute[71498]:   <os>
Apr 14 01:43:17 user nova-compute[71498]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 14 01:43:17 user nova-compute[71498]:     <boot dev='hd'/>
Apr 14 01:43:17 user nova-compute[71498]:     <smbios mode='sysinfo'/>
Apr 14 01:43:17 user nova-compute[71498]:   </os>
Apr 14 01:43:17 user nova-compute[71498]:   <features>
Apr 14 01:43:17 user nova-compute[71498]:     <acpi/>
Apr 14 01:43:17 user nova-compute[71498]:     <apic/>
Apr 14 01:43:17 user nova-compute[71498]:     <vmcoreinfo state='on'/>
Apr 14 01:43:17 user nova-compute[71498]:   </features>
Apr 14 01:43:17 user nova-compute[71498]:   <cpu mode='custom' match='exact' check='full'>
Apr 14 01:43:17 user nova-compute[71498]:     <model fallback='forbid'>Nehalem</model>
Apr 14 01:43:17 user nova-compute[71498]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 14 01:43:17 user nova-compute[71498]:     <feature policy='require' name='vme'/>
Apr 14 01:43:17 user nova-compute[71498]:     <feature policy='require' name='x2apic'/>
Apr 14 01:43:17 user nova-compute[71498]:     <feature policy='require' name='hypervisor'/>
Apr 14 01:43:17 user nova-compute[71498]:   </cpu>
Apr 14 01:43:17 user nova-compute[71498]:   <clock offset='utc'>
Apr 14 01:43:17 user nova-compute[71498]:     <timer name='pit' tickpolicy='delay'/>
Apr 14 01:43:17 user nova-compute[71498]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 14 01:43:17 user nova-compute[71498]:     <timer name='hpet' present='no'/>
Apr 14 01:43:17 user nova-compute[71498]:   </clock>
Apr 14 01:43:17 user nova-compute[71498]:   <on_poweroff>destroy</on_poweroff>
Apr 14 01:43:17 user nova-compute[71498]:   <on_reboot>restart</on_reboot>
Apr 14 01:43:17 user nova-compute[71498]:   <on_crash>destroy</on_crash>
Apr 14 01:43:17 user nova-compute[71498]:   <devices>
Apr 14 01:43:17 user nova-compute[71498]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 01:43:17 user nova-compute[71498]:     <disk type='file' device='disk'>
Apr 14 01:43:17 user nova-compute[71498]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 14 01:43:17 user nova-compute[71498]:       <source file='/opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/disk' index='2'/>
Apr 14 01:43:17 user nova-compute[71498]:       <backingStore type='file' index='3'>
Apr 14 01:43:17 user nova-compute[71498]:         <format type='raw'/>
Apr 14 01:43:17 user nova-compute[71498]:         <source file='/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab'/>
Apr 14 01:43:17 user nova-compute[71498]:         <backingStore/>
Apr 14 01:43:17 user nova-compute[71498]:       </backingStore>
Apr 14 01:43:17 user nova-compute[71498]:       <target dev='vda' bus='virtio'/>
Apr 14 01:43:17 user nova-compute[71498]:       <alias name='virtio-disk0'/>
Apr 14 01:43:17 user nova-compute[71498]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 14 01:43:17 user nova-compute[71498]:     </disk>
Apr 14 01:43:17 user nova-compute[71498]:     <disk type='file' device='cdrom'>
Apr 14 01:43:17 user nova-compute[71498]:       <driver name='qemu' type='raw' cache='none'/>
Apr 14 01:43:17 user nova-compute[71498]:       <source file='/opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/disk.config' index='1'/>
Apr 14 01:43:17 user nova-compute[71498]:       <backingStore/>
Apr 14 01:43:17 user nova-compute[71498]:       <target dev='hda' bus='ide'/>
Apr 14 01:43:17 user nova-compute[71498]:       <readonly/>
Apr 14 01:43:17 user nova-compute[71498]:       <alias name='ide0-0-0'/>
Apr 14 01:43:17 user nova-compute[71498]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 14 01:43:17 user nova-compute[71498]:     </disk>
Apr 14 01:43:17 user nova-compute[71498]:     <controller type='usb' index='0' model='none'>
Apr 14 01:43:17 user nova-compute[71498]:       <alias name='usb'/>
Apr 14 01:43:17 user nova-compute[71498]:     </controller>
Apr 14 01:43:17 user nova-compute[71498]:     <controller type='pci' index='0' model='pci-root'>
Apr 14 01:43:17 user nova-compute[71498]:       <alias name='pci.0'/>
Apr 14 01:43:17 user nova-compute[71498]:     </controller>
Apr 14 01:43:17 user nova-compute[71498]:     <controller type='ide' index='0'>
Apr 14 01:43:17 user nova-compute[71498]:       <alias name='ide'/>
Apr 14 01:43:17 user nova-compute[71498]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 14 01:43:17 user nova-compute[71498]:     </controller>
Apr 14 01:43:17 user nova-compute[71498]:     <interface type='ethernet'>
Apr 14 01:43:17 user nova-compute[71498]:       <mac address='fa:16:3e:41:81:59'/>
Apr 14 01:43:17 user nova-compute[71498]:       <target dev='tap6762a294-ec'/>
Apr 14 01:43:17 user nova-compute[71498]:       <model type='virtio'/>
Apr 14 01:43:17 user nova-compute[71498]:       <mtu size='1442'/>
Apr 14 01:43:17 user nova-compute[71498]:       <alias name='net0'/>
Apr 14 01:43:17 user nova-compute[71498]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 14 01:43:17 user nova-compute[71498]:     </interface>
Apr 14 01:43:17 user nova-compute[71498]:     <interface type='ethernet'>
Apr 14 01:43:17 user nova-compute[71498]:       <mac address='fa:16:3e:48:18:8c'/>
Apr 14 01:43:17 user nova-compute[71498]:       <target dev='tapade69726-e7'/>
Apr 14 01:43:17 user nova-compute[71498]:       <model type='virtio'/>
Apr 14 01:43:17 user nova-compute[71498]:       <mtu size='1442'/>
Apr 14 01:43:17 user nova-compute[71498]:       <alias name='net1'/>
Apr 14 01:43:17 user nova-compute[71498]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Apr 14 01:43:17 user nova-compute[71498]:     </interface>
Apr 14 01:43:17 user nova-compute[71498]:     <serial type='pty'>
Apr 14 01:43:17 user nova-compute[71498]:       <source path='/dev/pts/6'/>
Apr 14 01:43:17 user nova-compute[71498]:       <log file='/opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/console.log' append='off'/>
Apr 14 01:43:17 user nova-compute[71498]:       <target type='isa-serial' port='0'>
Apr 14 01:43:17 user nova-compute[71498]:         <model name='isa-serial'/>
Apr 14 01:43:17 user nova-compute[71498]:       </target>
Apr 14 01:43:17 user nova-compute[71498]:       <alias name='serial0'/>
Apr 14 01:43:17 user nova-compute[71498]:     </serial>
Apr 14 01:43:17 user nova-compute[71498]:     <console type='pty' tty='/dev/pts/6'>
Apr 14 01:43:17 user nova-compute[71498]:       <source path='/dev/pts/6'/>
Apr 14 01:43:17 user nova-compute[71498]:       <log file='/opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/console.log' append='off'/>
Apr 14 01:43:17 user nova-compute[71498]:       <target type='serial' port='0'/>
Apr 14 01:43:17 user nova-compute[71498]:       <alias name='serial0'/>
Apr 14 01:43:17 user nova-compute[71498]:     </console>
Apr 14 01:43:17 user nova-compute[71498]:     <input type='mouse' bus='ps2'>
Apr 14 01:43:17 user nova-compute[71498]:       <alias name='input0'/>
Apr 14 01:43:17 user nova-compute[71498]:     </input>
Apr 14 01:43:17 user nova-compute[71498]:     <input type='keyboard' bus='ps2'>
Apr 14 01:43:17 user nova-compute[71498]:       <alias name='input1'/>
Apr 14 01:43:17 user nova-compute[71498]:     </input>
Apr 14 01:43:17 user nova-compute[71498]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Apr 14 01:43:17 user nova-compute[71498]:       <listen type='address' address='0.0.0.0'/>
Apr 14 01:43:17 user nova-compute[71498]:     </graphics>
Apr 14 01:43:17 user nova-compute[71498]:     <audio id='1' type='none'/>
Apr 14 01:43:17 user nova-compute[71498]:     <video>
Apr 14 01:43:17 user nova-compute[71498]:       <model type='virtio' heads='1' primary='yes'/>
Apr 14 01:43:17 user nova-compute[71498]:       <alias name='video0'/>
Apr 14 01:43:17 user nova-compute[71498]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 14 01:43:17 user nova-compute[71498]:     </video>
Apr 14 01:43:17 user nova-compute[71498]:     <memballoon model='virtio'>
Apr 14 01:43:17 user nova-compute[71498]:       <stats period='10'/>
Apr 14 01:43:17 user nova-compute[71498]:       <alias name='balloon0'/>
Apr 14 01:43:17 user nova-compute[71498]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 14 01:43:17 user nova-compute[71498]:     </memballoon>
Apr 14 01:43:17 user nova-compute[71498]:     <rng model='virtio'>
Apr 14 01:43:17 user nova-compute[71498]:       <backend model='random'>/dev/urandom</backend>
Apr 14 01:43:17 user nova-compute[71498]:       <alias name='rng0'/>
Apr 14 01:43:17 user nova-compute[71498]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 14 01:43:17 user nova-compute[71498]:     </rng>
Apr 14 01:43:17 user nova-compute[71498]:   </devices>
Apr 14 01:43:17 user nova-compute[71498]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 14 01:43:17 user nova-compute[71498]:     <label>libvirt-f45130b1-9e83-47a0-b335-a6e74875b79e</label>
Apr 14 01:43:17 user nova-compute[71498]:     <imagelabel>libvirt-f45130b1-9e83-47a0-b335-a6e74875b79e</imagelabel>
Apr 14 01:43:17 user nova-compute[71498]:   </seclabel>
Apr 14 01:43:17 user nova-compute[71498]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 14 01:43:17 user nova-compute[71498]:     <label>+64055:+108</label>
Apr 14 01:43:17 user nova-compute[71498]:     <imagelabel>+64055:+108</imagelabel>
Apr 14 01:43:17 user nova-compute[71498]:   </seclabel>
Apr 14 01:43:17 user nova-compute[71498]: </domain>
Apr 14 01:43:17 user nova-compute[71498]:  {{(pid=71498) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 14 01:43:17 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Successfully detached device tapade69726-e7 from instance f45130b1-9e83-47a0-b335-a6e74875b79e from the persistent domain config.
Apr 14 01:43:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] (1/8): Attempting to detach device tapade69726-e7 with device alias net1 from instance f45130b1-9e83-47a0-b335-a6e74875b79e from the live domain config. {{(pid=71498) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] detach device xml: <interface type="ethernet">
Apr 14 01:43:17 user nova-compute[71498]:   <mac address="fa:16:3e:48:18:8c"/>
Apr 14 01:43:17 user nova-compute[71498]:   <model type="virtio"/>
Apr 14 01:43:17 user nova-compute[71498]:   <mtu size="1442"/>
Apr 14 01:43:17 user nova-compute[71498]:   <target dev="tapade69726-e7"/>
Apr 14 01:43:17 user nova-compute[71498]: </interface>
Apr 14 01:43:17 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Received event <DeviceRemovedEvent: 1681436597.5488102, f45130b1-9e83-47a0-b335-a6e74875b79e => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71498) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Start waiting for the detach event from libvirt for device tapade69726-e7 with device alias net1 for instance f45130b1-9e83-47a0-b335-a6e74875b79e {{(pid=71498) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:48:18:8c"/><model type="virtio"/><mtu size="1442"/><target dev="tapade69726-e7"/></interface> {{(pid=71498) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:48:18:8c"/><model type="virtio"/><mtu size="1442"/><target dev="tapade69726-e7"/></interface>not found in domain: <domain type='kvm' id='7'>
Apr 14 01:43:17 user nova-compute[71498]:   <name>instance-00000007</name>
Apr 14 01:43:17 user nova-compute[71498]:   <uuid>f45130b1-9e83-47a0-b335-a6e74875b79e</uuid>
Apr 14 01:43:17 user nova-compute[71498]:   <metadata>
Apr 14 01:43:17 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:43:17 user nova-compute[71498]:   <nova:package version="0.0.0"/>
Apr 14 01:43:17 user nova-compute[71498]:   <nova:name>tempest-device-tagging-server-1373277645</nova:name>
Apr 14 01:43:17 user nova-compute[71498]:   <nova:creationTime>2023-04-14 01:43:06</nova:creationTime>
Apr 14 01:43:17 user nova-compute[71498]:   <nova:flavor name="m1.nano">
Apr 14 01:43:17 user nova-compute[71498]:     <nova:memory>128</nova:memory>
Apr 14 01:43:17 user nova-compute[71498]:     <nova:disk>1</nova:disk>
Apr 14 01:43:17 user nova-compute[71498]:     <nova:swap>0</nova:swap>
Apr 14 01:43:17 user nova-compute[71498]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:43:17 user nova-compute[71498]:     <nova:vcpus>1</nova:vcpus>
Apr 14 01:43:17 user nova-compute[71498]:   </nova:flavor>
Apr 14 01:43:17 user nova-compute[71498]:   <nova:owner>
Apr 14 01:43:17 user nova-compute[71498]:     <nova:user uuid="2bada5cdb7704f6b956eb48b3729388d">tempest-TaggedAttachmentsTest-242857735-project-member</nova:user>
Apr 14 01:43:17 user nova-compute[71498]:     <nova:project uuid="58f0122cc9864fcea660891e2826ca7b">tempest-TaggedAttachmentsTest-242857735</nova:project>
Apr 14 01:43:17 user nova-compute[71498]:   </nova:owner>
Apr 14 01:43:17 user nova-compute[71498]:   <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:43:17 user nova-compute[71498]:   <nova:ports>
Apr 14 01:43:17 user nova-compute[71498]:     <nova:port uuid="6762a294-eced-41bd-87c0-ac112e954d3a">
Apr 14 01:43:17 user nova-compute[71498]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 01:43:17 user nova-compute[71498]:     </nova:port>
Apr 14 01:43:17 user nova-compute[71498]:     <nova:port uuid="ade69726-e7ad-4fda-8bd1-b5ca2df4d24f">
Apr 14 01:43:17 user nova-compute[71498]:       <nova:ip type="fixed" address="10.10.10.13" ipVersion="4"/>
Apr 14 01:43:17 user nova-compute[71498]:     </nova:port>
Apr 14 01:43:17 user nova-compute[71498]:   </nova:ports>
Apr 14 01:43:17 user nova-compute[71498]: </nova:instance>
Apr 14 01:43:17 user nova-compute[71498]:   </metadata>
Apr 14 01:43:17 user nova-compute[71498]:   <memory unit='KiB'>131072</memory>
Apr 14 01:43:17 user nova-compute[71498]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 14 01:43:17 user nova-compute[71498]:   <vcpu placement='static'>1</vcpu>
Apr 14 01:43:17 user nova-compute[71498]:   <resource>
Apr 14 01:43:17 user nova-compute[71498]:     <partition>/machine</partition>
Apr 14 01:43:17 user nova-compute[71498]:   </resource>
Apr 14 01:43:17 user nova-compute[71498]:   <sysinfo type='smbios'>
Apr 14 01:43:17 user nova-compute[71498]:     <system>
Apr 14 01:43:17 user nova-compute[71498]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 14 01:43:17 user nova-compute[71498]:       <entry name='product'>OpenStack Nova</entry>
Apr 14 01:43:17 user nova-compute[71498]:       <entry name='version'>0.0.0</entry>
Apr 14 01:43:17 user nova-compute[71498]:       <entry name='serial'>f45130b1-9e83-47a0-b335-a6e74875b79e</entry>
Apr 14 01:43:17 user nova-compute[71498]:       <entry name='uuid'>f45130b1-9e83-47a0-b335-a6e74875b79e</entry>
Apr 14 01:43:17 user nova-compute[71498]:       <entry name='family'>Virtual Machine</entry>
Apr 14 01:43:17 user nova-compute[71498]:     </system>
Apr 14 01:43:17 user nova-compute[71498]:   </sysinfo>
Apr 14 01:43:17 user nova-compute[71498]:   <os>
Apr 14 01:43:17 user nova-compute[71498]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 14 01:43:17 user nova-compute[71498]:     <boot dev='hd'/>
Apr 14 01:43:17 user nova-compute[71498]:     <smbios mode='sysinfo'/>
Apr 14 01:43:17 user nova-compute[71498]:   </os>
Apr 14 01:43:17 user nova-compute[71498]:   <features>
Apr 14 01:43:17 user nova-compute[71498]:     <acpi/>
Apr 14 01:43:17 user nova-compute[71498]:     <apic/>
Apr 14 01:43:17 user nova-compute[71498]:     <vmcoreinfo state='on'/>
Apr 14 01:43:17 user nova-compute[71498]:   </features>
Apr 14 01:43:17 user nova-compute[71498]:   <cpu mode='custom' match='exact' check='full'>
Apr 14 01:43:17 user nova-compute[71498]:     <model fallback='forbid'>Nehalem</model>
Apr 14 01:43:17 user nova-compute[71498]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 14 01:43:17 user nova-compute[71498]:     <feature policy='require' name='vme'/>
Apr 14 01:43:17 user nova-compute[71498]:     <feature policy='require' name='x2apic'/>
Apr 14 01:43:17 user nova-compute[71498]:     <feature policy='require' name='hypervisor'/>
Apr 14 01:43:17 user nova-compute[71498]:   </cpu>
Apr 14 01:43:17 user nova-compute[71498]:   <clock offset='utc'>
Apr 14 01:43:17 user nova-compute[71498]:     <timer name='pit' tickpolicy='delay'/>
Apr 14 01:43:17 user nova-compute[71498]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 14 01:43:17 user nova-compute[71498]:     <timer name='hpet' present='no'/>
Apr 14 01:43:17 user nova-compute[71498]:   </clock>
Apr 14 01:43:17 user nova-compute[71498]:   <on_poweroff>destroy</on_poweroff>
Apr 14 01:43:17 user nova-compute[71498]:   <on_reboot>restart</on_reboot>
Apr 14 01:43:17 user nova-compute[71498]:   <on_crash>destroy</on_crash>
Apr 14 01:43:17 user nova-compute[71498]:   <devices>
Apr 14 01:43:17 user nova-compute[71498]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 01:43:17 user nova-compute[71498]:     <disk type='file' device='disk'>
Apr 14 01:43:17 user nova-compute[71498]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 14 01:43:17 user nova-compute[71498]:       <source file='/opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/disk' index='2'/>
Apr 14 01:43:17 user nova-compute[71498]:       <backingStore type='file' index='3'>
Apr 14 01:43:17 user nova-compute[71498]:         <format type='raw'/>
Apr 14 01:43:17 user nova-compute[71498]:         <source file='/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab'/>
Apr 14 01:43:17 user nova-compute[71498]:         <backingStore/>
Apr 14 01:43:17 user nova-compute[71498]:       </backingStore>
Apr 14 01:43:17 user nova-compute[71498]:       <target dev='vda' bus='virtio'/>
Apr 14 01:43:17 user nova-compute[71498]:       <alias name='virtio-disk0'/>
Apr 14 01:43:17 user nova-compute[71498]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 14 01:43:17 user nova-compute[71498]:     </disk>
Apr 14 01:43:17 user nova-compute[71498]:     <disk type='file' device='cdrom'>
Apr 14 01:43:17 user nova-compute[71498]:       <driver name='qemu' type='raw' cache='none'/>
Apr 14 01:43:17 user nova-compute[71498]:       <source file='/opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/disk.config' index='1'/>
Apr 14 01:43:17 user nova-compute[71498]:       <backingStore/>
Apr 14 01:43:17 user nova-compute[71498]:       <target dev='hda' bus='ide'/>
Apr 14 01:43:17 user nova-compute[71498]:       <readonly/>
Apr 14 01:43:17 user nova-compute[71498]:       <alias name='ide0-0-0'/>
Apr 14 01:43:17 user nova-compute[71498]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 14 01:43:17 user nova-compute[71498]:     </disk>
Apr 14 01:43:17 user nova-compute[71498]:     <controller type='usb' index='0' model='none'>
Apr 14 01:43:17 user nova-compute[71498]:       <alias name='usb'/>
Apr 14 01:43:17 user nova-compute[71498]:     </controller>
Apr 14 01:43:17 user nova-compute[71498]:     <controller type='pci' index='0' model='pci-root'>
Apr 14 01:43:17 user nova-compute[71498]:       <alias name='pci.0'/>
Apr 14 01:43:17 user nova-compute[71498]:     </controller>
Apr 14 01:43:17 user nova-compute[71498]:     <controller type='ide' index='0'>
Apr 14 01:43:17 user nova-compute[71498]:       <alias name='ide'/>
Apr 14 01:43:17 user nova-compute[71498]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 14 01:43:17 user nova-compute[71498]:     </controller>
Apr 14 01:43:17 user nova-compute[71498]:     <interface type='ethernet'>
Apr 14 01:43:17 user nova-compute[71498]:       <mac address='fa:16:3e:41:81:59'/>
Apr 14 01:43:17 user nova-compute[71498]:       <target dev='tap6762a294-ec'/>
Apr 14 01:43:17 user nova-compute[71498]:       <model type='virtio'/>
Apr 14 01:43:17 user nova-compute[71498]:       <mtu size='1442'/>
Apr 14 01:43:17 user nova-compute[71498]:       <alias name='net0'/>
Apr 14 01:43:17 user nova-compute[71498]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 14 01:43:17 user nova-compute[71498]:     </interface>
Apr 14 01:43:17 user nova-compute[71498]:     <serial type='pty'>
Apr 14 01:43:17 user nova-compute[71498]:       <source path='/dev/pts/6'/>
Apr 14 01:43:17 user nova-compute[71498]:       <log file='/opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/console.log' append='off'/>
Apr 14 01:43:17 user nova-compute[71498]:       <target type='isa-serial' port='0'>
Apr 14 01:43:17 user nova-compute[71498]:         <model name='isa-serial'/>
Apr 14 01:43:17 user nova-compute[71498]:       </target>
Apr 14 01:43:17 user nova-compute[71498]:       <alias name='serial0'/>
Apr 14 01:43:17 user nova-compute[71498]:     </serial>
Apr 14 01:43:17 user nova-compute[71498]:     <console type='pty' tty='/dev/pts/6'>
Apr 14 01:43:17 user nova-compute[71498]:       <source path='/dev/pts/6'/>
Apr 14 01:43:17 user nova-compute[71498]:       <log file='/opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/console.log' append='off'/>
Apr 14 01:43:17 user nova-compute[71498]:       <target type='serial' port='0'/>
Apr 14 01:43:17 user nova-compute[71498]:       <alias name='serial0'/>
Apr 14 01:43:17 user nova-compute[71498]:     </console>
Apr 14 01:43:17 user nova-compute[71498]:     <input type='mouse' bus='ps2'>
Apr 14 01:43:17 user nova-compute[71498]:       <alias name='input0'/>
Apr 14 01:43:17 user nova-compute[71498]:     </input>
Apr 14 01:43:17 user nova-compute[71498]:     <input type='keyboard' bus='ps2'>
Apr 14 01:43:17 user nova-compute[71498]:       <alias name='input1'/>
Apr 14 01:43:17 user nova-compute[71498]:     </input>
Apr 14 01:43:17 user nova-compute[71498]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Apr 14 01:43:17 user nova-compute[71498]:       <listen type='address' address='0.0.0.0'/>
Apr 14 01:43:17 user nova-compute[71498]:     </graphics>
Apr 14 01:43:17 user nova-compute[71498]:     <audio id='1' type='none'/>
Apr 14 01:43:17 user nova-compute[71498]:     <video>
Apr 14 01:43:17 user nova-compute[71498]:       <model type='virtio' heads='1' primary='yes'/>
Apr 14 01:43:17 user nova-compute[71498]:       <alias name='video0'/>
Apr 14 01:43:17 user nova-compute[71498]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 14 01:43:17 user nova-compute[71498]:     </video>
Apr 14 01:43:17 user nova-compute[71498]:     <memballoon model='virtio'>
Apr 14 01:43:17 user nova-compute[71498]:       <stats period='10'/>
Apr 14 01:43:17 user nova-compute[71498]:       <alias name='balloon0'/>
Apr 14 01:43:17 user nova-compute[71498]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 14 01:43:17 user nova-compute[71498]:     </memballoon>
Apr 14 01:43:17 user nova-compute[71498]:     <rng model='virtio'>
Apr 14 01:43:17 user nova-compute[71498]:       <backend model='random'>/dev/urandom</backend>
Apr 14 01:43:17 user nova-compute[71498]:       <alias name='rng0'/>
Apr 14 01:43:17 user nova-compute[71498]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 14 01:43:17 user nova-compute[71498]:     </rng>
Apr 14 01:43:17 user nova-compute[71498]:   </devices>
Apr 14 01:43:17 user nova-compute[71498]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 14 01:43:17 user nova-compute[71498]:     <label>libvirt-f45130b1-9e83-47a0-b335-a6e74875b79e</label>
Apr 14 01:43:17 user nova-compute[71498]:     <imagelabel>libvirt-f45130b1-9e83-47a0-b335-a6e74875b79e</imagelabel>
Apr 14 01:43:17 user nova-compute[71498]:   </seclabel>
Apr 14 01:43:17 user nova-compute[71498]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 14 01:43:17 user nova-compute[71498]:     <label>+64055:+108</label>
Apr 14 01:43:17 user nova-compute[71498]:     <imagelabel>+64055:+108</imagelabel>
Apr 14 01:43:17 user nova-compute[71498]:   </seclabel>
Apr 14 01:43:17 user nova-compute[71498]: </domain>
Apr 14 01:43:17 user nova-compute[71498]:  {{(pid=71498) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 14 01:43:17 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Successfully detached device tapade69726-e7 from instance f45130b1-9e83-47a0-b335-a6e74875b79e from the live domain config.
Apr 14 01:43:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:41:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1373277645',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1373277645',id=7,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUT3ZOn0Mn2ktm54d2qA9xktIMZqL7Q40F6rrStB8sUhSSG/BBymdkGPGHtlWKKsqIfu1Qyxy455mqWjjowlE5hNoX4c7IQemPoagPLG/KJKleE/aVTRO8q8iRe5UAbxg==',key_name='tempest-keypair-658101980',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:41:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='58f0122cc9864fcea660891e2826ca7b',ramdisk_id='',reservation_id='r-svkr1ynm',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-242857735',owner_user_name='tempest-TaggedAttachmentsTest-242857735-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:41:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bada5cdb7704f6b956eb48b3729388d',uuid=f45130b1-9e83-47a0-b335-a6e74875b79e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ade69726-e7ad-4fda-8bd1-b5ca2df4d24f", "address": "fa:16:3e:48:18:8c", "network": {"id": "d7d68554-fe8e-4ca1-9390-0f7412e761b9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1349339291", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "58f0122cc9864fcea660891e2826ca7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade69726-e7", "ovs_interfaceid": "ade69726-e7ad-4fda-8bd1-b5ca2df4d24f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Converting VIF {"id": "ade69726-e7ad-4fda-8bd1-b5ca2df4d24f", "address": "fa:16:3e:48:18:8c", "network": {"id": "d7d68554-fe8e-4ca1-9390-0f7412e761b9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1349339291", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "58f0122cc9864fcea660891e2826ca7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade69726-e7", "ovs_interfaceid": "ade69726-e7ad-4fda-8bd1-b5ca2df4d24f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:18:8c,bridge_name='br-int',has_traffic_filtering=True,id=ade69726-e7ad-4fda-8bd1-b5ca2df4d24f,network=Network(d7d68554-fe8e-4ca1-9390-0f7412e761b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade69726-e7') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG os_vif [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:18:8c,bridge_name='br-int',has_traffic_filtering=True,id=ade69726-e7ad-4fda-8bd1-b5ca2df4d24f,network=Network(d7d68554-fe8e-4ca1-9390-0f7412e761b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade69726-e7') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapade69726-e7, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:17 user nova-compute[71498]: INFO os_vif [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:18:8c,bridge_name='br-int',has_traffic_filtering=True,id=ade69726-e7ad-4fda-8bd1-b5ca2df4d24f,network=Network(d7d68554-fe8e-4ca1-9390-0f7412e761b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade69726-e7')
Apr 14 01:43:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:43:17 user nova-compute[71498]:   <nova:package version="0.0.0"/>
Apr 14 01:43:17 user nova-compute[71498]:   <nova:name>tempest-device-tagging-server-1373277645</nova:name>
Apr 14 01:43:17 user nova-compute[71498]:   <nova:creationTime>2023-04-14 01:43:17</nova:creationTime>
Apr 14 01:43:17 user nova-compute[71498]:   <nova:flavor name="m1.nano">
Apr 14 01:43:17 user nova-compute[71498]:     <nova:memory>128</nova:memory>
Apr 14 01:43:17 user nova-compute[71498]:     <nova:disk>1</nova:disk>
Apr 14 01:43:17 user nova-compute[71498]:     <nova:swap>0</nova:swap>
Apr 14 01:43:17 user nova-compute[71498]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:43:17 user nova-compute[71498]:     <nova:vcpus>1</nova:vcpus>
Apr 14 01:43:17 user nova-compute[71498]:   </nova:flavor>
Apr 14 01:43:17 user nova-compute[71498]:   <nova:owner>
Apr 14 01:43:17 user nova-compute[71498]:     <nova:user uuid="2bada5cdb7704f6b956eb48b3729388d">tempest-TaggedAttachmentsTest-242857735-project-member</nova:user>
Apr 14 01:43:17 user nova-compute[71498]:     <nova:project uuid="58f0122cc9864fcea660891e2826ca7b">tempest-TaggedAttachmentsTest-242857735</nova:project>
Apr 14 01:43:17 user nova-compute[71498]:   </nova:owner>
Apr 14 01:43:17 user nova-compute[71498]:   <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:43:17 user nova-compute[71498]:   <nova:ports>
Apr 14 01:43:17 user nova-compute[71498]:     <nova:port uuid="6762a294-eced-41bd-87c0-ac112e954d3a">
Apr 14 01:43:17 user nova-compute[71498]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 01:43:17 user nova-compute[71498]:     </nova:port>
Apr 14 01:43:17 user nova-compute[71498]:   </nova:ports>
Apr 14 01:43:17 user nova-compute[71498]: </nova:instance>
Apr 14 01:43:17 user nova-compute[71498]:  {{(pid=71498) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG nova.compute.manager [req-3f00fdfb-2bc4-4e4b-b071-e47e9a376548 req-6a56a5c6-01b1-434e-8a20-9088176b78f6 service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Received event network-vif-unplugged-ade69726-e7ad-4fda-8bd1-b5ca2df4d24f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3f00fdfb-2bc4-4e4b-b071-e47e9a376548 req-6a56a5c6-01b1-434e-8a20-9088176b78f6 service nova] Acquiring lock "f45130b1-9e83-47a0-b335-a6e74875b79e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3f00fdfb-2bc4-4e4b-b071-e47e9a376548 req-6a56a5c6-01b1-434e-8a20-9088176b78f6 service nova] Lock "f45130b1-9e83-47a0-b335-a6e74875b79e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3f00fdfb-2bc4-4e4b-b071-e47e9a376548 req-6a56a5c6-01b1-434e-8a20-9088176b78f6 service nova] Lock "f45130b1-9e83-47a0-b335-a6e74875b79e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:17 user nova-compute[71498]: DEBUG nova.compute.manager [req-3f00fdfb-2bc4-4e4b-b071-e47e9a376548 req-6a56a5c6-01b1-434e-8a20-9088176b78f6 service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] No waiting events found dispatching network-vif-unplugged-ade69726-e7ad-4fda-8bd1-b5ca2df4d24f {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:43:17 user nova-compute[71498]: WARNING nova.compute.manager [req-3f00fdfb-2bc4-4e4b-b071-e47e9a376548 req-6a56a5c6-01b1-434e-8a20-9088176b78f6 service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Received unexpected event network-vif-unplugged-ade69726-e7ad-4fda-8bd1-b5ca2df4d24f for instance with vm_state active and task_state None.
Apr 14 01:43:18 user nova-compute[71498]: DEBUG nova.compute.manager [req-e7abafa9-3e26-4cec-b430-f7217dc109ea req-0da05198-1256-4824-8618-b488e9923c8c service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Received event network-vif-deleted-ade69726-e7ad-4fda-8bd1-b5ca2df4d24f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:18 user nova-compute[71498]: INFO nova.compute.manager [req-e7abafa9-3e26-4cec-b430-f7217dc109ea req-0da05198-1256-4824-8618-b488e9923c8c service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Neutron deleted interface ade69726-e7ad-4fda-8bd1-b5ca2df4d24f; detaching it from the instance and deleting it from the info cache
Apr 14 01:43:18 user nova-compute[71498]: DEBUG nova.network.neutron [req-e7abafa9-3e26-4cec-b430-f7217dc109ea req-0da05198-1256-4824-8618-b488e9923c8c service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Updating instance_info_cache with network_info: [{"id": "6762a294-eced-41bd-87c0-ac112e954d3a", "address": "fa:16:3e:41:81:59", "network": {"id": "c7acaa49-fce0-41b5-8dd6-d5ef02e27e23", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1296085277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58f0122cc9864fcea660891e2826ca7b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6762a294-ec", "ovs_interfaceid": "6762a294-eced-41bd-87c0-ac112e954d3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:43:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "refresh_cache-f45130b1-9e83-47a0-b335-a6e74875b79e" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:43:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquired lock "refresh_cache-f45130b1-9e83-47a0-b335-a6e74875b79e" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:43:18 user nova-compute[71498]: DEBUG nova.network.neutron [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:43:18 user nova-compute[71498]: DEBUG nova.objects.instance [req-e7abafa9-3e26-4cec-b430-f7217dc109ea req-0da05198-1256-4824-8618-b488e9923c8c service nova] Lazy-loading 'system_metadata' on Instance uuid f45130b1-9e83-47a0-b335-a6e74875b79e {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:43:18 user nova-compute[71498]: DEBUG nova.objects.instance [req-e7abafa9-3e26-4cec-b430-f7217dc109ea req-0da05198-1256-4824-8618-b488e9923c8c service nova] Lazy-loading 'flavor' on Instance uuid f45130b1-9e83-47a0-b335-a6e74875b79e {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:43:18 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [req-e7abafa9-3e26-4cec-b430-f7217dc109ea req-0da05198-1256-4824-8618-b488e9923c8c service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:41:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1373277645',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1373277645',id=7,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUT3ZOn0Mn2ktm54d2qA9xktIMZqL7Q40F6rrStB8sUhSSG/BBymdkGPGHtlWKKsqIfu1Qyxy455mqWjjowlE5hNoX4c7IQemPoagPLG/KJKleE/aVTRO8q8iRe5UAbxg==',key_name='tempest-keypair-658101980',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:41:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='58f0122cc9864fcea660891e2826ca7b',ramdisk_id='',reservation_id='r-svkr1ynm',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-242857735',owner_user_name='tempest-TaggedAttachmentsTest-242857735-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:41:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bada5cdb7704f6b956eb48b3729388d',uuid=f45130b1-9e83-47a0-b335-a6e74875b79e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ade69726-e7ad-4fda-8bd1-b5ca2df4d24f", "address": "fa:16:3e:48:18:8c", "network": {"id": "d7d68554-fe8e-4ca1-9390-0f7412e761b9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1349339291", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "58f0122cc9864fcea660891e2826ca7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade69726-e7", "ovs_interfaceid": "ade69726-e7ad-4fda-8bd1-b5ca2df4d24f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:43:18 user nova-compute[71498]: DEBUG nova.network.os_vif_util [req-e7abafa9-3e26-4cec-b430-f7217dc109ea req-0da05198-1256-4824-8618-b488e9923c8c service nova] Converting VIF {"id": "ade69726-e7ad-4fda-8bd1-b5ca2df4d24f", "address": "fa:16:3e:48:18:8c", "network": {"id": "d7d68554-fe8e-4ca1-9390-0f7412e761b9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1349339291", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "58f0122cc9864fcea660891e2826ca7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade69726-e7", "ovs_interfaceid": "ade69726-e7ad-4fda-8bd1-b5ca2df4d24f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:43:18 user nova-compute[71498]: DEBUG nova.network.os_vif_util [req-e7abafa9-3e26-4cec-b430-f7217dc109ea req-0da05198-1256-4824-8618-b488e9923c8c service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:18:8c,bridge_name='br-int',has_traffic_filtering=True,id=ade69726-e7ad-4fda-8bd1-b5ca2df4d24f,network=Network(d7d68554-fe8e-4ca1-9390-0f7412e761b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade69726-e7') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:43:18 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [req-e7abafa9-3e26-4cec-b430-f7217dc109ea req-0da05198-1256-4824-8618-b488e9923c8c service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:48:18:8c"/><model type="virtio"/><mtu size="1442"/><target dev="tapade69726-e7"/></interface> {{(pid=71498) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 01:43:18 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [req-e7abafa9-3e26-4cec-b430-f7217dc109ea req-0da05198-1256-4824-8618-b488e9923c8c service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:48:18:8c"/><model type="virtio"/><mtu size="1442"/><target dev="tapade69726-e7"/></interface>not found in domain: <domain type='kvm' id='7'>
Apr 14 01:43:18 user nova-compute[71498]:   <name>instance-00000007</name>
Apr 14 01:43:18 user nova-compute[71498]:   <uuid>f45130b1-9e83-47a0-b335-a6e74875b79e</uuid>
Apr 14 01:43:18 user nova-compute[71498]:   <metadata>
Apr 14 01:43:18 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:43:18 user nova-compute[71498]:   <nova:package version="0.0.0"/>
Apr 14 01:43:18 user nova-compute[71498]:   <nova:name>tempest-device-tagging-server-1373277645</nova:name>
Apr 14 01:43:18 user nova-compute[71498]:   <nova:creationTime>2023-04-14 01:43:17</nova:creationTime>
Apr 14 01:43:18 user nova-compute[71498]:   <nova:flavor name="m1.nano">
Apr 14 01:43:18 user nova-compute[71498]:     <nova:memory>128</nova:memory>
Apr 14 01:43:18 user nova-compute[71498]:     <nova:disk>1</nova:disk>
Apr 14 01:43:18 user nova-compute[71498]:     <nova:swap>0</nova:swap>
Apr 14 01:43:18 user nova-compute[71498]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:43:18 user nova-compute[71498]:     <nova:vcpus>1</nova:vcpus>
Apr 14 01:43:18 user nova-compute[71498]:   </nova:flavor>
Apr 14 01:43:18 user nova-compute[71498]:   <nova:owner>
Apr 14 01:43:18 user nova-compute[71498]:     <nova:user uuid="2bada5cdb7704f6b956eb48b3729388d">tempest-TaggedAttachmentsTest-242857735-project-member</nova:user>
Apr 14 01:43:18 user nova-compute[71498]:     <nova:project uuid="58f0122cc9864fcea660891e2826ca7b">tempest-TaggedAttachmentsTest-242857735</nova:project>
Apr 14 01:43:18 user nova-compute[71498]:   </nova:owner>
Apr 14 01:43:18 user nova-compute[71498]:   <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:43:18 user nova-compute[71498]:   <nova:ports>
Apr 14 01:43:18 user nova-compute[71498]:     <nova:port uuid="6762a294-eced-41bd-87c0-ac112e954d3a">
Apr 14 01:43:18 user nova-compute[71498]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 01:43:18 user nova-compute[71498]:     </nova:port>
Apr 14 01:43:18 user nova-compute[71498]:   </nova:ports>
Apr 14 01:43:18 user nova-compute[71498]: </nova:instance>
Apr 14 01:43:18 user nova-compute[71498]:   </metadata>
Apr 14 01:43:18 user nova-compute[71498]:   <memory unit='KiB'>131072</memory>
Apr 14 01:43:18 user nova-compute[71498]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 14 01:43:18 user nova-compute[71498]:   <vcpu placement='static'>1</vcpu>
Apr 14 01:43:18 user nova-compute[71498]:   <resource>
Apr 14 01:43:18 user nova-compute[71498]:     <partition>/machine</partition>
Apr 14 01:43:18 user nova-compute[71498]:   </resource>
Apr 14 01:43:18 user nova-compute[71498]:   <sysinfo type='smbios'>
Apr 14 01:43:18 user nova-compute[71498]:     <system>
Apr 14 01:43:18 user nova-compute[71498]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 14 01:43:18 user nova-compute[71498]:       <entry name='product'>OpenStack Nova</entry>
Apr 14 01:43:18 user nova-compute[71498]:       <entry name='version'>0.0.0</entry>
Apr 14 01:43:18 user nova-compute[71498]:       <entry name='serial'>f45130b1-9e83-47a0-b335-a6e74875b79e</entry>
Apr 14 01:43:18 user nova-compute[71498]:       <entry name='uuid'>f45130b1-9e83-47a0-b335-a6e74875b79e</entry>
Apr 14 01:43:18 user nova-compute[71498]:       <entry name='family'>Virtual Machine</entry>
Apr 14 01:43:18 user nova-compute[71498]:     </system>
Apr 14 01:43:18 user nova-compute[71498]:   </sysinfo>
Apr 14 01:43:18 user nova-compute[71498]:   <os>
Apr 14 01:43:18 user nova-compute[71498]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 14 01:43:18 user nova-compute[71498]:     <boot dev='hd'/>
Apr 14 01:43:18 user nova-compute[71498]:     <smbios mode='sysinfo'/>
Apr 14 01:43:18 user nova-compute[71498]:   </os>
Apr 14 01:43:18 user nova-compute[71498]:   <features>
Apr 14 01:43:18 user nova-compute[71498]:     <acpi/>
Apr 14 01:43:18 user nova-compute[71498]:     <apic/>
Apr 14 01:43:18 user nova-compute[71498]:     <vmcoreinfo state='on'/>
Apr 14 01:43:18 user nova-compute[71498]:   </features>
Apr 14 01:43:18 user nova-compute[71498]:   <cpu mode='custom' match='exact' check='full'>
Apr 14 01:43:18 user nova-compute[71498]:     <model fallback='forbid'>Nehalem</model>
Apr 14 01:43:18 user nova-compute[71498]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 14 01:43:18 user nova-compute[71498]:     <feature policy='require' name='vme'/>
Apr 14 01:43:18 user nova-compute[71498]:     <feature policy='require' name='x2apic'/>
Apr 14 01:43:18 user nova-compute[71498]:     <feature policy='require' name='hypervisor'/>
Apr 14 01:43:18 user nova-compute[71498]:   </cpu>
Apr 14 01:43:18 user nova-compute[71498]:   <clock offset='utc'>
Apr 14 01:43:18 user nova-compute[71498]:     <timer name='pit' tickpolicy='delay'/>
Apr 14 01:43:18 user nova-compute[71498]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 14 01:43:18 user nova-compute[71498]:     <timer name='hpet' present='no'/>
Apr 14 01:43:18 user nova-compute[71498]:   </clock>
Apr 14 01:43:18 user nova-compute[71498]:   <on_poweroff>destroy</on_poweroff>
Apr 14 01:43:18 user nova-compute[71498]:   <on_reboot>restart</on_reboot>
Apr 14 01:43:18 user nova-compute[71498]:   <on_crash>destroy</on_crash>
Apr 14 01:43:18 user nova-compute[71498]:   <devices>
Apr 14 01:43:18 user nova-compute[71498]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 01:43:18 user nova-compute[71498]:     <disk type='file' device='disk'>
Apr 14 01:43:18 user nova-compute[71498]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 14 01:43:18 user nova-compute[71498]:       <source file='/opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/disk' index='2'/>
Apr 14 01:43:18 user nova-compute[71498]:       <backingStore type='file' index='3'>
Apr 14 01:43:18 user nova-compute[71498]:         <format type='raw'/>
Apr 14 01:43:18 user nova-compute[71498]:         <source file='/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab'/>
Apr 14 01:43:18 user nova-compute[71498]:         <backingStore/>
Apr 14 01:43:18 user nova-compute[71498]:       </backingStore>
Apr 14 01:43:18 user nova-compute[71498]:       <target dev='vda' bus='virtio'/>
Apr 14 01:43:18 user nova-compute[71498]:       <alias name='virtio-disk0'/>
Apr 14 01:43:18 user nova-compute[71498]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 14 01:43:18 user nova-compute[71498]:     </disk>
Apr 14 01:43:18 user nova-compute[71498]:     <disk type='file' device='cdrom'>
Apr 14 01:43:18 user nova-compute[71498]:       <driver name='qemu' type='raw' cache='none'/>
Apr 14 01:43:18 user nova-compute[71498]:       <source file='/opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/disk.config' index='1'/>
Apr 14 01:43:18 user nova-compute[71498]:       <backingStore/>
Apr 14 01:43:18 user nova-compute[71498]:       <target dev='hda' bus='ide'/>
Apr 14 01:43:18 user nova-compute[71498]:       <readonly/>
Apr 14 01:43:18 user nova-compute[71498]:       <alias name='ide0-0-0'/>
Apr 14 01:43:18 user nova-compute[71498]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 14 01:43:18 user nova-compute[71498]:     </disk>
Apr 14 01:43:18 user nova-compute[71498]:     <controller type='usb' index='0' model='none'>
Apr 14 01:43:18 user nova-compute[71498]:       <alias name='usb'/>
Apr 14 01:43:18 user nova-compute[71498]:     </controller>
Apr 14 01:43:18 user nova-compute[71498]:     <controller type='pci' index='0' model='pci-root'>
Apr 14 01:43:18 user nova-compute[71498]:       <alias name='pci.0'/>
Apr 14 01:43:18 user nova-compute[71498]:     </controller>
Apr 14 01:43:18 user nova-compute[71498]:     <controller type='ide' index='0'>
Apr 14 01:43:18 user nova-compute[71498]:       <alias name='ide'/>
Apr 14 01:43:18 user nova-compute[71498]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 14 01:43:18 user nova-compute[71498]:     </controller>
Apr 14 01:43:18 user nova-compute[71498]:     <interface type='ethernet'>
Apr 14 01:43:18 user nova-compute[71498]:       <mac address='fa:16:3e:41:81:59'/>
Apr 14 01:43:18 user nova-compute[71498]:       <target dev='tap6762a294-ec'/>
Apr 14 01:43:18 user nova-compute[71498]:       <model type='virtio'/>
Apr 14 01:43:18 user nova-compute[71498]:       <mtu size='1442'/>
Apr 14 01:43:18 user nova-compute[71498]:       <alias name='net0'/>
Apr 14 01:43:18 user nova-compute[71498]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 14 01:43:18 user nova-compute[71498]:     </interface>
Apr 14 01:43:18 user nova-compute[71498]:     <serial type='pty'>
Apr 14 01:43:18 user nova-compute[71498]:       <source path='/dev/pts/6'/>
Apr 14 01:43:18 user nova-compute[71498]:       <log file='/opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/console.log' append='off'/>
Apr 14 01:43:18 user nova-compute[71498]:       <target type='isa-serial' port='0'>
Apr 14 01:43:18 user nova-compute[71498]:         <model name='isa-serial'/>
Apr 14 01:43:18 user nova-compute[71498]:       </target>
Apr 14 01:43:18 user nova-compute[71498]:       <alias name='serial0'/>
Apr 14 01:43:18 user nova-compute[71498]:     </serial>
Apr 14 01:43:18 user nova-compute[71498]:     <console type='pty' tty='/dev/pts/6'>
Apr 14 01:43:18 user nova-compute[71498]:       <source path='/dev/pts/6'/>
Apr 14 01:43:18 user nova-compute[71498]:       <log file='/opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/console.log' append='off'/>
Apr 14 01:43:18 user nova-compute[71498]:       <target type='serial' port='0'/>
Apr 14 01:43:18 user nova-compute[71498]:       <alias name='serial0'/>
Apr 14 01:43:18 user nova-compute[71498]:     </console>
Apr 14 01:43:18 user nova-compute[71498]:     <input type='mouse' bus='ps2'>
Apr 14 01:43:18 user nova-compute[71498]:       <alias name='input0'/>
Apr 14 01:43:18 user nova-compute[71498]:     </input>
Apr 14 01:43:18 user nova-compute[71498]:     <input type='keyboard' bus='ps2'>
Apr 14 01:43:18 user nova-compute[71498]:       <alias name='input1'/>
Apr 14 01:43:18 user nova-compute[71498]:     </input>
Apr 14 01:43:18 user nova-compute[71498]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Apr 14 01:43:18 user nova-compute[71498]:       <listen type='address' address='0.0.0.0'/>
Apr 14 01:43:18 user nova-compute[71498]:     </graphics>
Apr 14 01:43:18 user nova-compute[71498]:     <audio id='1' type='none'/>
Apr 14 01:43:18 user nova-compute[71498]:     <video>
Apr 14 01:43:18 user nova-compute[71498]:       <model type='virtio' heads='1' primary='yes'/>
Apr 14 01:43:18 user nova-compute[71498]:       <alias name='video0'/>
Apr 14 01:43:18 user nova-compute[71498]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 14 01:43:18 user nova-compute[71498]:     </video>
Apr 14 01:43:18 user nova-compute[71498]:     <memballoon model='virtio'>
Apr 14 01:43:18 user nova-compute[71498]:       <stats period='10'/>
Apr 14 01:43:18 user nova-compute[71498]:       <alias name='balloon0'/>
Apr 14 01:43:18 user nova-compute[71498]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 14 01:43:18 user nova-compute[71498]:     </memballoon>
Apr 14 01:43:18 user nova-compute[71498]:     <rng model='virtio'>
Apr 14 01:43:18 user nova-compute[71498]:       <backend model='random'>/dev/urandom</backend>
Apr 14 01:43:18 user nova-compute[71498]:       <alias name='rng0'/>
Apr 14 01:43:18 user nova-compute[71498]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 14 01:43:18 user nova-compute[71498]:     </rng>
Apr 14 01:43:18 user nova-compute[71498]:   </devices>
Apr 14 01:43:18 user nova-compute[71498]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 14 01:43:18 user nova-compute[71498]:     <label>libvirt-f45130b1-9e83-47a0-b335-a6e74875b79e</label>
Apr 14 01:43:18 user nova-compute[71498]:     <imagelabel>libvirt-f45130b1-9e83-47a0-b335-a6e74875b79e</imagelabel>
Apr 14 01:43:18 user nova-compute[71498]:   </seclabel>
Apr 14 01:43:18 user nova-compute[71498]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 14 01:43:18 user nova-compute[71498]:     <label>+64055:+108</label>
Apr 14 01:43:18 user nova-compute[71498]:     <imagelabel>+64055:+108</imagelabel>
Apr 14 01:43:18 user nova-compute[71498]:   </seclabel>
Apr 14 01:43:18 user nova-compute[71498]: </domain>
Apr 14 01:43:18 user nova-compute[71498]:  {{(pid=71498) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 14 01:43:18 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [req-e7abafa9-3e26-4cec-b430-f7217dc109ea req-0da05198-1256-4824-8618-b488e9923c8c service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:48:18:8c"/><model type="virtio"/><mtu size="1442"/><target dev="tapade69726-e7"/></interface> {{(pid=71498) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 01:43:18 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [req-e7abafa9-3e26-4cec-b430-f7217dc109ea req-0da05198-1256-4824-8618-b488e9923c8c service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:48:18:8c"/><model type="virtio"/><mtu size="1442"/><target dev="tapade69726-e7"/></interface>not found in domain: <domain type='kvm' id='7'>
Apr 14 01:43:18 user nova-compute[71498]:   <name>instance-00000007</name>
Apr 14 01:43:18 user nova-compute[71498]:   <uuid>f45130b1-9e83-47a0-b335-a6e74875b79e</uuid>
Apr 14 01:43:18 user nova-compute[71498]:   <metadata>
Apr 14 01:43:18 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:43:18 user nova-compute[71498]:   <nova:package version="0.0.0"/>
Apr 14 01:43:18 user nova-compute[71498]:   <nova:name>tempest-device-tagging-server-1373277645</nova:name>
Apr 14 01:43:18 user nova-compute[71498]:   <nova:creationTime>2023-04-14 01:43:17</nova:creationTime>
Apr 14 01:43:18 user nova-compute[71498]:   <nova:flavor name="m1.nano">
Apr 14 01:43:18 user nova-compute[71498]:     <nova:memory>128</nova:memory>
Apr 14 01:43:18 user nova-compute[71498]:     <nova:disk>1</nova:disk>
Apr 14 01:43:18 user nova-compute[71498]:     <nova:swap>0</nova:swap>
Apr 14 01:43:18 user nova-compute[71498]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:43:18 user nova-compute[71498]:     <nova:vcpus>1</nova:vcpus>
Apr 14 01:43:18 user nova-compute[71498]:   </nova:flavor>
Apr 14 01:43:18 user nova-compute[71498]:   <nova:owner>
Apr 14 01:43:18 user nova-compute[71498]:     <nova:user uuid="2bada5cdb7704f6b956eb48b3729388d">tempest-TaggedAttachmentsTest-242857735-project-member</nova:user>
Apr 14 01:43:18 user nova-compute[71498]:     <nova:project uuid="58f0122cc9864fcea660891e2826ca7b">tempest-TaggedAttachmentsTest-242857735</nova:project>
Apr 14 01:43:18 user nova-compute[71498]:   </nova:owner>
Apr 14 01:43:18 user nova-compute[71498]:   <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:43:18 user nova-compute[71498]:   <nova:ports>
Apr 14 01:43:18 user nova-compute[71498]:     <nova:port uuid="6762a294-eced-41bd-87c0-ac112e954d3a">
Apr 14 01:43:18 user nova-compute[71498]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 01:43:18 user nova-compute[71498]:     </nova:port>
Apr 14 01:43:18 user nova-compute[71498]:   </nova:ports>
Apr 14 01:43:18 user nova-compute[71498]: </nova:instance>
Apr 14 01:43:18 user nova-compute[71498]:   </metadata>
Apr 14 01:43:18 user nova-compute[71498]:   <memory unit='KiB'>131072</memory>
Apr 14 01:43:18 user nova-compute[71498]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 14 01:43:18 user nova-compute[71498]:   <vcpu placement='static'>1</vcpu>
Apr 14 01:43:18 user nova-compute[71498]:   <resource>
Apr 14 01:43:18 user nova-compute[71498]:     <partition>/machine</partition>
Apr 14 01:43:18 user nova-compute[71498]:   </resource>
Apr 14 01:43:18 user nova-compute[71498]:   <sysinfo type='smbios'>
Apr 14 01:43:18 user nova-compute[71498]:     <system>
Apr 14 01:43:18 user nova-compute[71498]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 14 01:43:18 user nova-compute[71498]:       <entry name='product'>OpenStack Nova</entry>
Apr 14 01:43:18 user nova-compute[71498]:       <entry name='version'>0.0.0</entry>
Apr 14 01:43:18 user nova-compute[71498]:       <entry name='serial'>f45130b1-9e83-47a0-b335-a6e74875b79e</entry>
Apr 14 01:43:18 user nova-compute[71498]:       <entry name='uuid'>f45130b1-9e83-47a0-b335-a6e74875b79e</entry>
Apr 14 01:43:18 user nova-compute[71498]:       <entry name='family'>Virtual Machine</entry>
Apr 14 01:43:18 user nova-compute[71498]:     </system>
Apr 14 01:43:18 user nova-compute[71498]:   </sysinfo>
Apr 14 01:43:18 user nova-compute[71498]:   <os>
Apr 14 01:43:18 user nova-compute[71498]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 14 01:43:18 user nova-compute[71498]:     <boot dev='hd'/>
Apr 14 01:43:18 user nova-compute[71498]:     <smbios mode='sysinfo'/>
Apr 14 01:43:18 user nova-compute[71498]:   </os>
Apr 14 01:43:18 user nova-compute[71498]:   <features>
Apr 14 01:43:18 user nova-compute[71498]:     <acpi/>
Apr 14 01:43:18 user nova-compute[71498]:     <apic/>
Apr 14 01:43:18 user nova-compute[71498]:     <vmcoreinfo state='on'/>
Apr 14 01:43:18 user nova-compute[71498]:   </features>
Apr 14 01:43:18 user nova-compute[71498]:   <cpu mode='custom' match='exact' check='full'>
Apr 14 01:43:18 user nova-compute[71498]:     <model fallback='forbid'>Nehalem</model>
Apr 14 01:43:18 user nova-compute[71498]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 14 01:43:18 user nova-compute[71498]:     <feature policy='require' name='vme'/>
Apr 14 01:43:18 user nova-compute[71498]:     <feature policy='require' name='x2apic'/>
Apr 14 01:43:18 user nova-compute[71498]:     <feature policy='require' name='hypervisor'/>
Apr 14 01:43:18 user nova-compute[71498]:   </cpu>
Apr 14 01:43:18 user nova-compute[71498]:   <clock offset='utc'>
Apr 14 01:43:18 user nova-compute[71498]:     <timer name='pit' tickpolicy='delay'/>
Apr 14 01:43:18 user nova-compute[71498]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 14 01:43:18 user nova-compute[71498]:     <timer name='hpet' present='no'/>
Apr 14 01:43:18 user nova-compute[71498]:   </clock>
Apr 14 01:43:18 user nova-compute[71498]:   <on_poweroff>destroy</on_poweroff>
Apr 14 01:43:18 user nova-compute[71498]:   <on_reboot>restart</on_reboot>
Apr 14 01:43:18 user nova-compute[71498]:   <on_crash>destroy</on_crash>
Apr 14 01:43:18 user nova-compute[71498]:   <devices>
Apr 14 01:43:18 user nova-compute[71498]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 01:43:18 user nova-compute[71498]:     <disk type='file' device='disk'>
Apr 14 01:43:18 user nova-compute[71498]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 14 01:43:18 user nova-compute[71498]:       <source file='/opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/disk' index='2'/>
Apr 14 01:43:18 user nova-compute[71498]:       <backingStore type='file' index='3'>
Apr 14 01:43:18 user nova-compute[71498]:         <format type='raw'/>
Apr 14 01:43:18 user nova-compute[71498]:         <source file='/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab'/>
Apr 14 01:43:18 user nova-compute[71498]:         <backingStore/>
Apr 14 01:43:18 user nova-compute[71498]:       </backingStore>
Apr 14 01:43:18 user nova-compute[71498]:       <target dev='vda' bus='virtio'/>
Apr 14 01:43:18 user nova-compute[71498]:       <alias name='virtio-disk0'/>
Apr 14 01:43:18 user nova-compute[71498]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 14 01:43:18 user nova-compute[71498]:     </disk>
Apr 14 01:43:18 user nova-compute[71498]:     <disk type='file' device='cdrom'>
Apr 14 01:43:18 user nova-compute[71498]:       <driver name='qemu' type='raw' cache='none'/>
Apr 14 01:43:18 user nova-compute[71498]:       <source file='/opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/disk.config' index='1'/>
Apr 14 01:43:18 user nova-compute[71498]:       <backingStore/>
Apr 14 01:43:18 user nova-compute[71498]:       <target dev='hda' bus='ide'/>
Apr 14 01:43:18 user nova-compute[71498]:       <readonly/>
Apr 14 01:43:18 user nova-compute[71498]:       <alias name='ide0-0-0'/>
Apr 14 01:43:18 user nova-compute[71498]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 14 01:43:18 user nova-compute[71498]:     </disk>
Apr 14 01:43:18 user nova-compute[71498]:     <controller type='usb' index='0' model='none'>
Apr 14 01:43:18 user nova-compute[71498]:       <alias name='usb'/>
Apr 14 01:43:18 user nova-compute[71498]:     </controller>
Apr 14 01:43:18 user nova-compute[71498]:     <controller type='pci' index='0' model='pci-root'>
Apr 14 01:43:18 user nova-compute[71498]:       <alias name='pci.0'/>
Apr 14 01:43:18 user nova-compute[71498]:     </controller>
Apr 14 01:43:18 user nova-compute[71498]:     <controller type='ide' index='0'>
Apr 14 01:43:18 user nova-compute[71498]:       <alias name='ide'/>
Apr 14 01:43:18 user nova-compute[71498]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 14 01:43:18 user nova-compute[71498]:     </controller>
Apr 14 01:43:18 user nova-compute[71498]:     <interface type='ethernet'>
Apr 14 01:43:18 user nova-compute[71498]:       <mac address='fa:16:3e:41:81:59'/>
Apr 14 01:43:18 user nova-compute[71498]:       <target dev='tap6762a294-ec'/>
Apr 14 01:43:18 user nova-compute[71498]:       <model type='virtio'/>
Apr 14 01:43:18 user nova-compute[71498]:       <mtu size='1442'/>
Apr 14 01:43:18 user nova-compute[71498]:       <alias name='net0'/>
Apr 14 01:43:18 user nova-compute[71498]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 14 01:43:18 user nova-compute[71498]:     </interface>
Apr 14 01:43:18 user nova-compute[71498]:     <serial type='pty'>
Apr 14 01:43:18 user nova-compute[71498]:       <source path='/dev/pts/6'/>
Apr 14 01:43:18 user nova-compute[71498]:       <log file='/opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/console.log' append='off'/>
Apr 14 01:43:18 user nova-compute[71498]:       <target type='isa-serial' port='0'>
Apr 14 01:43:18 user nova-compute[71498]:         <model name='isa-serial'/>
Apr 14 01:43:18 user nova-compute[71498]:       </target>
Apr 14 01:43:18 user nova-compute[71498]:       <alias name='serial0'/>
Apr 14 01:43:18 user nova-compute[71498]:     </serial>
Apr 14 01:43:18 user nova-compute[71498]:     <console type='pty' tty='/dev/pts/6'>
Apr 14 01:43:18 user nova-compute[71498]:       <source path='/dev/pts/6'/>
Apr 14 01:43:18 user nova-compute[71498]:       <log file='/opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/console.log' append='off'/>
Apr 14 01:43:18 user nova-compute[71498]:       <target type='serial' port='0'/>
Apr 14 01:43:18 user nova-compute[71498]:       <alias name='serial0'/>
Apr 14 01:43:18 user nova-compute[71498]:     </console>
Apr 14 01:43:18 user nova-compute[71498]:     <input type='mouse' bus='ps2'>
Apr 14 01:43:18 user nova-compute[71498]:       <alias name='input0'/>
Apr 14 01:43:18 user nova-compute[71498]:     </input>
Apr 14 01:43:18 user nova-compute[71498]:     <input type='keyboard' bus='ps2'>
Apr 14 01:43:18 user nova-compute[71498]:       <alias name='input1'/>
Apr 14 01:43:18 user nova-compute[71498]:     </input>
Apr 14 01:43:18 user nova-compute[71498]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Apr 14 01:43:18 user nova-compute[71498]:       <listen type='address' address='0.0.0.0'/>
Apr 14 01:43:18 user nova-compute[71498]:     </graphics>
Apr 14 01:43:18 user nova-compute[71498]:     <audio id='1' type='none'/>
Apr 14 01:43:18 user nova-compute[71498]:     <video>
Apr 14 01:43:18 user nova-compute[71498]:       <model type='virtio' heads='1' primary='yes'/>
Apr 14 01:43:18 user nova-compute[71498]:       <alias name='video0'/>
Apr 14 01:43:18 user nova-compute[71498]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 14 01:43:18 user nova-compute[71498]:     </video>
Apr 14 01:43:18 user nova-compute[71498]:     <memballoon model='virtio'>
Apr 14 01:43:18 user nova-compute[71498]:       <stats period='10'/>
Apr 14 01:43:18 user nova-compute[71498]:       <alias name='balloon0'/>
Apr 14 01:43:18 user nova-compute[71498]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 14 01:43:18 user nova-compute[71498]:     </memballoon>
Apr 14 01:43:18 user nova-compute[71498]:     <rng model='virtio'>
Apr 14 01:43:18 user nova-compute[71498]:       <backend model='random'>/dev/urandom</backend>
Apr 14 01:43:18 user nova-compute[71498]:       <alias name='rng0'/>
Apr 14 01:43:18 user nova-compute[71498]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 14 01:43:18 user nova-compute[71498]:     </rng>
Apr 14 01:43:18 user nova-compute[71498]:   </devices>
Apr 14 01:43:18 user nova-compute[71498]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 14 01:43:18 user nova-compute[71498]:     <label>libvirt-f45130b1-9e83-47a0-b335-a6e74875b79e</label>
Apr 14 01:43:18 user nova-compute[71498]:     <imagelabel>libvirt-f45130b1-9e83-47a0-b335-a6e74875b79e</imagelabel>
Apr 14 01:43:18 user nova-compute[71498]:   </seclabel>
Apr 14 01:43:18 user nova-compute[71498]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 14 01:43:18 user nova-compute[71498]:     <label>+64055:+108</label>
Apr 14 01:43:18 user nova-compute[71498]:     <imagelabel>+64055:+108</imagelabel>
Apr 14 01:43:18 user nova-compute[71498]:   </seclabel>
Apr 14 01:43:18 user nova-compute[71498]: </domain>
Apr 14 01:43:18 user nova-compute[71498]:  {{(pid=71498) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 14 01:43:18 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [req-e7abafa9-3e26-4cec-b430-f7217dc109ea req-0da05198-1256-4824-8618-b488e9923c8c service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Detaching interface fa:16:3e:48:18:8c failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapade69726-e7' not found.
Apr 14 01:43:18 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [req-e7abafa9-3e26-4cec-b430-f7217dc109ea req-0da05198-1256-4824-8618-b488e9923c8c service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:41:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1373277645',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1373277645',id=7,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUT3ZOn0Mn2ktm54d2qA9xktIMZqL7Q40F6rrStB8sUhSSG/BBymdkGPGHtlWKKsqIfu1Qyxy455mqWjjowlE5hNoX4c7IQemPoagPLG/KJKleE/aVTRO8q8iRe5UAbxg==',key_name='tempest-keypair-658101980',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:41:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='58f0122cc9864fcea660891e2826ca7b',ramdisk_id='',reservation_id='r-svkr1ynm',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-242857735',owner_user_name='tempest-TaggedAttachmentsTest-242857735-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:41:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bada5cdb7704f6b956eb48b3729388d',uuid=f45130b1-9e83-47a0-b335-a6e74875b79e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ade69726-e7ad-4fda-8bd1-b5ca2df4d24f", "address": "fa:16:3e:48:18:8c", "network": {"id": "d7d68554-fe8e-4ca1-9390-0f7412e761b9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1349339291", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "58f0122cc9864fcea660891e2826ca7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade69726-e7", "ovs_interfaceid": "ade69726-e7ad-4fda-8bd1-b5ca2df4d24f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:43:18 user nova-compute[71498]: DEBUG nova.network.os_vif_util [req-e7abafa9-3e26-4cec-b430-f7217dc109ea req-0da05198-1256-4824-8618-b488e9923c8c service nova] Converting VIF {"id": "ade69726-e7ad-4fda-8bd1-b5ca2df4d24f", "address": "fa:16:3e:48:18:8c", "network": {"id": "d7d68554-fe8e-4ca1-9390-0f7412e761b9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1349339291", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "58f0122cc9864fcea660891e2826ca7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade69726-e7", "ovs_interfaceid": "ade69726-e7ad-4fda-8bd1-b5ca2df4d24f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:43:18 user nova-compute[71498]: DEBUG nova.network.os_vif_util [req-e7abafa9-3e26-4cec-b430-f7217dc109ea req-0da05198-1256-4824-8618-b488e9923c8c service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:18:8c,bridge_name='br-int',has_traffic_filtering=True,id=ade69726-e7ad-4fda-8bd1-b5ca2df4d24f,network=Network(d7d68554-fe8e-4ca1-9390-0f7412e761b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade69726-e7') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:43:18 user nova-compute[71498]: DEBUG os_vif [req-e7abafa9-3e26-4cec-b430-f7217dc109ea req-0da05198-1256-4824-8618-b488e9923c8c service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:18:8c,bridge_name='br-int',has_traffic_filtering=True,id=ade69726-e7ad-4fda-8bd1-b5ca2df4d24f,network=Network(d7d68554-fe8e-4ca1-9390-0f7412e761b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade69726-e7') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:43:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapade69726-e7, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:43:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:43:18 user nova-compute[71498]: INFO os_vif [req-e7abafa9-3e26-4cec-b430-f7217dc109ea req-0da05198-1256-4824-8618-b488e9923c8c service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:18:8c,bridge_name='br-int',has_traffic_filtering=True,id=ade69726-e7ad-4fda-8bd1-b5ca2df4d24f,network=Network(d7d68554-fe8e-4ca1-9390-0f7412e761b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade69726-e7')
Apr 14 01:43:18 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [req-e7abafa9-3e26-4cec-b430-f7217dc109ea req-0da05198-1256-4824-8618-b488e9923c8c service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:43:18 user nova-compute[71498]:   <nova:package version="0.0.0"/>
Apr 14 01:43:18 user nova-compute[71498]:   <nova:name>tempest-device-tagging-server-1373277645</nova:name>
Apr 14 01:43:18 user nova-compute[71498]:   <nova:creationTime>2023-04-14 01:43:18</nova:creationTime>
Apr 14 01:43:18 user nova-compute[71498]:   <nova:flavor name="m1.nano">
Apr 14 01:43:18 user nova-compute[71498]:     <nova:memory>128</nova:memory>
Apr 14 01:43:18 user nova-compute[71498]:     <nova:disk>1</nova:disk>
Apr 14 01:43:18 user nova-compute[71498]:     <nova:swap>0</nova:swap>
Apr 14 01:43:18 user nova-compute[71498]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:43:18 user nova-compute[71498]:     <nova:vcpus>1</nova:vcpus>
Apr 14 01:43:18 user nova-compute[71498]:   </nova:flavor>
Apr 14 01:43:18 user nova-compute[71498]:   <nova:owner>
Apr 14 01:43:18 user nova-compute[71498]:     <nova:user uuid="2bada5cdb7704f6b956eb48b3729388d">tempest-TaggedAttachmentsTest-242857735-project-member</nova:user>
Apr 14 01:43:18 user nova-compute[71498]:     <nova:project uuid="58f0122cc9864fcea660891e2826ca7b">tempest-TaggedAttachmentsTest-242857735</nova:project>
Apr 14 01:43:18 user nova-compute[71498]:   </nova:owner>
Apr 14 01:43:18 user nova-compute[71498]:   <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:43:18 user nova-compute[71498]:   <nova:ports>
Apr 14 01:43:18 user nova-compute[71498]:     <nova:port uuid="6762a294-eced-41bd-87c0-ac112e954d3a">
Apr 14 01:43:18 user nova-compute[71498]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 01:43:18 user nova-compute[71498]:     </nova:port>
Apr 14 01:43:18 user nova-compute[71498]:   </nova:ports>
Apr 14 01:43:18 user nova-compute[71498]: </nova:instance>
Apr 14 01:43:18 user nova-compute[71498]:  {{(pid=71498) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 14 01:43:18 user nova-compute[71498]: DEBUG nova.network.neutron [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Updating instance_info_cache with network_info: [{"id": "6762a294-eced-41bd-87c0-ac112e954d3a", "address": "fa:16:3e:41:81:59", "network": {"id": "c7acaa49-fce0-41b5-8dd6-d5ef02e27e23", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1296085277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58f0122cc9864fcea660891e2826ca7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6762a294-ec", "ovs_interfaceid": "6762a294-eced-41bd-87c0-ac112e954d3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:43:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Releasing lock "refresh_cache-f45130b1-9e83-47a0-b335-a6e74875b79e" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:43:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4538fa31-f1d6-40ac-930f-5c6c9ffb755c tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "interface-f45130b1-9e83-47a0-b335-a6e74875b79e-ade69726-e7ad-4fda-8bd1-b5ca2df4d24f" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.540s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:19 user nova-compute[71498]: DEBUG nova.compute.manager [req-d288ac59-3373-48f1-a7c0-759e4b19214b req-793c71cb-2b5b-4379-ae70-2eab6e3b1505 service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Received event network-vif-plugged-ade69726-e7ad-4fda-8bd1-b5ca2df4d24f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d288ac59-3373-48f1-a7c0-759e4b19214b req-793c71cb-2b5b-4379-ae70-2eab6e3b1505 service nova] Acquiring lock "f45130b1-9e83-47a0-b335-a6e74875b79e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d288ac59-3373-48f1-a7c0-759e4b19214b req-793c71cb-2b5b-4379-ae70-2eab6e3b1505 service nova] Lock "f45130b1-9e83-47a0-b335-a6e74875b79e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d288ac59-3373-48f1-a7c0-759e4b19214b req-793c71cb-2b5b-4379-ae70-2eab6e3b1505 service nova] Lock "f45130b1-9e83-47a0-b335-a6e74875b79e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:19 user nova-compute[71498]: DEBUG nova.compute.manager [req-d288ac59-3373-48f1-a7c0-759e4b19214b req-793c71cb-2b5b-4379-ae70-2eab6e3b1505 service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] No waiting events found dispatching network-vif-plugged-ade69726-e7ad-4fda-8bd1-b5ca2df4d24f {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:43:19 user nova-compute[71498]: WARNING nova.compute.manager [req-d288ac59-3373-48f1-a7c0-759e4b19214b req-793c71cb-2b5b-4379-ae70-2eab6e3b1505 service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Received unexpected event network-vif-plugged-ade69726-e7ad-4fda-8bd1-b5ca2df4d24f for instance with vm_state active and task_state None.
Apr 14 01:43:21 user nova-compute[71498]: DEBUG nova.compute.manager [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awmUAnKe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3decf8d9-7bb3-4395-a8b2-91c8dcf1880c', 'attached_at': '', 'detached_at': '', 'volume_id': 'ddd73274-308f-4d71-9930-9ed144269534', 'serial': 'ddd73274-308f-4d71-9930-9ed144269534'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TAEDvFux', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '3decf8d9-7bb3-4395-a8b2-91c8dcf1880c', 'attached_at': '', 'detached_at': '', 'volume_id': '7113332c-fb29-4657-be57-be86d245b411', 'serial'} {{(pid=71498) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awmUAnKe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:43:21 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:43:21 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:43:21 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:43:21 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:43:21 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:43:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ab60f0-4eac-4f03-961d-09df0f85c18f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:43:21 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d768e5c-c45d-445e-a2f9-11f73d3d7a1a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534] added
Apr 14 01:43:21 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c86546-c21b-4cae-8cf0-38b9511b9473]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[239a34ae-fa19-4b45-a710-e4c2611425d2]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v awmUAnKe {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v awmUAnKe" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2079d7-0dbd-4e4d-b135-e3f78952e7a1]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'awmUAnKe'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2edb0d1-f316-48ca-8cb6-6bc6bad8ed9e]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1833786-cd71-4e0d-8ff8-10df4764885e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 (non-flash)
Apr 14 01:43:21 user nova-compute[71498]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:21 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:21 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:21 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:21 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 (non-flash)
Apr 14 01:43:21 user nova-compute[71498]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:21 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:21 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:21 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:21 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1312a7be-9d95-45c6-bd65-b0801172149a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534, portal: 172.16.0.220,3260]
Apr 14 01:43:21 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534, portal: 172.16.0.220,3260] successful.
Apr 14 01:43:21 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7701fa3a-acc3-4a4a-90e6-b8e91824c896]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76f5928-48c4-441a-8dcb-c771334fba52]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 (non-flash)
Apr 14 01:43:21 user nova-compute[71498]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 (non-flash)
Apr 14 01:43:21 user nova-compute[71498]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:21 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:21 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:21 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:21 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 (non-flash)
Apr 14 01:43:21 user nova-compute[71498]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 (non-flash)
Apr 14 01:43:21 user nova-compute[71498]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:21 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:21 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:21 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:21 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] HCTL ('37', '-', '-', 0) found on session 11 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e459201-380e-4e75-9358-7a8bd0d70c57]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:21 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Searching for a device in session 11 and hctl ['37', '*', '*', 0] yield: None {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:43:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:22 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Searching for a device in session 11 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:43:22 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awmUAnKe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:43:22 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:43:22 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26330643436633761', 'path': '/dev/sdf'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:43:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330643436633761', 'path': '/dev/sdf'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:43:22 user nova-compute[71498]: DEBUG nova.objects.instance [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Lazy-loading 'flavor' on Instance uuid 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:43:23 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] COPY block job progress, current cursor: 8388608 final cursor: 1073741824 {{(pid=71498) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 01:43:23 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] COPY block job progress, current cursor: 175112192 final cursor: 1073741824 {{(pid=71498) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 01:43:24 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] COPY block job progress, current cursor: 347078656 final cursor: 1073741824 {{(pid=71498) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 01:43:24 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] COPY block job progress, current cursor: 500170752 final cursor: 1073741824 {{(pid=71498) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 01:43:25 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] COPY block job progress, current cursor: 653262848 final cursor: 1073741824 {{(pid=71498) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 01:43:25 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] COPY block job progress, current cursor: 811597824 final cursor: 1073741824 {{(pid=71498) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 01:43:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] COPY block job progress, current cursor: 978321408 final cursor: 1073741824 {{(pid=71498) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 01:43:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71498) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TAEDvFux', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:43:27 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:43:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b9502a-ea70-48f1-b9f9-8f2cebd4ff13]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:43:27 user nova-compute[71498]: No targets found.
Apr 14 01:43:27 user nova-compute[71498]: iSNS:
Apr 14 01:43:27 user nova-compute[71498]: No targets found.
Apr 14 01:43:27 user nova-compute[71498]: STATIC:
Apr 14 01:43:27 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02
Apr 14 01:43:27 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:27 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:27 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53
Apr 14 01:43:27 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:27 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:27 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e
Apr 14 01:43:27 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:27 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:27 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534
Apr 14 01:43:27 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:27 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:27 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411
Apr 14 01:43:27 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:27 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:27 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d
Apr 14 01:43:27 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:27 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:27 user nova-compute[71498]: FIRMWARE:
Apr 14 01:43:27 user nova-compute[71498]: No targets found.
Apr 14 01:43:27 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:43:27 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:43:27 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc7af16-5a4f-4865-adb4-55503784e610]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5efdfbe-4127-461f-81c3-87139b1355d2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 (non-flash)
Apr 14 01:43:27 user nova-compute[71498]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 (non-flash)
Apr 14 01:43:27 user nova-compute[71498]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:27 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:27 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:27 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:27 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 (non-flash)
Apr 14 01:43:27 user nova-compute[71498]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 (non-flash)
Apr 14 01:43:27 user nova-compute[71498]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:27 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:27 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:27 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:27 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51f43ba950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411'): ({'sdg'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Removing single pathed devices sdg {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[592dd4b7-2222-42bf-b199-97916ce3d021]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6beb29e1-c022-4ad4-9f14-c7434df3aeda]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Flushing IO for device /dev/sdg {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f2e063-f5d2-492e-b770-89de9aaecda7]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.041s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8ff25e-6666-4e63-bfb2-286e66419c40]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] SCSI volumes sdg have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[abca55eb-afd6-4d80-8546-0426c0fefc10]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9d62b3-b982-4840-846e-2ae719851fb0]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411, portal: 172.16.0.220,3260]
Apr 14 01:43:27 user nova-compute[71498]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411, portal: 172.16.0.220,3260] successful.
Apr 14 01:43:27 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.079s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51391b4-34dd-434f-ba36-a0c943350676]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] <== disconnect_volume: return (368ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awmUAnKe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '3decf8d9-7bb3-4395-a8b2-91c8dcf1880c', 'attached_at': '', 'detached_at': '', 'volume_id': 'ddd73274-308f-4d71-9930-9ed144269534', 'serial'} {{(pid=71498) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 14 01:43:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] swap_volume: removing Cinder connection for volume 7113332c-fb29-4657-be57-be86d245b411 {{(pid=71498) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 14 01:43:28 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681436593.3163195, f1d10278-cf24-4fde-86eb-664ba86cbd8f => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:43:28 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] VM Stopped (Lifecycle Event)
Apr 14 01:43:28 user nova-compute[71498]: DEBUG nova.compute.manager [None req-a01210b7-9257-43c8-84e0-0377740fd77c None None] [instance: f1d10278-cf24-4fde-86eb-664ba86cbd8f] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:43:28 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:43:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:28 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 01:43:28 user nova-compute[71498]: DEBUG nova.compute.manager [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] swap_volume: Updating volume 7113332c-fb29-4657-be57-be86d245b411 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "awmUAnKe", "auth_password": "zqpX82yDBvOtjH", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "ddd73274-308f-4d71-9930-9ed144269534"}, "status": "reserved", "instance": "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c", "attached_at": "", "detached_at": "", "volume_id": "ddd73274-308f-4d71-9930-9ed144269534", "serial": "ddd73274-308f-4d71-9930-9ed144269534"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'ddd73274-308f-4d71-9930-9ed144269534', 'no_device': None, 'attachment_id': '876b8959-64bb-4bfd-b0f7-6e49869bdb1f'} {{(pid=71498) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 14 01:43:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-897a6baf-d538-4542-910c-f6e7842df9da tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.400s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Acquiring lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:29 user nova-compute[71498]: DEBUG os_brick.utils [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:43:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:29 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e68a1a6-09ef-490b-950d-5db9a6858453]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:29 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[32969df8-2e0b-4816-b827-f3aef37886ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:29 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f4ca51-cb0a-4810-b9f7-6c3c77f8cd53]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:29 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c35b6d-5c3d-4bcd-8419-30da73db9c60]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:43:29 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:43:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:43:29 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:43:29 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2215444-0b5c-4a65-93ff-18493e6e371f]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:29 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:43:29 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:43:29 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:43:29 user nova-compute[71498]: DEBUG os_brick.utils [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:43:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:29 user nova-compute[71498]: INFO nova.compute.manager [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Swapping volume ddd73274-308f-4d71-9930-9ed144269534 for 7113332c-fb29-4657-be57-be86d245b411
Apr 14 01:43:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:43:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:43:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/160b86fd-8405-42f5-90b2-8069917e4df1/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/160b86fd-8405-42f5-90b2-8069917e4df1/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/160b86fd-8405-42f5-90b2-8069917e4df1/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/160b86fd-8405-42f5-90b2-8069917e4df1/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:43:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:43:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:43:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9397a9e2-b5e9-47e7-b25e-5c40379a60eb/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9397a9e2-b5e9-47e7-b25e-5c40379a60eb/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9397a9e2-b5e9-47e7-b25e-5c40379a60eb/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9397a9e2-b5e9-47e7-b25e-5c40379a60eb/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dfd39c9-8535-40d0-863d-c30fc98103e6/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dfd39c9-8535-40d0-863d-c30fc98103e6/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dfd39c9-8535-40d0-863d-c30fc98103e6/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dfd39c9-8535-40d0-863d-c30fc98103e6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:31 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:43:31 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:43:31 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=7364MB free_disk=26.473358154296875GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 01:43:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:31 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance da60f4f1-2474-453f-8f84-c95daf02431a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:43:31 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:43:31 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:43:31 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance f68784e7-578c-4a12-87d4-f35fbc5a1d59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:43:31 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance f45130b1-9e83-47a0-b335-a6e74875b79e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:43:31 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:43:31 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:43:31 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 9397a9e2-b5e9-47e7-b25e-5c40379a60eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:43:31 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance ee4cf01f-8d33-4696-b6ec-7f188ee18026 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:43:31 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 160b86fd-8405-42f5-90b2-8069917e4df1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:43:31 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 2dfd39c9-8535-40d0-863d-c30fc98103e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:43:31 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 01:43:31 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 01:43:32 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:43:32 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:43:32 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 01:43:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.644s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:33 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:43:33 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:43:33 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 01:43:33 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-3a3fb53f-7b4a-48d3-85ab-418bad435c07" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:43:33 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-3a3fb53f-7b4a-48d3-85ab-418bad435c07" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:43:33 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Updating instance_info_cache with network_info: [{"id": "7942720d-0958-4826-bedf-0a7eebfe45b6", "address": "fa:16:3e:0c:0e:df", "network": {"id": "95555a4e-9d95-4509-a683-f61ea2dc38a1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-560359898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4833ddea1fa74866b97ef52a730605aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7942720d-09", "ovs_interfaceid": "7942720d-0958-4826-bedf-0a7eebfe45b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-3a3fb53f-7b4a-48d3-85ab-418bad435c07" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG nova.compute.manager [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TAEDvFux', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3decf8d9-7bb3-4395-a8b2-91c8dcf1880c', 'attached_at': '', 'detached_at': '', 'volume_id': '7113332c-fb29-4657-be57-be86d245b411', 'serial': '7113332c-fb29-4657-be57-be86d245b411'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awmUAnKe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': 'ddd73274-308f-4d71-9930-9ed144269534'}, 'status': 'reserved', 'instance': '3decf8d9-7bb3-4395-a8b2-91c8dcf1880c', 'attached_at': '', 'detached_at': '', 'volume_id': 'ddd73274-308f-4d71-9930-9ed144269534', 'serial'} {{(pid=71498) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TAEDvFux', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:43:34 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:43:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:43:34 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:43:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:43:34 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[784a65e5-c14e-4fa4-874a-788894387ecf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:43:34 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1971f412-0505-4771-a3a4-2ef73ad7384f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411] added
Apr 14 01:43:34 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2e5154-e012-4a60-8a4e-0598146b6fb2]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac417c1-4f86-4546-b2df-21cdc77c2c08]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TAEDvFux {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TAEDvFux" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[36671784-8f90-4387-9657-8b0cef0b689f]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TAEDvFux'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cdf9a7-de30-44d0-8710-498a523599f9]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3a142b-0378-4df0-be95-53fdc062dbaa]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 (non-flash)
Apr 14 01:43:34 user nova-compute[71498]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:34 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:34 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:34 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:34 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 (non-flash)
Apr 14 01:43:34 user nova-compute[71498]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:34 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:34 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:34 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:34 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60d5dae-c2ed-438f-addd-002e1f98308c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411, portal: 172.16.0.220,3260]
Apr 14 01:43:34 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411, portal: 172.16.0.220,3260] successful.
Apr 14 01:43:34 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0d424c-0a5f-49d2-bf2d-1ca56c19ef42]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[769a8870-3d5c-49ff-81b3-ae6491866d79]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 (non-flash)
Apr 14 01:43:34 user nova-compute[71498]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 (non-flash)
Apr 14 01:43:34 user nova-compute[71498]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:34 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:34 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:34 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:34 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 (non-flash)
Apr 14 01:43:34 user nova-compute[71498]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 (non-flash)
Apr 14 01:43:34 user nova-compute[71498]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:34 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:34 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:34 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:34 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] HCTL ('38', '-', '-', 0) found on session 12 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[203e41fe-7e5f-4e36-9598-11a2714253db]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:34 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Searching for a device in session 12 and hctl ['38', '*', '*', 0] yield: None {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:43:35 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:43:35 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Searching for a device in session 12 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:43:35 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TAEDvFux', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:43:35 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:43:35 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '26132356465313339', 'path': '/dev/sdg'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:43:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132356465313339', 'path': '/dev/sdg'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:43:35 user nova-compute[71498]: DEBUG nova.objects.instance [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Lazy-loading 'flavor' on Instance uuid 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:43:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=71498) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 01:43:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] COPY block job progress, current cursor: 80740352 final cursor: 1073741824 {{(pid=71498) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 01:43:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] COPY block job progress, current cursor: 270532608 final cursor: 1073741824 {{(pid=71498) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 01:43:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] COPY block job progress, current cursor: 448790528 final cursor: 1073741824 {{(pid=71498) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 01:43:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] COPY block job progress, current cursor: 622854144 final cursor: 1073741824 {{(pid=71498) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 01:43:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] COPY block job progress, current cursor: 783286272 final cursor: 1073741824 {{(pid=71498) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 01:43:38 user nova-compute[71498]: DEBUG nova.compute.manager [req-f0c9f18a-96f5-430d-a072-a56bd5056a1e req-10a60bcb-ee95-4ef1-a293-ae3c87f4e919 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-changed-3522bbcc-4190-48e3-ab01-ae36f8d6d64e {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:38 user nova-compute[71498]: DEBUG nova.compute.manager [req-f0c9f18a-96f5-430d-a072-a56bd5056a1e req-10a60bcb-ee95-4ef1-a293-ae3c87f4e919 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Refreshing instance network info cache due to event network-changed-3522bbcc-4190-48e3-ab01-ae36f8d6d64e. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:43:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f0c9f18a-96f5-430d-a072-a56bd5056a1e req-10a60bcb-ee95-4ef1-a293-ae3c87f4e919 service nova] Acquiring lock "refresh_cache-bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:43:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f0c9f18a-96f5-430d-a072-a56bd5056a1e req-10a60bcb-ee95-4ef1-a293-ae3c87f4e919 service nova] Acquired lock "refresh_cache-bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:43:38 user nova-compute[71498]: DEBUG nova.network.neutron [req-f0c9f18a-96f5-430d-a072-a56bd5056a1e req-10a60bcb-ee95-4ef1-a293-ae3c87f4e919 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Refreshing network info cache for port 3522bbcc-4190-48e3-ab01-ae36f8d6d64e {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:43:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] COPY block job progress, current cursor: 933232640 final cursor: 1073741824 {{(pid=71498) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG nova.network.neutron [req-f0c9f18a-96f5-430d-a072-a56bd5056a1e req-10a60bcb-ee95-4ef1-a293-ae3c87f4e919 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Updated VIF entry in instance network info cache for port 3522bbcc-4190-48e3-ab01-ae36f8d6d64e. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG nova.network.neutron [req-f0c9f18a-96f5-430d-a072-a56bd5056a1e req-10a60bcb-ee95-4ef1-a293-ae3c87f4e919 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Updating instance_info_cache with network_info: [{"id": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e", "address": "fa:16:3e:f9:e2:65", "network": {"id": "92b9d247-3013-4a97-9ca0-41643807ce1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-923461645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3522bbcc-41", "ovs_interfaceid": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eee87019-7923-4e16-8e15-f2a1010616e3", "address": "fa:16:3e:6c:ff:19", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeee87019-79", "ovs_interfaceid": "eee87019-7923-4e16-8e15-f2a1010616e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fd852601-98a3-4811-8bf5-120906e84646", "address": "fa:16:3e:cd:ab:83", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd852601-98", "ovs_interfaceid": "fd852601-98a3-4811-8bf5-120906e84646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d44e7f03-f338-4efa-b6b4-fb90d22aa37c", "address": "fa:16:3e:8d:5d:e1", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd44e7f03-f3", "ovs_interfaceid": "d44e7f03-f338-4efa-b6b4-fb90d22aa37c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b26233c-8774-42ae-9f2f-8794c8e364a1", "address": "fa:16:3e:ae:ed:db", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b26233c-87", "ovs_interfaceid": "2b26233c-8774-42ae-9f2f-8794c8e364a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "592ca281-1142-433c-996f-54b6bdce948b", "address": "fa:16:3e:ee:9d:4c", "network": {"id": "9169c3c6-6243-44ce-8070-5991e81046ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1541501115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592ca281-11", "ovs_interfaceid": "592ca281-1142-433c-996f-54b6bdce948b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd", "address": "fa:16:3e:0f:ad:4f", "network": {"id": "9169c3c6-6243-44ce-8070-5991e81046ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1541501115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933d0949-bd", "ovs_interfaceid": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f0c9f18a-96f5-430d-a072-a56bd5056a1e req-10a60bcb-ee95-4ef1-a293-ae3c87f4e919 service nova] Releasing lock "refresh_cache-bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71498) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awmUAnKe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': 'ddd73274-308f-4d71-9930-9ed144269534': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:43:39 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:43:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1048a2ea-f22d-44fa-bf96-b83f64635a4e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:43:39 user nova-compute[71498]: No targets found.
Apr 14 01:43:39 user nova-compute[71498]: iSNS:
Apr 14 01:43:39 user nova-compute[71498]: No targets found.
Apr 14 01:43:39 user nova-compute[71498]: STATIC:
Apr 14 01:43:39 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02
Apr 14 01:43:39 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:39 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:39 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53
Apr 14 01:43:39 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:39 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:39 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e
Apr 14 01:43:39 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:39 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:39 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534
Apr 14 01:43:39 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:39 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:39 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411
Apr 14 01:43:39 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:39 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:39 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d
Apr 14 01:43:39 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:39 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:39 user nova-compute[71498]: FIRMWARE:
Apr 14 01:43:39 user nova-compute[71498]: No targets found.
Apr 14 01:43:39 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:43:39 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:43:39 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[05257ed9-cf74-464c-a5f5-b001d493ea65]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ce2428-0e21-4cd1-9167-4d1513eddcd3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 (non-flash)
Apr 14 01:43:39 user nova-compute[71498]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 (non-flash)
Apr 14 01:43:39 user nova-compute[71498]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:39 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:39 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:39 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:39 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 (non-flash)
Apr 14 01:43:39 user nova-compute[71498]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 (non-flash)
Apr 14 01:43:39 user nova-compute[71498]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:39 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:39 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:39 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:39 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5201368160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534'): ({'sdf'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Removing single pathed devices sdf {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[143b1094-a94e-493b-a19c-7c47d777d543]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ae250f-1786-4e1c-8074-f3b603b9135a]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Flushing IO for device /dev/sdf {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e8ef02-e856-4cbe-a27e-2e0a395b2a3a]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.032s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cf1d5c-f5ca-45f7-8db8-a99b81f52289]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] SCSI volumes sdf have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8958d1b-1a3d-41ee-9dd7-9390219003ad]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fef8ab-a440-41eb-bde0-93608c750bf2]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534, portal: 172.16.0.220,3260]
Apr 14 01:43:39 user nova-compute[71498]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534, portal: 172.16.0.220,3260] successful.
Apr 14 01:43:39 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddd73274-308f-4d71-9930-9ed144269534 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fedbed-481e-427a-97c4-8c91c71bb16c]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] <== disconnect_volume: return (340ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:43:39 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:43:40 user nova-compute[71498]: DEBUG nova.compute.manager [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TAEDvFux', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '3decf8d9-7bb3-4395-a8b2-91c8dcf1880c', 'attached_at': '', 'detached_at': '', 'volume_id': '7113332c-fb29-4657-be57-be86d245b411', 'serial'} {{(pid=71498) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 14 01:43:40 user nova-compute[71498]: DEBUG nova.compute.manager [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] swap_volume: removing Cinder connection for volume ddd73274-308f-4d71-9930-9ed144269534 {{(pid=71498) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 14 01:43:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:40 user nova-compute[71498]: INFO nova.compute.manager [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Terminating instance
Apr 14 01:43:40 user nova-compute[71498]: DEBUG nova.compute.manager [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 01:43:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-e148bd35-2e4f-4ce7-9ff4-63daba9c7bd8 req-48818055-622e-454f-af36-f3a9490abdd6 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-unplugged-3522bbcc-4190-48e3-ab01-ae36f8d6d64e {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e148bd35-2e4f-4ce7-9ff4-63daba9c7bd8 req-48818055-622e-454f-af36-f3a9490abdd6 service nova] Acquiring lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e148bd35-2e4f-4ce7-9ff4-63daba9c7bd8 req-48818055-622e-454f-af36-f3a9490abdd6 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e148bd35-2e4f-4ce7-9ff4-63daba9c7bd8 req-48818055-622e-454f-af36-f3a9490abdd6 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-e148bd35-2e4f-4ce7-9ff4-63daba9c7bd8 req-48818055-622e-454f-af36-f3a9490abdd6 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] No waiting events found dispatching network-vif-unplugged-3522bbcc-4190-48e3-ab01-ae36f8d6d64e {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:43:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-e148bd35-2e4f-4ce7-9ff4-63daba9c7bd8 req-48818055-622e-454f-af36-f3a9490abdd6 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-unplugged-3522bbcc-4190-48e3-ab01-ae36f8d6d64e for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:43:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-871a7010-6637-48b4-89ac-2065f76eea6e req-e54f47af-1756-415e-bc56-bad36b7a191f service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-unplugged-eee87019-7923-4e16-8e15-f2a1010616e3 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-871a7010-6637-48b4-89ac-2065f76eea6e req-e54f47af-1756-415e-bc56-bad36b7a191f service nova] Acquiring lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-871a7010-6637-48b4-89ac-2065f76eea6e req-e54f47af-1756-415e-bc56-bad36b7a191f service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-871a7010-6637-48b4-89ac-2065f76eea6e req-e54f47af-1756-415e-bc56-bad36b7a191f service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-871a7010-6637-48b4-89ac-2065f76eea6e req-e54f47af-1756-415e-bc56-bad36b7a191f service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] No waiting events found dispatching network-vif-unplugged-eee87019-7923-4e16-8e15-f2a1010616e3 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:43:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-871a7010-6637-48b4-89ac-2065f76eea6e req-e54f47af-1756-415e-bc56-bad36b7a191f service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-unplugged-eee87019-7923-4e16-8e15-f2a1010616e3 for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:43:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:40 user nova-compute[71498]: DEBUG nova.compute.manager [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] swap_volume: Updating volume ddd73274-308f-4d71-9930-9ed144269534 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "TAEDvFux", "auth_password": "TUuYy1ZXriQIMv", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "7113332c-fb29-4657-be57-be86d245b411"}, "status": "reserved", "instance": "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c", "attached_at": "", "detached_at": "", "volume_id": "7113332c-fb29-4657-be57-be86d245b411", "serial": "7113332c-fb29-4657-be57-be86d245b411"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '7113332c-fb29-4657-be57-be86d245b411', 'no_device': None, 'attachment_id': '546bb471-53c3-4ad5-a260-b71738a71680'} {{(pid=71498) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 14 01:43:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-40d616e5-f84a-4d5a-9b45-cdc1e86b2b41 tempest-TestVolumeSwap-535670122 tempest-TestVolumeSwap-535670122-project-admin] Lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.644s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:41 user nova-compute[71498]: DEBUG nova.compute.manager [req-094eec25-6c66-43d7-b164-f0e1b00a4807 req-aef34232-3033-47a4-a530-bfa47f4c85d4 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-unplugged-2b26233c-8774-42ae-9f2f-8794c8e364a1 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-094eec25-6c66-43d7-b164-f0e1b00a4807 req-aef34232-3033-47a4-a530-bfa47f4c85d4 service nova] Acquiring lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-094eec25-6c66-43d7-b164-f0e1b00a4807 req-aef34232-3033-47a4-a530-bfa47f4c85d4 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-094eec25-6c66-43d7-b164-f0e1b00a4807 req-aef34232-3033-47a4-a530-bfa47f4c85d4 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:41 user nova-compute[71498]: DEBUG nova.compute.manager [req-094eec25-6c66-43d7-b164-f0e1b00a4807 req-aef34232-3033-47a4-a530-bfa47f4c85d4 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] No waiting events found dispatching network-vif-unplugged-2b26233c-8774-42ae-9f2f-8794c8e364a1 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:43:41 user nova-compute[71498]: DEBUG nova.compute.manager [req-094eec25-6c66-43d7-b164-f0e1b00a4807 req-aef34232-3033-47a4-a530-bfa47f4c85d4 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-unplugged-2b26233c-8774-42ae-9f2f-8794c8e364a1 for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:43:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:42 user nova-compute[71498]: INFO nova.compute.manager [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Detaching volume 7113332c-fb29-4657-be57-be86d245b411
Apr 14 01:43:42 user nova-compute[71498]: INFO nova.virt.block_device [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Attempting to driver detach volume 7113332c-fb29-4657-be57-be86d245b411 from mountpoint /dev/vdb
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Attempting to detach device vdb from instance 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c from the persistent domain config. {{(pid=71498) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 01:43:42 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:43:42 user nova-compute[71498]:   <source dev="/dev/sdg"/>
Apr 14 01:43:42 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:43:42 user nova-compute[71498]:   <serial>7113332c-fb29-4657-be57-be86d245b411</serial>
Apr 14 01:43:42 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 01:43:42 user nova-compute[71498]: </disk>
Apr 14 01:43:42 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:43:42 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Successfully detached device vdb from instance 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c from the persistent domain config.
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c from the live domain config. {{(pid=71498) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 01:43:42 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:43:42 user nova-compute[71498]:   <source dev="/dev/sdg"/>
Apr 14 01:43:42 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:43:42 user nova-compute[71498]:   <serial>7113332c-fb29-4657-be57-be86d245b411</serial>
Apr 14 01:43:42 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 01:43:42 user nova-compute[71498]: </disk>
Apr 14 01:43:42 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:43:42 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Instance destroyed successfully.
Apr 14 01:43:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.objects.instance [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lazy-loading 'resources' on Instance uuid bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1230095561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1230095561',id=9,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPq5zgM+RzDby5P6sRhmB9kf8xO+nt7oF+oBIIGpm1i/teJmlf9WNHKzRFpDDT0brJjaI9znJHTvCslBDxEsUUPyP0/a95qsEexcDD0LKojeUgUwxZPEpB+ozEEQVR6lcg==',key_name='tempest-keypair-1529995714',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:42:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='113733a7b1f9424bb5243107472b01c6',ramdisk_id='',reservation_id='r-z1ofx0f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-135372045',owner_user_name='tempest-TaggedBootDevicesTest-135372045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:42:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='692d1dd6aa73472a9c63049910360a0b',uuid=bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e", "address": "fa:16:3e:f9:e2:65", "network": {"id": "92b9d247-3013-4a97-9ca0-41643807ce1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-923461645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3522bbcc-41", "ovs_interfaceid": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converting VIF {"id": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e", "address": "fa:16:3e:f9:e2:65", "network": {"id": "92b9d247-3013-4a97-9ca0-41643807ce1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-923461645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3522bbcc-41", "ovs_interfaceid": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:e2:65,bridge_name='br-int',has_traffic_filtering=True,id=3522bbcc-4190-48e3-ab01-ae36f8d6d64e,network=Network(92b9d247-3013-4a97-9ca0-41643807ce1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3522bbcc-41') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG os_vif [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:e2:65,bridge_name='br-int',has_traffic_filtering=True,id=3522bbcc-4190-48e3-ab01-ae36f8d6d64e,network=Network(92b9d247-3013-4a97-9ca0-41643807ce1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3522bbcc-41') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3522bbcc-41, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:42 user nova-compute[71498]: INFO os_vif [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:e2:65,bridge_name='br-int',has_traffic_filtering=True,id=3522bbcc-4190-48e3-ab01-ae36f8d6d64e,network=Network(92b9d247-3013-4a97-9ca0-41643807ce1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3522bbcc-41')
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1230095561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1230095561',id=9,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPq5zgM+RzDby5P6sRhmB9kf8xO+nt7oF+oBIIGpm1i/teJmlf9WNHKzRFpDDT0brJjaI9znJHTvCslBDxEsUUPyP0/a95qsEexcDD0LKojeUgUwxZPEpB+ozEEQVR6lcg==',key_name='tempest-keypair-1529995714',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:42:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='113733a7b1f9424bb5243107472b01c6',ramdisk_id='',reservation_id='r-z1ofx0f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-135372045',owner_user_name='tempest-TaggedBootDevicesTest-135372045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:42:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='692d1dd6aa73472a9c63049910360a0b',uuid=bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eee87019-7923-4e16-8e15-f2a1010616e3", "address": "fa:16:3e:6c:ff:19", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeee87019-79", "ovs_interfaceid": "eee87019-7923-4e16-8e15-f2a1010616e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converting VIF {"id": "eee87019-7923-4e16-8e15-f2a1010616e3", "address": "fa:16:3e:6c:ff:19", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeee87019-79", "ovs_interfaceid": "eee87019-7923-4e16-8e15-f2a1010616e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:ff:19,bridge_name='br-int',has_traffic_filtering=True,id=eee87019-7923-4e16-8e15-f2a1010616e3,network=Network(08a79a3b-5c3d-4923-b568-4655661083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeee87019-79') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG os_vif [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:ff:19,bridge_name='br-int',has_traffic_filtering=True,id=eee87019-7923-4e16-8e15-f2a1010616e3,network=Network(08a79a3b-5c3d-4923-b568-4655661083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeee87019-79') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeee87019-79, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:42 user nova-compute[71498]: INFO os_vif [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:ff:19,bridge_name='br-int',has_traffic_filtering=True,id=eee87019-7923-4e16-8e15-f2a1010616e3,network=Network(08a79a3b-5c3d-4923-b568-4655661083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeee87019-79')
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1230095561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1230095561',id=9,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPq5zgM+RzDby5P6sRhmB9kf8xO+nt7oF+oBIIGpm1i/teJmlf9WNHKzRFpDDT0brJjaI9znJHTvCslBDxEsUUPyP0/a95qsEexcDD0LKojeUgUwxZPEpB+ozEEQVR6lcg==',key_name='tempest-keypair-1529995714',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:42:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='113733a7b1f9424bb5243107472b01c6',ramdisk_id='',reservation_id='r-z1ofx0f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-135372045',owner_user_name='tempest-TaggedBootDevicesTest-135372045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:42:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='692d1dd6aa73472a9c63049910360a0b',uuid=bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd852601-98a3-4811-8bf5-120906e84646", "address": "fa:16:3e:cd:ab:83", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd852601-98", "ovs_interfaceid": "fd852601-98a3-4811-8bf5-120906e84646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converting VIF {"id": "fd852601-98a3-4811-8bf5-120906e84646", "address": "fa:16:3e:cd:ab:83", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd852601-98", "ovs_interfaceid": "fd852601-98a3-4811-8bf5-120906e84646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:ab:83,bridge_name='br-int',has_traffic_filtering=True,id=fd852601-98a3-4811-8bf5-120906e84646,network=Network(08a79a3b-5c3d-4923-b568-4655661083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd852601-98') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG os_vif [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:ab:83,bridge_name='br-int',has_traffic_filtering=True,id=fd852601-98a3-4811-8bf5-120906e84646,network=Network(08a79a3b-5c3d-4923-b568-4655661083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd852601-98') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd852601-98, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:42 user nova-compute[71498]: INFO os_vif [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:ab:83,bridge_name='br-int',has_traffic_filtering=True,id=fd852601-98a3-4811-8bf5-120906e84646,network=Network(08a79a3b-5c3d-4923-b568-4655661083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfd852601-98')
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1230095561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1230095561',id=9,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPq5zgM+RzDby5P6sRhmB9kf8xO+nt7oF+oBIIGpm1i/teJmlf9WNHKzRFpDDT0brJjaI9znJHTvCslBDxEsUUPyP0/a95qsEexcDD0LKojeUgUwxZPEpB+ozEEQVR6lcg==',key_name='tempest-keypair-1529995714',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:42:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='113733a7b1f9424bb5243107472b01c6',ramdisk_id='',reservation_id='r-z1ofx0f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-135372045',owner_user_name='tempest-TaggedBootDevicesTest-135372045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:42:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='692d1dd6aa73472a9c63049910360a0b',uuid=bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d44e7f03-f338-4efa-b6b4-fb90d22aa37c", "address": "fa:16:3e:8d:5d:e1", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd44e7f03-f3", "ovs_interfaceid": "d44e7f03-f338-4efa-b6b4-fb90d22aa37c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converting VIF {"id": "d44e7f03-f338-4efa-b6b4-fb90d22aa37c", "address": "fa:16:3e:8d:5d:e1", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd44e7f03-f3", "ovs_interfaceid": "d44e7f03-f338-4efa-b6b4-fb90d22aa37c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:5d:e1,bridge_name='br-int',has_traffic_filtering=True,id=d44e7f03-f338-4efa-b6b4-fb90d22aa37c,network=Network(08a79a3b-5c3d-4923-b568-4655661083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd44e7f03-f3') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG os_vif [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:5d:e1,bridge_name='br-int',has_traffic_filtering=True,id=d44e7f03-f338-4efa-b6b4-fb90d22aa37c,network=Network(08a79a3b-5c3d-4923-b568-4655661083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd44e7f03-f3') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd44e7f03-f3, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:42 user nova-compute[71498]: INFO os_vif [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:5d:e1,bridge_name='br-int',has_traffic_filtering=True,id=d44e7f03-f338-4efa-b6b4-fb90d22aa37c,network=Network(08a79a3b-5c3d-4923-b568-4655661083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd44e7f03-f3')
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1230095561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1230095561',id=9,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPq5zgM+RzDby5P6sRhmB9kf8xO+nt7oF+oBIIGpm1i/teJmlf9WNHKzRFpDDT0brJjaI9znJHTvCslBDxEsUUPyP0/a95qsEexcDD0LKojeUgUwxZPEpB+ozEEQVR6lcg==',key_name='tempest-keypair-1529995714',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:42:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='113733a7b1f9424bb5243107472b01c6',ramdisk_id='',reservation_id='r-z1ofx0f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-135372045',owner_user_name='tempest-TaggedBootDevicesTest-135372045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:42:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='692d1dd6aa73472a9c63049910360a0b',uuid=bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b26233c-8774-42ae-9f2f-8794c8e364a1", "address": "fa:16:3e:ae:ed:db", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b26233c-87", "ovs_interfaceid": "2b26233c-8774-42ae-9f2f-8794c8e364a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converting VIF {"id": "2b26233c-8774-42ae-9f2f-8794c8e364a1", "address": "fa:16:3e:ae:ed:db", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b26233c-87", "ovs_interfaceid": "2b26233c-8774-42ae-9f2f-8794c8e364a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ed:db,bridge_name='br-int',has_traffic_filtering=True,id=2b26233c-8774-42ae-9f2f-8794c8e364a1,network=Network(08a79a3b-5c3d-4923-b568-4655661083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b26233c-87') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG os_vif [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ed:db,bridge_name='br-int',has_traffic_filtering=True,id=2b26233c-8774-42ae-9f2f-8794c8e364a1,network=Network(08a79a3b-5c3d-4923-b568-4655661083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b26233c-87') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b26233c-87, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-plugged-3522bbcc-4190-48e3-ab01-ae36f8d6d64e {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] Acquiring lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] No waiting events found dispatching network-vif-plugged-3522bbcc-4190-48e3-ab01-ae36f8d6d64e {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:43:42 user nova-compute[71498]: WARNING nova.compute.manager [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received unexpected event network-vif-plugged-3522bbcc-4190-48e3-ab01-ae36f8d6d64e for instance with vm_state active and task_state deleting.
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-unplugged-fd852601-98a3-4811-8bf5-120906e84646 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] Acquiring lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] No waiting events found dispatching network-vif-unplugged-fd852601-98a3-4811-8bf5-120906e84646 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-unplugged-fd852601-98a3-4811-8bf5-120906e84646 for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-plugged-fd852601-98a3-4811-8bf5-120906e84646 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] Acquiring lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] No waiting events found dispatching network-vif-plugged-fd852601-98a3-4811-8bf5-120906e84646 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:43:42 user nova-compute[71498]: WARNING nova.compute.manager [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received unexpected event network-vif-plugged-fd852601-98a3-4811-8bf5-120906e84646 for instance with vm_state active and task_state deleting.
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-unplugged-d44e7f03-f338-4efa-b6b4-fb90d22aa37c {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] Acquiring lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] No waiting events found dispatching network-vif-unplugged-d44e7f03-f338-4efa-b6b4-fb90d22aa37c {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-unplugged-d44e7f03-f338-4efa-b6b4-fb90d22aa37c for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-plugged-d44e7f03-f338-4efa-b6b4-fb90d22aa37c {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] Acquiring lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] No waiting events found dispatching network-vif-plugged-d44e7f03-f338-4efa-b6b4-fb90d22aa37c {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:43:42 user nova-compute[71498]: WARNING nova.compute.manager [req-64b7c37d-9c6b-4b5d-a033-380fe5293c1d req-e2114646-4300-447b-88f6-217d840c2f66 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received unexpected event network-vif-plugged-d44e7f03-f338-4efa-b6b4-fb90d22aa37c for instance with vm_state active and task_state deleting.
Apr 14 01:43:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:42 user nova-compute[71498]: INFO os_vif [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ed:db,bridge_name='br-int',has_traffic_filtering=True,id=2b26233c-8774-42ae-9f2f-8794c8e364a1,network=Network(08a79a3b-5c3d-4923-b568-4655661083a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b26233c-87')
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1230095561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1230095561',id=9,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPq5zgM+RzDby5P6sRhmB9kf8xO+nt7oF+oBIIGpm1i/teJmlf9WNHKzRFpDDT0brJjaI9znJHTvCslBDxEsUUPyP0/a95qsEexcDD0LKojeUgUwxZPEpB+ozEEQVR6lcg==',key_name='tempest-keypair-1529995714',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:42:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='113733a7b1f9424bb5243107472b01c6',ramdisk_id='',reservation_id='r-z1ofx0f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-135372045',owner_user_name='tempest-TaggedBootDevicesTest-135372045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:42:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='692d1dd6aa73472a9c63049910360a0b',uuid=bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "592ca281-1142-433c-996f-54b6bdce948b", "address": "fa:16:3e:ee:9d:4c", "network": {"id": "9169c3c6-6243-44ce-8070-5991e81046ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1541501115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592ca281-11", "ovs_interfaceid": "592ca281-1142-433c-996f-54b6bdce948b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converting VIF {"id": "592ca281-1142-433c-996f-54b6bdce948b", "address": "fa:16:3e:ee:9d:4c", "network": {"id": "9169c3c6-6243-44ce-8070-5991e81046ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1541501115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592ca281-11", "ovs_interfaceid": "592ca281-1142-433c-996f-54b6bdce948b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:9d:4c,bridge_name='br-int',has_traffic_filtering=True,id=592ca281-1142-433c-996f-54b6bdce948b,network=Network(9169c3c6-6243-44ce-8070-5991e81046ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592ca281-11') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG os_vif [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:9d:4c,bridge_name='br-int',has_traffic_filtering=True,id=592ca281-1142-433c-996f-54b6bdce948b,network=Network(9169c3c6-6243-44ce-8070-5991e81046ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592ca281-11') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap592ca281-11, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:42 user nova-compute[71498]: INFO os_vif [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:9d:4c,bridge_name='br-int',has_traffic_filtering=True,id=592ca281-1142-433c-996f-54b6bdce948b,network=Network(9169c3c6-6243-44ce-8070-5991e81046ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592ca281-11')
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:41:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1230095561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1230095561',id=9,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPq5zgM+RzDby5P6sRhmB9kf8xO+nt7oF+oBIIGpm1i/teJmlf9WNHKzRFpDDT0brJjaI9znJHTvCslBDxEsUUPyP0/a95qsEexcDD0LKojeUgUwxZPEpB+ozEEQVR6lcg==',key_name='tempest-keypair-1529995714',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:42:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='113733a7b1f9424bb5243107472b01c6',ramdisk_id='',reservation_id='r-z1ofx0f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-135372045',owner_user_name='tempest-TaggedBootDevicesTest-135372045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:42:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='692d1dd6aa73472a9c63049910360a0b',uuid=bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd", "address": "fa:16:3e:0f:ad:4f", "network": {"id": "9169c3c6-6243-44ce-8070-5991e81046ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1541501115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933d0949-bd", "ovs_interfaceid": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converting VIF {"id": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd", "address": "fa:16:3e:0f:ad:4f", "network": {"id": "9169c3c6-6243-44ce-8070-5991e81046ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1541501115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933d0949-bd", "ovs_interfaceid": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:ad:4f,bridge_name='br-int',has_traffic_filtering=True,id=933d0949-bd1a-4905-ae6a-e15e6b6e72dd,network=Network(9169c3c6-6243-44ce-8070-5991e81046ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap933d0949-bd') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG os_vif [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:ad:4f,bridge_name='br-int',has_traffic_filtering=True,id=933d0949-bd1a-4905-ae6a-e15e6b6e72dd,network=Network(9169c3c6-6243-44ce-8070-5991e81046ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap933d0949-bd') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap933d0949-bd, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:42 user nova-compute[71498]: INFO os_vif [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:ad:4f,bridge_name='br-int',has_traffic_filtering=True,id=933d0949-bd1a-4905-ae6a-e15e6b6e72dd,network=Network(9169c3c6-6243-44ce-8070-5991e81046ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap933d0949-bd')
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-9ec9778c-dc56-4290-b791-450d7593e121 req-1fb67b52-0669-4497-8833-5f731744b1ec service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-plugged-eee87019-7923-4e16-8e15-f2a1010616e3 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-9ec9778c-dc56-4290-b791-450d7593e121 req-1fb67b52-0669-4497-8833-5f731744b1ec service nova] Acquiring lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-9ec9778c-dc56-4290-b791-450d7593e121 req-1fb67b52-0669-4497-8833-5f731744b1ec service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-9ec9778c-dc56-4290-b791-450d7593e121 req-1fb67b52-0669-4497-8833-5f731744b1ec service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-9ec9778c-dc56-4290-b791-450d7593e121 req-1fb67b52-0669-4497-8833-5f731744b1ec service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] No waiting events found dispatching network-vif-plugged-eee87019-7923-4e16-8e15-f2a1010616e3 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:43:42 user nova-compute[71498]: WARNING nova.compute.manager [req-9ec9778c-dc56-4290-b791-450d7593e121 req-1fb67b52-0669-4497-8833-5f731744b1ec service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received unexpected event network-vif-plugged-eee87019-7923-4e16-8e15-f2a1010616e3 for instance with vm_state active and task_state deleting.
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oLYPhWbV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:43:42 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:43:42 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0f08aa-817b-4a20-b92c-b28d057d5dec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:43:42 user nova-compute[71498]: No targets found.
Apr 14 01:43:42 user nova-compute[71498]: iSNS:
Apr 14 01:43:42 user nova-compute[71498]: No targets found.
Apr 14 01:43:42 user nova-compute[71498]: STATIC:
Apr 14 01:43:42 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02
Apr 14 01:43:42 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:42 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:42 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53
Apr 14 01:43:42 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:42 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:42 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e
Apr 14 01:43:42 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:42 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:42 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411
Apr 14 01:43:42 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:42 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:42 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d
Apr 14 01:43:42 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:42 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:42 user nova-compute[71498]: FIRMWARE:
Apr 14 01:43:42 user nova-compute[71498]: No targets found.
Apr 14 01:43:42 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:43:42 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:43:42 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[33af5e16-811d-4056-8725-44e28d2eb82a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Received event <DeviceRemovedEvent: 1681436622.9205363, 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71498) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c {{(pid=71498) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 01:43:42 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Successfully detached device vdb from instance 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c from the live domain config.
Apr 14 01:43:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TAEDvFux', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '7113332c-fb29-4657-be57-be86d245b411': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:43:42 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:43:42 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2b2030-fae8-4828-881c-63f5b52562d6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 (non-flash)
Apr 14 01:43:42 user nova-compute[71498]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:42 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:42 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:42 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:42 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 (non-flash)
Apr 14 01:43:42 user nova-compute[71498]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e (non-flash)
Apr 14 01:43:42 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:42 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:42 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:42 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51f44f6b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e'): ({'sdb'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Removing single pathed devices sdb {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a329828d-673f-41f9-89df-be666dde8a07]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbda586-c4d8-493d-b12a-472223a3a8ca]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Flushing IO for device /dev/sdb {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[66196d7a-e29a-42db-b3d1-b2dddfef9e03]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd36331-970b-4f31-b66b-c83282d9afed]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] SCSI volumes sdb have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf490b0-782d-4cdf-8827-7c6db28164ed]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd78e25-75e1-46cd-aeb4-5acd10009568]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e, portal: 172.16.0.220,3260]
Apr 14 01:43:43 user nova-compute[71498]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e, portal: 172.16.0.220,3260] successful.
Apr 14 01:43:43 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e9b1e2c-15a4-481a-a713-fa24dca0918e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6777515-0c0d-4904-ae53-f93f54430c29]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] <== disconnect_volume: return (339ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.272s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TXlNnZyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:43:43 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[749eba28-f4c7-4dca-ac8c-92960b9a1345]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:43:43 user nova-compute[71498]: No targets found.
Apr 14 01:43:43 user nova-compute[71498]: iSNS:
Apr 14 01:43:43 user nova-compute[71498]: No targets found.
Apr 14 01:43:43 user nova-compute[71498]: STATIC:
Apr 14 01:43:43 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02
Apr 14 01:43:43 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:43 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:43 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53
Apr 14 01:43:43 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:43 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:43 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411
Apr 14 01:43:43 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:43 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:43 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d
Apr 14 01:43:43 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:43 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:43 user nova-compute[71498]: FIRMWARE:
Apr 14 01:43:43 user nova-compute[71498]: No targets found.
Apr 14 01:43:43 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:43:43 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:43:43 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2497fb2-5669-401d-85c9-4daa384828ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ee2dc29f-8e79-4406-8355-2e47c9f680d9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "9397a9e2-b5e9-47e7-b25e-5c40379a60eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ee2dc29f-8e79-4406-8355-2e47c9f680d9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "9397a9e2-b5e9-47e7-b25e-5c40379a60eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ee2dc29f-8e79-4406-8355-2e47c9f680d9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "9397a9e2-b5e9-47e7-b25e-5c40379a60eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ee2dc29f-8e79-4406-8355-2e47c9f680d9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "9397a9e2-b5e9-47e7-b25e-5c40379a60eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ee2dc29f-8e79-4406-8355-2e47c9f680d9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "9397a9e2-b5e9-47e7-b25e-5c40379a60eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:43 user nova-compute[71498]: INFO nova.compute.manager [None req-ee2dc29f-8e79-4406-8355-2e47c9f680d9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Terminating instance
Apr 14 01:43:43 user nova-compute[71498]: DEBUG nova.compute.manager [None req-ee2dc29f-8e79-4406-8355-2e47c9f680d9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c28b6c0-6292-4f2c-8511-cf06b9ecd9c2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 (non-flash)
Apr 14 01:43:43 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:43 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:43 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:43 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 (non-flash)
Apr 14 01:43:43 user nova-compute[71498]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:43 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:43 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:43 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51f4509ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411'): ({'sdg'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Removing single pathed devices sdg {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be28eda-892d-474a-a983-ba66e2c132a1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[32308d84-c0ca-4108-bb5c-420557501048]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Flushing IO for device /dev/sdg {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd01ce2e-59d0-4a1e-8eca-c1691bea28a5]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.049s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e7c746-434f-4345-b441-3696c743190e]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] SCSI volumes sdg have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d73dc8-901f-4790-bcce-58075b255825]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2269f3bc-22e8-457d-86ce-20ec30c4b1d7]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411, portal: 172.16.0.220,3260]
Apr 14 01:43:43 user nova-compute[71498]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411, portal: 172.16.0.220,3260] successful.
Apr 14 01:43:43 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7113332c-fb29-4657-be57-be86d245b411 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b956ff-f8ac-4c9d-860b-bda41f4ce6c9]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] <== disconnect_volume: return (631ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.361s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG nova.compute.manager [req-7d0ff535-82ee-472f-966d-7cbe7fd1938e req-3ae8bad0-7a9e-4681-93fe-500d938564fd service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-plugged-2b26233c-8774-42ae-9f2f-8794c8e364a1 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7d0ff535-82ee-472f-966d-7cbe7fd1938e req-3ae8bad0-7a9e-4681-93fe-500d938564fd service nova] Acquiring lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7d0ff535-82ee-472f-966d-7cbe7fd1938e req-3ae8bad0-7a9e-4681-93fe-500d938564fd service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7d0ff535-82ee-472f-966d-7cbe7fd1938e req-3ae8bad0-7a9e-4681-93fe-500d938564fd service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG nova.compute.manager [req-7d0ff535-82ee-472f-966d-7cbe7fd1938e req-3ae8bad0-7a9e-4681-93fe-500d938564fd service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] No waiting events found dispatching network-vif-plugged-2b26233c-8774-42ae-9f2f-8794c8e364a1 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:43:43 user nova-compute[71498]: WARNING nova.compute.manager [req-7d0ff535-82ee-472f-966d-7cbe7fd1938e req-3ae8bad0-7a9e-4681-93fe-500d938564fd service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received unexpected event network-vif-plugged-2b26233c-8774-42ae-9f2f-8794c8e364a1 for instance with vm_state active and task_state deleting.
Apr 14 01:43:43 user nova-compute[71498]: DEBUG nova.compute.manager [req-7d0ff535-82ee-472f-966d-7cbe7fd1938e req-3ae8bad0-7a9e-4681-93fe-500d938564fd service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-unplugged-592ca281-1142-433c-996f-54b6bdce948b {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7d0ff535-82ee-472f-966d-7cbe7fd1938e req-3ae8bad0-7a9e-4681-93fe-500d938564fd service nova] Acquiring lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7d0ff535-82ee-472f-966d-7cbe7fd1938e req-3ae8bad0-7a9e-4681-93fe-500d938564fd service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7d0ff535-82ee-472f-966d-7cbe7fd1938e req-3ae8bad0-7a9e-4681-93fe-500d938564fd service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG nova.compute.manager [req-7d0ff535-82ee-472f-966d-7cbe7fd1938e req-3ae8bad0-7a9e-4681-93fe-500d938564fd service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] No waiting events found dispatching network-vif-unplugged-592ca281-1142-433c-996f-54b6bdce948b {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG nova.compute.manager [req-7d0ff535-82ee-472f-966d-7cbe7fd1938e req-3ae8bad0-7a9e-4681-93fe-500d938564fd service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-unplugged-592ca281-1142-433c-996f-54b6bdce948b for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG nova.compute.manager [req-7d0ff535-82ee-472f-966d-7cbe7fd1938e req-3ae8bad0-7a9e-4681-93fe-500d938564fd service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-plugged-592ca281-1142-433c-996f-54b6bdce948b {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7d0ff535-82ee-472f-966d-7cbe7fd1938e req-3ae8bad0-7a9e-4681-93fe-500d938564fd service nova] Acquiring lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7d0ff535-82ee-472f-966d-7cbe7fd1938e req-3ae8bad0-7a9e-4681-93fe-500d938564fd service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7d0ff535-82ee-472f-966d-7cbe7fd1938e req-3ae8bad0-7a9e-4681-93fe-500d938564fd service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG nova.compute.manager [req-7d0ff535-82ee-472f-966d-7cbe7fd1938e req-3ae8bad0-7a9e-4681-93fe-500d938564fd service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] No waiting events found dispatching network-vif-plugged-592ca281-1142-433c-996f-54b6bdce948b {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:43:43 user nova-compute[71498]: WARNING nova.compute.manager [req-7d0ff535-82ee-472f-966d-7cbe7fd1938e req-3ae8bad0-7a9e-4681-93fe-500d938564fd service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received unexpected event network-vif-plugged-592ca281-1142-433c-996f-54b6bdce948b for instance with vm_state active and task_state deleting.
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a913ea-d3ca-425e-970b-2f389169891a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:43:43 user nova-compute[71498]: No targets found.
Apr 14 01:43:43 user nova-compute[71498]: iSNS:
Apr 14 01:43:43 user nova-compute[71498]: No targets found.
Apr 14 01:43:43 user nova-compute[71498]: STATIC:
Apr 14 01:43:43 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02
Apr 14 01:43:43 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:43 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:43 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53
Apr 14 01:43:43 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:43 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:43 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d
Apr 14 01:43:43 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:43 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:43 user nova-compute[71498]: FIRMWARE:
Apr 14 01:43:43 user nova-compute[71498]: No targets found.
Apr 14 01:43:43 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:43:43 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:43:43 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.056s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acebf76-3321-401d-bb27-7a30d6bf62ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbb98a6-919a-4729-ba96-11396384e6f4]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:43 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:43 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:43 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d (non-flash)
Apr 14 01:43:43 user nova-compute[71498]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:43 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:43 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51f45095a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d'): ({'sdc'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Removing single pathed devices sdc {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36c014d-5ee8-4669-8c9f-b419891905b3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d70c48-9663-47a3-88c1-66f5d486df5b]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Flushing IO for device /dev/sdc {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb53d08b-748e-4ab4-a7bc-34f826244d00]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd02a6c-f514-4ac3-a03b-338776c53b7c]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] SCSI volumes sdc have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:43 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Instance destroyed successfully.
Apr 14 01:43:43 user nova-compute[71498]: DEBUG nova.objects.instance [None req-ee2dc29f-8e79-4406-8355-2e47c9f680d9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lazy-loading 'resources' on Instance uuid 9397a9e2-b5e9-47e7-b25e-5c40379a60eb {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-ee2dc29f-8e79-4406-8355-2e47c9f680d9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:41:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-888539893',display_name='tempest-VolumesActionsTest-instance-888539893',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-888539893',id=10,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:41:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cdb176ac656c47b38e736fc629fc46e0',ramdisk_id='',reservation_id='r-lc3velri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-193871514',owner_user_name='tempest-VolumesActionsTest-193871514-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:42:00Z,user_data=None,user_id='8b18b911fcf847efbf4f814f3b687279',uuid=9397a9e2-b5e9-47e7-b25e-5c40379a60eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "084feebd-4d90-4eab-b8ec-346c32858b42", "address": "fa:16:3e:31:eb:07", "network": {"id": "d2f0bf5d-7422-436e-82b2-95cfe8eb77bd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1126078103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cdb176ac656c47b38e736fc629fc46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084feebd-4d", "ovs_interfaceid": "084feebd-4d90-4eab-b8ec-346c32858b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-ee2dc29f-8e79-4406-8355-2e47c9f680d9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Converting VIF {"id": "084feebd-4d90-4eab-b8ec-346c32858b42", "address": "fa:16:3e:31:eb:07", "network": {"id": "d2f0bf5d-7422-436e-82b2-95cfe8eb77bd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1126078103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cdb176ac656c47b38e736fc629fc46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084feebd-4d", "ovs_interfaceid": "084feebd-4d90-4eab-b8ec-346c32858b42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-ee2dc29f-8e79-4406-8355-2e47c9f680d9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:eb:07,bridge_name='br-int',has_traffic_filtering=True,id=084feebd-4d90-4eab-b8ec-346c32858b42,network=Network(d2f0bf5d-7422-436e-82b2-95cfe8eb77bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084feebd-4d') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_vif [None req-ee2dc29f-8e79-4406-8355-2e47c9f680d9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:eb:07,bridge_name='br-int',has_traffic_filtering=True,id=084feebd-4d90-4eab-b8ec-346c32858b42,network=Network(d2f0bf5d-7422-436e-82b2-95cfe8eb77bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084feebd-4d') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[811d280e-2ec5-4a27-b97f-183d63cd115e]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap084feebd-4d, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:43:43 user nova-compute[71498]: INFO os_vif [None req-ee2dc29f-8e79-4406-8355-2e47c9f680d9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:eb:07,bridge_name='br-int',has_traffic_filtering=True,id=084feebd-4d90-4eab-b8ec-346c32858b42,network=Network(d2f0bf5d-7422-436e-82b2-95cfe8eb77bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084feebd-4d')
Apr 14 01:43:43 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-ee2dc29f-8e79-4406-8355-2e47c9f680d9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Deleting instance files /opt/stack/data/nova/instances/9397a9e2-b5e9-47e7-b25e-5c40379a60eb_del
Apr 14 01:43:43 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-ee2dc29f-8e79-4406-8355-2e47c9f680d9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Deletion of /opt/stack/data/nova/instances/9397a9e2-b5e9-47e7-b25e-5c40379a60eb_del complete
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[22da2b4f-cb07-49d5-add3-91ed5062547d]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d, portal: 172.16.0.220,3260]
Apr 14 01:43:43 user nova-compute[71498]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d, portal: 172.16.0.220,3260] successful.
Apr 14 01:43:43 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:43 user nova-compute[71498]: INFO nova.compute.manager [None req-ee2dc29f-8e79-4406-8355-2e47c9f680d9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-ee2dc29f-8e79-4406-8355-2e47c9f680d9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:953520b1-6ecb-41ad-8793-851901048f6d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc24a6bf-4bc3-4c41-a51e-e831f4d89222]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] <== disconnect_volume: return (738ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AymIXcgr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:43:43 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a352dbd2-1364-42bb-a6e5-f8b1a1bcdb85]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:43:43 user nova-compute[71498]: No targets found.
Apr 14 01:43:43 user nova-compute[71498]: iSNS:
Apr 14 01:43:43 user nova-compute[71498]: No targets found.
Apr 14 01:43:43 user nova-compute[71498]: STATIC:
Apr 14 01:43:43 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02
Apr 14 01:43:43 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:43 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:43 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53
Apr 14 01:43:43 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:43:43 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:43:43 user nova-compute[71498]: FIRMWARE:
Apr 14 01:43:43 user nova-compute[71498]: No targets found.
Apr 14 01:43:43 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:43:43 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:43:43 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:43:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbcb5f7-7c54-49ce-a1b9-ee362557bc2b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b685f2a4-add6-4530-8e9b-3a7376f330a1]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:44 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:44 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 (non-flash)
Apr 14 01:43:44 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:44 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51f43ba290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02'): ({'sdd'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Removing single pathed devices sdd {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53320dc-d76b-4bb8-a19e-0f120ed0f21a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e09f4e-c151-43bd-879e-c6c6cb1b5cac]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Flushing IO for device /dev/sdd {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[436906f0-493d-48fa-bb77-0620bf7854ff]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbda7ae3-64e3-4401-9baf-078a7f7f2447]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] SCSI volumes sdd have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed16d7ba-d82c-483d-80ba-7ab88c80648c]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG nova.compute.manager [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa805304-c364-4b2d-abce-5f41ed2debe0]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02, portal: 172.16.0.220,3260]
Apr 14 01:43:44 user nova-compute[71498]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02, portal: 172.16.0.220,3260] successful.
Apr 14 01:43:44 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da07fe19-d0bc-4451-a0c5-29df607f9b02 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a32a2b-adef-47ff-ac88-b7067b91ac6e]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] <== disconnect_volume: return (331ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:43:44 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Deleting instance files /opt/stack/data/nova/instances/bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5_del
Apr 14 01:43:44 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Deletion of /opt/stack/data/nova/instances/bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5_del complete
Apr 14 01:43:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:43:44 user nova-compute[71498]: INFO nova.compute.claims [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Claim successful on node user
Apr 14 01:43:44 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG nova.objects.instance [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lazy-loading 'flavor' on Instance uuid 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:43:44 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Took 0.44 seconds to deallocate network for instance.
Apr 14 01:43:44 user nova-compute[71498]: INFO nova.compute.manager [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Took 4.01 seconds to destroy the instance on the hypervisor.
Apr 14 01:43:44 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-1cd20b8f-81b6-478d-9be4-6f59ab19b05d tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.457s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ee2dc29f-8e79-4406-8355-2e47c9f680d9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.522s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG nova.compute.manager [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ee2dc29f-8e79-4406-8355-2e47c9f680d9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.389s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG nova.compute.manager [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG nova.network.neutron [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:43:44 user nova-compute[71498]: DEBUG nova.compute.manager [req-f8e0e9bd-b04c-4390-bf22-721e01a81883 req-c15cfae5-0b3f-46b6-a57d-26fa97288f54 service nova] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Received event network-vif-deleted-084feebd-4d90-4eab-b8ec-346c32858b42 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:44 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 01:43:44 user nova-compute[71498]: DEBUG nova.compute.manager [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 01:43:44 user nova-compute[71498]: INFO nova.virt.block_device [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Booting with blank volume at /dev/vda
Apr 14 01:43:45 user nova-compute[71498]: DEBUG nova.policy [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:43:45 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-ee2dc29f-8e79-4406-8355-2e47c9f680d9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:43:45 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-ee2dc29f-8e79-4406-8355-2e47c9f680d9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:43:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ee2dc29f-8e79-4406-8355-2e47c9f680d9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.424s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:45 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-ee2dc29f-8e79-4406-8355-2e47c9f680d9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Deleted allocations for instance 9397a9e2-b5e9-47e7-b25e-5c40379a60eb
Apr 14 01:43:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ee2dc29f-8e79-4406-8355-2e47c9f680d9 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "9397a9e2-b5e9-47e7-b25e-5c40379a60eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.140s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:45 user nova-compute[71498]: DEBUG nova.compute.manager [req-fc7e4288-49bf-4f0f-8e20-01240abb7ad3 req-cc73995f-0549-4e17-8cce-f6d3c01f4ee4 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-unplugged-933d0949-bd1a-4905-ae6a-e15e6b6e72dd {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-fc7e4288-49bf-4f0f-8e20-01240abb7ad3 req-cc73995f-0549-4e17-8cce-f6d3c01f4ee4 service nova] Acquiring lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-fc7e4288-49bf-4f0f-8e20-01240abb7ad3 req-cc73995f-0549-4e17-8cce-f6d3c01f4ee4 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-fc7e4288-49bf-4f0f-8e20-01240abb7ad3 req-cc73995f-0549-4e17-8cce-f6d3c01f4ee4 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:45 user nova-compute[71498]: DEBUG nova.compute.manager [req-fc7e4288-49bf-4f0f-8e20-01240abb7ad3 req-cc73995f-0549-4e17-8cce-f6d3c01f4ee4 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] No waiting events found dispatching network-vif-unplugged-933d0949-bd1a-4905-ae6a-e15e6b6e72dd {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:43:45 user nova-compute[71498]: DEBUG nova.compute.manager [req-fc7e4288-49bf-4f0f-8e20-01240abb7ad3 req-cc73995f-0549-4e17-8cce-f6d3c01f4ee4 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-unplugged-933d0949-bd1a-4905-ae6a-e15e6b6e72dd for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:43:45 user nova-compute[71498]: DEBUG nova.compute.manager [req-fc7e4288-49bf-4f0f-8e20-01240abb7ad3 req-cc73995f-0549-4e17-8cce-f6d3c01f4ee4 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-plugged-933d0949-bd1a-4905-ae6a-e15e6b6e72dd {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-fc7e4288-49bf-4f0f-8e20-01240abb7ad3 req-cc73995f-0549-4e17-8cce-f6d3c01f4ee4 service nova] Acquiring lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-fc7e4288-49bf-4f0f-8e20-01240abb7ad3 req-cc73995f-0549-4e17-8cce-f6d3c01f4ee4 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-fc7e4288-49bf-4f0f-8e20-01240abb7ad3 req-cc73995f-0549-4e17-8cce-f6d3c01f4ee4 service nova] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:45 user nova-compute[71498]: DEBUG nova.compute.manager [req-fc7e4288-49bf-4f0f-8e20-01240abb7ad3 req-cc73995f-0549-4e17-8cce-f6d3c01f4ee4 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] No waiting events found dispatching network-vif-plugged-933d0949-bd1a-4905-ae6a-e15e6b6e72dd {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:43:45 user nova-compute[71498]: WARNING nova.compute.manager [req-fc7e4288-49bf-4f0f-8e20-01240abb7ad3 req-cc73995f-0549-4e17-8cce-f6d3c01f4ee4 service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received unexpected event network-vif-plugged-933d0949-bd1a-4905-ae6a-e15e6b6e72dd for instance with vm_state active and task_state deleting.
Apr 14 01:43:45 user nova-compute[71498]: DEBUG nova.compute.manager [req-fc7e4288-49bf-4f0f-8e20-01240abb7ad3 req-cc73995f-0549-4e17-8cce-f6d3c01f4ee4 service nova] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Received event network-vif-plugged-084feebd-4d90-4eab-b8ec-346c32858b42 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-fc7e4288-49bf-4f0f-8e20-01240abb7ad3 req-cc73995f-0549-4e17-8cce-f6d3c01f4ee4 service nova] Acquiring lock "9397a9e2-b5e9-47e7-b25e-5c40379a60eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-fc7e4288-49bf-4f0f-8e20-01240abb7ad3 req-cc73995f-0549-4e17-8cce-f6d3c01f4ee4 service nova] Lock "9397a9e2-b5e9-47e7-b25e-5c40379a60eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-fc7e4288-49bf-4f0f-8e20-01240abb7ad3 req-cc73995f-0549-4e17-8cce-f6d3c01f4ee4 service nova] Lock "9397a9e2-b5e9-47e7-b25e-5c40379a60eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:45 user nova-compute[71498]: DEBUG nova.compute.manager [req-fc7e4288-49bf-4f0f-8e20-01240abb7ad3 req-cc73995f-0549-4e17-8cce-f6d3c01f4ee4 service nova] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] No waiting events found dispatching network-vif-plugged-084feebd-4d90-4eab-b8ec-346c32858b42 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:43:45 user nova-compute[71498]: WARNING nova.compute.manager [req-fc7e4288-49bf-4f0f-8e20-01240abb7ad3 req-cc73995f-0549-4e17-8cce-f6d3c01f4ee4 service nova] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Received unexpected event network-vif-plugged-084feebd-4d90-4eab-b8ec-346c32858b42 for instance with vm_state deleted and task_state None.
Apr 14 01:43:46 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:46 user nova-compute[71498]: DEBUG nova.network.neutron [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Successfully created port: 4146457e-4b16-4c22-afd2-ffae8a58c0c5 {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:43:46 user nova-compute[71498]: DEBUG nova.compute.manager [req-bbe5b4e2-4bcb-46e4-9ac0-60d26cd728c9 req-121a846b-5182-4637-8dd7-1db44bc7166e service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-deleted-592ca281-1142-433c-996f-54b6bdce948b {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:46 user nova-compute[71498]: INFO nova.compute.manager [req-bbe5b4e2-4bcb-46e4-9ac0-60d26cd728c9 req-121a846b-5182-4637-8dd7-1db44bc7166e service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Neutron deleted interface 592ca281-1142-433c-996f-54b6bdce948b; detaching it from the instance and deleting it from the info cache
Apr 14 01:43:46 user nova-compute[71498]: DEBUG nova.network.neutron [req-bbe5b4e2-4bcb-46e4-9ac0-60d26cd728c9 req-121a846b-5182-4637-8dd7-1db44bc7166e service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Updating instance_info_cache with network_info: [{"id": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e", "address": "fa:16:3e:f9:e2:65", "network": {"id": "92b9d247-3013-4a97-9ca0-41643807ce1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-923461645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3522bbcc-41", "ovs_interfaceid": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eee87019-7923-4e16-8e15-f2a1010616e3", "address": "fa:16:3e:6c:ff:19", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeee87019-79", "ovs_interfaceid": "eee87019-7923-4e16-8e15-f2a1010616e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fd852601-98a3-4811-8bf5-120906e84646", "address": "fa:16:3e:cd:ab:83", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd852601-98", "ovs_interfaceid": "fd852601-98a3-4811-8bf5-120906e84646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d44e7f03-f338-4efa-b6b4-fb90d22aa37c", "address": "fa:16:3e:8d:5d:e1", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd44e7f03-f3", "ovs_interfaceid": "d44e7f03-f338-4efa-b6b4-fb90d22aa37c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b26233c-8774-42ae-9f2f-8794c8e364a1", "address": "fa:16:3e:ae:ed:db", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b26233c-87", "ovs_interfaceid": "2b26233c-8774-42ae-9f2f-8794c8e364a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd", "address": "fa:16:3e:0f:ad:4f", "network": {"id": "9169c3c6-6243-44ce-8070-5991e81046ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1541501115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933d0949-bd", "ovs_interfaceid": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:43:46 user nova-compute[71498]: DEBUG nova.compute.manager [req-bbe5b4e2-4bcb-46e4-9ac0-60d26cd728c9 req-121a846b-5182-4637-8dd7-1db44bc7166e service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Detach interface failed, port_id=592ca281-1142-433c-996f-54b6bdce948b, reason: Instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 could not be found. {{(pid=71498) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 01:43:46 user nova-compute[71498]: DEBUG nova.compute.manager [req-bbe5b4e2-4bcb-46e4-9ac0-60d26cd728c9 req-121a846b-5182-4637-8dd7-1db44bc7166e service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-deleted-2b26233c-8774-42ae-9f2f-8794c8e364a1 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:46 user nova-compute[71498]: INFO nova.compute.manager [req-bbe5b4e2-4bcb-46e4-9ac0-60d26cd728c9 req-121a846b-5182-4637-8dd7-1db44bc7166e service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Neutron deleted interface 2b26233c-8774-42ae-9f2f-8794c8e364a1; detaching it from the instance and deleting it from the info cache
Apr 14 01:43:46 user nova-compute[71498]: DEBUG nova.network.neutron [req-bbe5b4e2-4bcb-46e4-9ac0-60d26cd728c9 req-121a846b-5182-4637-8dd7-1db44bc7166e service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Updating instance_info_cache with network_info: [{"id": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e", "address": "fa:16:3e:f9:e2:65", "network": {"id": "92b9d247-3013-4a97-9ca0-41643807ce1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-923461645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3522bbcc-41", "ovs_interfaceid": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eee87019-7923-4e16-8e15-f2a1010616e3", "address": "fa:16:3e:6c:ff:19", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeee87019-79", "ovs_interfaceid": "eee87019-7923-4e16-8e15-f2a1010616e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fd852601-98a3-4811-8bf5-120906e84646", "address": "fa:16:3e:cd:ab:83", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd852601-98", "ovs_interfaceid": "fd852601-98a3-4811-8bf5-120906e84646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d44e7f03-f338-4efa-b6b4-fb90d22aa37c", "address": "fa:16:3e:8d:5d:e1", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd44e7f03-f3", "ovs_interfaceid": "d44e7f03-f338-4efa-b6b4-fb90d22aa37c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd", "address": "fa:16:3e:0f:ad:4f", "network": {"id": "9169c3c6-6243-44ce-8070-5991e81046ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1541501115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933d0949-bd", "ovs_interfaceid": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:43:47 user nova-compute[71498]: DEBUG nova.compute.manager [req-bbe5b4e2-4bcb-46e4-9ac0-60d26cd728c9 req-121a846b-5182-4637-8dd7-1db44bc7166e service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Detach interface failed, port_id=2b26233c-8774-42ae-9f2f-8794c8e364a1, reason: Instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 could not be found. {{(pid=71498) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 01:43:47 user nova-compute[71498]: DEBUG nova.compute.manager [req-bbe5b4e2-4bcb-46e4-9ac0-60d26cd728c9 req-121a846b-5182-4637-8dd7-1db44bc7166e service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-deleted-d44e7f03-f338-4efa-b6b4-fb90d22aa37c {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:47 user nova-compute[71498]: INFO nova.compute.manager [req-bbe5b4e2-4bcb-46e4-9ac0-60d26cd728c9 req-121a846b-5182-4637-8dd7-1db44bc7166e service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Neutron deleted interface d44e7f03-f338-4efa-b6b4-fb90d22aa37c; detaching it from the instance and deleting it from the info cache
Apr 14 01:43:47 user nova-compute[71498]: DEBUG nova.network.neutron [req-bbe5b4e2-4bcb-46e4-9ac0-60d26cd728c9 req-121a846b-5182-4637-8dd7-1db44bc7166e service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Updating instance_info_cache with network_info: [{"id": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e", "address": "fa:16:3e:f9:e2:65", "network": {"id": "92b9d247-3013-4a97-9ca0-41643807ce1e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-923461645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3522bbcc-41", "ovs_interfaceid": "3522bbcc-4190-48e3-ab01-ae36f8d6d64e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eee87019-7923-4e16-8e15-f2a1010616e3", "address": "fa:16:3e:6c:ff:19", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeee87019-79", "ovs_interfaceid": "eee87019-7923-4e16-8e15-f2a1010616e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fd852601-98a3-4811-8bf5-120906e84646", "address": "fa:16:3e:cd:ab:83", "network": {"id": "08a79a3b-5c3d-4923-b568-4655661083a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-488189705", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd852601-98", "ovs_interfaceid": "fd852601-98a3-4811-8bf5-120906e84646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd", "address": "fa:16:3e:0f:ad:4f", "network": {"id": "9169c3c6-6243-44ce-8070-5991e81046ce", "bridge": "br-int", "label": "tempest-device-tagging-net2-1541501115", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "113733a7b1f9424bb5243107472b01c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap933d0949-bd", "ovs_interfaceid": "933d0949-bd1a-4905-ae6a-e15e6b6e72dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:43:47 user nova-compute[71498]: DEBUG nova.compute.manager [req-bbe5b4e2-4bcb-46e4-9ac0-60d26cd728c9 req-121a846b-5182-4637-8dd7-1db44bc7166e service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Detach interface failed, port_id=d44e7f03-f338-4efa-b6b4-fb90d22aa37c, reason: Instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 could not be found. {{(pid=71498) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 01:43:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:47 user nova-compute[71498]: DEBUG nova.network.neutron [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Successfully updated port: 4146457e-4b16-4c22-afd2-ffae8a58c0c5 {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:43:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "refresh_cache-73fd9bc1-af0f-41e9-adea-d73323b4a76c" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:43:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquired lock "refresh_cache-73fd9bc1-af0f-41e9-adea-d73323b4a76c" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:43:47 user nova-compute[71498]: DEBUG nova.network.neutron [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:43:47 user nova-compute[71498]: DEBUG nova.compute.manager [req-f0690549-bbdc-4714-8cc9-c38e8c158691 req-b6a4c134-90f6-45d7-b83b-54d6beb7dee3 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Received event network-changed-4146457e-4b16-4c22-afd2-ffae8a58c0c5 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:47 user nova-compute[71498]: DEBUG nova.compute.manager [req-f0690549-bbdc-4714-8cc9-c38e8c158691 req-b6a4c134-90f6-45d7-b83b-54d6beb7dee3 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Refreshing instance network info cache due to event network-changed-4146457e-4b16-4c22-afd2-ffae8a58c0c5. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:43:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f0690549-bbdc-4714-8cc9-c38e8c158691 req-b6a4c134-90f6-45d7-b83b-54d6beb7dee3 service nova] Acquiring lock "refresh_cache-73fd9bc1-af0f-41e9-adea-d73323b4a76c" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:43:47 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:43:47 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Took 3.45 seconds to deallocate network for instance.
Apr 14 01:43:47 user nova-compute[71498]: DEBUG nova.network.neutron [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:43:48 user nova-compute[71498]: DEBUG nova.network.neutron [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Updating instance_info_cache with network_info: [{"id": "4146457e-4b16-4c22-afd2-ffae8a58c0c5", "address": "fa:16:3e:4c:4f:e1", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4146457e-4b", "ovs_interfaceid": "4146457e-4b16-4c22-afd2-ffae8a58c0c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:43:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Releasing lock "refresh_cache-73fd9bc1-af0f-41e9-adea-d73323b4a76c" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:43:48 user nova-compute[71498]: DEBUG nova.compute.manager [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Instance network_info: |[{"id": "4146457e-4b16-4c22-afd2-ffae8a58c0c5", "address": "fa:16:3e:4c:4f:e1", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4146457e-4b", "ovs_interfaceid": "4146457e-4b16-4c22-afd2-ffae8a58c0c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 01:43:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f0690549-bbdc-4714-8cc9-c38e8c158691 req-b6a4c134-90f6-45d7-b83b-54d6beb7dee3 service nova] Acquired lock "refresh_cache-73fd9bc1-af0f-41e9-adea-d73323b4a76c" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:43:48 user nova-compute[71498]: DEBUG nova.network.neutron [req-f0690549-bbdc-4714-8cc9-c38e8c158691 req-b6a4c134-90f6-45d7-b83b-54d6beb7dee3 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Refreshing network info cache for port 4146457e-4b16-4c22-afd2-ffae8a58c0c5 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:43:48 user nova-compute[71498]: DEBUG nova.network.neutron [req-f0690549-bbdc-4714-8cc9-c38e8c158691 req-b6a4c134-90f6-45d7-b83b-54d6beb7dee3 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Updated VIF entry in instance network info cache for port 4146457e-4b16-4c22-afd2-ffae8a58c0c5. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:43:48 user nova-compute[71498]: DEBUG nova.network.neutron [req-f0690549-bbdc-4714-8cc9-c38e8c158691 req-b6a4c134-90f6-45d7-b83b-54d6beb7dee3 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Updating instance_info_cache with network_info: [{"id": "4146457e-4b16-4c22-afd2-ffae8a58c0c5", "address": "fa:16:3e:4c:4f:e1", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4146457e-4b", "ovs_interfaceid": "4146457e-4b16-4c22-afd2-ffae8a58c0c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:43:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f0690549-bbdc-4714-8cc9-c38e8c158691 req-b6a4c134-90f6-45d7-b83b-54d6beb7dee3 service nova] Releasing lock "refresh_cache-73fd9bc1-af0f-41e9-adea-d73323b4a76c" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:43:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:49 user nova-compute[71498]: DEBUG nova.compute.manager [req-adef6b17-4310-4182-80e0-3e45cc49cb8b req-bd15eb40-4f98-40c7-bb8a-d771426f88bb service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-deleted-3522bbcc-4190-48e3-ab01-ae36f8d6d64e {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:49 user nova-compute[71498]: DEBUG nova.compute.manager [req-adef6b17-4310-4182-80e0-3e45cc49cb8b req-bd15eb40-4f98-40c7-bb8a-d771426f88bb service nova] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Received event network-vif-deleted-933d0949-bd1a-4905-ae6a-e15e6b6e72dd {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:50 user nova-compute[71498]: INFO nova.compute.manager [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Took 2.34 seconds to detach 3 volumes for instance.
Apr 14 01:43:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:50 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:43:50 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:43:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:50 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Deleted allocations for instance bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5
Apr 14 01:43:50 user nova-compute[71498]: DEBUG os_brick.utils [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:43:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:50 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc916f7-2585-479f-a0c1-85fb3c82fa5c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:50 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ee0859-a686-408a-8097-154847e13096]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:50 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[97726b78-144c-4a1d-b843-5c49b0da24d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:50 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5a2ff9-1d9a-4566-a363-cfb449913fe2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:43:50 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:43:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dc5ad2e2-6b02-4434-844a-c0acff3239c8 tempest-TaggedBootDevicesTest-135372045 tempest-TaggedBootDevicesTest-135372045-project-member] Lock "bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.385s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:43:50 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:43:50 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0985663c-6cc7-4f33-920b-040877e05a03]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:50 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:43:50 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:43:50 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:43:50 user nova-compute[71498]: DEBUG os_brick.utils [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:43:50 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Updating existing volume attachment record: ae1038cb-9890-4797-aade-3705c75e2976 {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:43:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG nova.compute.manager [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:43:55 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Creating image(s)
Apr 14 01:43:55 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Did not create local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Ensure instance console log exists: /opt/stack/data/nova/instances/73fd9bc1-af0f-41e9-adea-d73323b4a76c/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Start _get_guest_xml network_info=[{"id": "4146457e-4b16-4c22-afd2-ffae8a58c0c5", "address": "fa:16:3e:4c:4f:e1", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4146457e-4b", "ovs_interfaceid": "4146457e-4b16-4c22-afd2-ffae8a58c0c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ae1038cb-9890-4797-aade-3705c75e2976', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hCwSrpEd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '73fd9bc1-af0f-41e9-adea-d73323b4a76c', 'attached_at': '', 'detached_at': '', 'volume_id': '0856ebd5-320b-4f5a-b305-4b1a0be6fb22', 'serial': '0856ebd5-320b-4f5a-b305-4b1a0be6fb22'}, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:43:55 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:43:55 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:43:55 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hCwSrpEd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:43:55 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:43:55 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:43:55 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:43:55 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:43:55 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[249b626e-f721-4010-878e-3424ea525fd7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:43:55 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4517b28c-eb42-40a9-b22a-80761c9aa9f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22] added
Apr 14 01:43:55 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d41867c-0edc-4f64-8135-2abe7eb536e8]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2911c9-85eb-49dc-8f20-0326b99af7f5]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hCwSrpEd {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hCwSrpEd" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a8e70a-a3f8-4b19-8791-83f0a4ec3aef]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hCwSrpEd'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd6028e-4360-49ab-bcae-e94b5fd17477]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e23ed23-6825-475f-b377-572711d9bb51]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:55 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:55 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[83dac803-f327-494c-9ca1-8ee137e149ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22, portal: 172.16.0.220,3260]
Apr 14 01:43:55 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22, portal: 172.16.0.220,3260] successful.
Apr 14 01:43:55 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.056s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1ae8b1-b758-459b-b4cf-43b125e3fdd9]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebc0528-92cc-4113-8894-8385a8dd44b5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:43:55 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:55 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:43:55 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:43:55 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b507d4-12c5-4596-ac7c-c4ec48c6ae96]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:43:55 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hCwSrpEd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:43:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "f045ae6d-889e-40c0-bd71-9b107dba9a70" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "f045ae6d-889e-40c0-bd71-9b107dba9a70" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:56 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:43:56 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23539636265343736', 'path': '/dev/sdb'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:43:56 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539636265343736', 'path': '/dev/sdb'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:43:56 user nova-compute[71498]: DEBUG nova.compute.manager [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 01:43:56 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:43:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2126586208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2126586208',id=14,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='219c39c8299e46368012a947fdfbe5fd',ramdisk_id='',reservation_id='r-vg1kmosh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-85797606',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:43:45Z,user_data=None,user_id='7ed01a83531f4c6bb18a4593284baf05',uuid=73fd9bc1-af0f-41e9-adea-d73323b4a76c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4146457e-4b16-4c22-afd2-ffae8a58c0c5", "address": "fa:16:3e:4c:4f:e1", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4146457e-4b", "ovs_interfaceid": "4146457e-4b16-4c22-afd2-ffae8a58c0c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:43:56 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Converting VIF {"id": "4146457e-4b16-4c22-afd2-ffae8a58c0c5", "address": "fa:16:3e:4c:4f:e1", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4146457e-4b", "ovs_interfaceid": "4146457e-4b16-4c22-afd2-ffae8a58c0c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:43:56 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:4f:e1,bridge_name='br-int',has_traffic_filtering=True,id=4146457e-4b16-4c22-afd2-ffae8a58c0c5,network=Network(365cbeec-3756-4258-a135-04112bdda4b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4146457e-4b') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:43:56 user nova-compute[71498]: DEBUG nova.objects.instance [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lazy-loading 'pci_devices' on Instance uuid 73fd9bc1-af0f-41e9-adea-d73323b4a76c {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:43:56 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:43:56 user nova-compute[71498]:   <uuid>73fd9bc1-af0f-41e9-adea-d73323b4a76c</uuid>
Apr 14 01:43:56 user nova-compute[71498]:   <name>instance-0000000e</name>
Apr 14 01:43:56 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:43:56 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:43:56 user nova-compute[71498]:   <metadata>
Apr 14 01:43:56 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:43:56 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:43:56 user nova-compute[71498]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2126586208</nova:name>
Apr 14 01:43:56 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:43:55</nova:creationTime>
Apr 14 01:43:56 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:43:56 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:43:56 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:43:56 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:43:56 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:43:56 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:43:56 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:43:56 user nova-compute[71498]:       <nova:owner>
Apr 14 01:43:56 user nova-compute[71498]:         <nova:user uuid="7ed01a83531f4c6bb18a4593284baf05">tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member</nova:user>
Apr 14 01:43:56 user nova-compute[71498]:         <nova:project uuid="219c39c8299e46368012a947fdfbe5fd">tempest-ServerBootFromVolumeStableRescueTest-85797606</nova:project>
Apr 14 01:43:56 user nova-compute[71498]:       </nova:owner>
Apr 14 01:43:56 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:43:56 user nova-compute[71498]:       <nova:ports>
Apr 14 01:43:56 user nova-compute[71498]:         <nova:port uuid="4146457e-4b16-4c22-afd2-ffae8a58c0c5">
Apr 14 01:43:56 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 01:43:56 user nova-compute[71498]:         </nova:port>
Apr 14 01:43:56 user nova-compute[71498]:       </nova:ports>
Apr 14 01:43:56 user nova-compute[71498]:     </nova:instance>
Apr 14 01:43:56 user nova-compute[71498]:   </metadata>
Apr 14 01:43:56 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:43:56 user nova-compute[71498]:     <system>
Apr 14 01:43:56 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:43:56 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:43:56 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:43:56 user nova-compute[71498]:       <entry name="serial">73fd9bc1-af0f-41e9-adea-d73323b4a76c</entry>
Apr 14 01:43:56 user nova-compute[71498]:       <entry name="uuid">73fd9bc1-af0f-41e9-adea-d73323b4a76c</entry>
Apr 14 01:43:56 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:43:56 user nova-compute[71498]:     </system>
Apr 14 01:43:56 user nova-compute[71498]:   </sysinfo>
Apr 14 01:43:56 user nova-compute[71498]:   <os>
Apr 14 01:43:56 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:43:56 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:43:56 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:43:56 user nova-compute[71498]:   </os>
Apr 14 01:43:56 user nova-compute[71498]:   <features>
Apr 14 01:43:56 user nova-compute[71498]:     <acpi/>
Apr 14 01:43:56 user nova-compute[71498]:     <apic/>
Apr 14 01:43:56 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:43:56 user nova-compute[71498]:   </features>
Apr 14 01:43:56 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:43:56 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:43:56 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:43:56 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:43:56 user nova-compute[71498]:   </clock>
Apr 14 01:43:56 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:43:56 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:43:56 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:43:56 user nova-compute[71498]:   </cpu>
Apr 14 01:43:56 user nova-compute[71498]:   <devices>
Apr 14 01:43:56 user nova-compute[71498]:     <disk type="block" device="disk">
Apr 14 01:43:56 user nova-compute[71498]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:43:56 user nova-compute[71498]:       <source dev="/dev/sdb"/>
Apr 14 01:43:56 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:43:56 user nova-compute[71498]:       <serial>0856ebd5-320b-4f5a-b305-4b1a0be6fb22</serial>
Apr 14 01:43:56 user nova-compute[71498]:     </disk>
Apr 14 01:43:56 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:43:56 user nova-compute[71498]:       <mac address="fa:16:3e:4c:4f:e1"/>
Apr 14 01:43:56 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:43:56 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:43:56 user nova-compute[71498]:       <target dev="tap4146457e-4b"/>
Apr 14 01:43:56 user nova-compute[71498]:     </interface>
Apr 14 01:43:56 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:43:56 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/73fd9bc1-af0f-41e9-adea-d73323b4a76c/console.log" append="off"/>
Apr 14 01:43:56 user nova-compute[71498]:     </serial>
Apr 14 01:43:56 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:43:56 user nova-compute[71498]:     <video>
Apr 14 01:43:56 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:43:56 user nova-compute[71498]:     </video>
Apr 14 01:43:56 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:43:56 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:43:56 user nova-compute[71498]:     </rng>
Apr 14 01:43:56 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:43:56 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:43:56 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:43:56 user nova-compute[71498]:     </memballoon>
Apr 14 01:43:56 user nova-compute[71498]:   </devices>
Apr 14 01:43:56 user nova-compute[71498]: </domain>
Apr 14 01:43:56 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:43:56 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:43:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2126586208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2126586208',id=14,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='219c39c8299e46368012a947fdfbe5fd',ramdisk_id='',reservation_id='r-vg1kmosh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-85797606',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:43:45Z,user_data=None,user_id='7ed01a83531f4c6bb18a4593284baf05',uuid=73fd9bc1-af0f-41e9-adea-d73323b4a76c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4146457e-4b16-4c22-afd2-ffae8a58c0c5", "address": "fa:16:3e:4c:4f:e1", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4146457e-4b", "ovs_interfaceid": "4146457e-4b16-4c22-afd2-ffae8a58c0c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:43:56 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Converting VIF {"id": "4146457e-4b16-4c22-afd2-ffae8a58c0c5", "address": "fa:16:3e:4c:4f:e1", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4146457e-4b", "ovs_interfaceid": "4146457e-4b16-4c22-afd2-ffae8a58c0c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:43:56 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:4f:e1,bridge_name='br-int',has_traffic_filtering=True,id=4146457e-4b16-4c22-afd2-ffae8a58c0c5,network=Network(365cbeec-3756-4258-a135-04112bdda4b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4146457e-4b') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:43:56 user nova-compute[71498]: DEBUG os_vif [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:4f:e1,bridge_name='br-int',has_traffic_filtering=True,id=4146457e-4b16-4c22-afd2-ffae8a58c0c5,network=Network(365cbeec-3756-4258-a135-04112bdda4b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4146457e-4b') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:43:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:43:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:43:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4146457e-4b, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:43:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4146457e-4b, col_values=(('external_ids', {'iface-id': '4146457e-4b16-4c22-afd2-ffae8a58c0c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:4f:e1', 'vm-uuid': '73fd9bc1-af0f-41e9-adea-d73323b4a76c'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:43:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:43:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:56 user nova-compute[71498]: INFO os_vif [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:4f:e1,bridge_name='br-int',has_traffic_filtering=True,id=4146457e-4b16-4c22-afd2-ffae8a58c0c5,network=Network(365cbeec-3756-4258-a135-04112bdda4b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4146457e-4b')
Apr 14 01:43:56 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:43:56 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] No VIF found with MAC fa:16:3e:4c:4f:e1, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:43:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:56 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:43:56 user nova-compute[71498]: INFO nova.compute.claims [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Claim successful on node user
Apr 14 01:43:57 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:43:57 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:43:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.452s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:57 user nova-compute[71498]: DEBUG nova.compute.manager [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 01:43:57 user nova-compute[71498]: DEBUG nova.compute.manager [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 01:43:57 user nova-compute[71498]: DEBUG nova.network.neutron [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:43:57 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 01:43:57 user nova-compute[71498]: DEBUG nova.compute.manager [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 01:43:57 user nova-compute[71498]: DEBUG nova.policy [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bbaf843e44ff4359a15ab6d625134b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a409270d6d4d408de33c5e71a56da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:43:57 user nova-compute[71498]: DEBUG nova.compute.manager [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 01:43:57 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:43:57 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Creating image(s)
Apr 14 01:43:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "/opt/stack/data/nova/instances/f045ae6d-889e-40c0-bd71-9b107dba9a70/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "/opt/stack/data/nova/instances/f045ae6d-889e-40c0-bd71-9b107dba9a70/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "/opt/stack/data/nova/instances/f045ae6d-889e-40c0-bd71-9b107dba9a70/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:57 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681436622.4700336, bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5 => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:43:57 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] VM Stopped (Lifecycle Event)
Apr 14 01:43:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:57 user nova-compute[71498]: DEBUG nova.compute.manager [None req-9d0d82c9-cffd-44bb-8ea2-291d230fa051 None None] [instance: bf7cb2a2-82b1-4e79-80bf-ea1b94345fe5] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:43:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.151s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.136s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/f045ae6d-889e-40c0-bd71-9b107dba9a70/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/f045ae6d-889e-40c0-bd71-9b107dba9a70/disk 1073741824" returned: 0 in 0.050s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.161s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:57 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f045ae6d-889e-40c0-bd71-9b107dba9a70/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 01:43:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f045ae6d-889e-40c0-bd71-9b107dba9a70/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:43:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:58 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f045ae6d-889e-40c0-bd71-9b107dba9a70/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:43:58 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Cannot resize image /opt/stack/data/nova/instances/f045ae6d-889e-40c0-bd71-9b107dba9a70/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 01:43:58 user nova-compute[71498]: DEBUG nova.objects.instance [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lazy-loading 'migration_context' on Instance uuid f045ae6d-889e-40c0-bd71-9b107dba9a70 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:43:58 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 01:43:58 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Ensure instance console log exists: /opt/stack/data/nova/instances/f045ae6d-889e-40c0-bd71-9b107dba9a70/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:43:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:58 user nova-compute[71498]: DEBUG nova.network.neutron [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Successfully created port: 100274c1-800c-4d7f-a6b2-f3f74ec1d682 {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:43:58 user nova-compute[71498]: DEBUG nova.compute.manager [req-ba99df5a-e1fe-409e-974d-2f71213df76e req-bf59196b-4066-44cc-ad9f-281ea7f434ce service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Received event network-vif-plugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ba99df5a-e1fe-409e-974d-2f71213df76e req-bf59196b-4066-44cc-ad9f-281ea7f434ce service nova] Acquiring lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:43:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ba99df5a-e1fe-409e-974d-2f71213df76e req-bf59196b-4066-44cc-ad9f-281ea7f434ce service nova] Lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:43:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ba99df5a-e1fe-409e-974d-2f71213df76e req-bf59196b-4066-44cc-ad9f-281ea7f434ce service nova] Lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:43:58 user nova-compute[71498]: DEBUG nova.compute.manager [req-ba99df5a-e1fe-409e-974d-2f71213df76e req-bf59196b-4066-44cc-ad9f-281ea7f434ce service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] No waiting events found dispatching network-vif-plugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:43:58 user nova-compute[71498]: WARNING nova.compute.manager [req-ba99df5a-e1fe-409e-974d-2f71213df76e req-bf59196b-4066-44cc-ad9f-281ea7f434ce service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Received unexpected event network-vif-plugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 for instance with vm_state building and task_state spawning.
Apr 14 01:43:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:58 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681436623.8199682, 9397a9e2-b5e9-47e7-b25e-5c40379a60eb => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:43:58 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] VM Stopped (Lifecycle Event)
Apr 14 01:43:58 user nova-compute[71498]: DEBUG nova.compute.manager [None req-42522c48-86e9-40f1-985c-e7fb238f69e5 None None] [instance: 9397a9e2-b5e9-47e7-b25e-5c40379a60eb] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:43:58 user nova-compute[71498]: DEBUG nova.network.neutron [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Successfully updated port: 100274c1-800c-4d7f-a6b2-f3f74ec1d682 {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:43:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "refresh_cache-f045ae6d-889e-40c0-bd71-9b107dba9a70" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:43:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquired lock "refresh_cache-f045ae6d-889e-40c0-bd71-9b107dba9a70" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:43:58 user nova-compute[71498]: DEBUG nova.network.neutron [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:43:58 user nova-compute[71498]: DEBUG nova.compute.manager [req-9efa11f2-c763-4982-adf4-fb5cd433a0c3 req-3b99b98a-ff32-49c0-8811-81dccaad4af4 service nova] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Received event network-changed-100274c1-800c-4d7f-a6b2-f3f74ec1d682 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:43:58 user nova-compute[71498]: DEBUG nova.compute.manager [req-9efa11f2-c763-4982-adf4-fb5cd433a0c3 req-3b99b98a-ff32-49c0-8811-81dccaad4af4 service nova] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Refreshing instance network info cache due to event network-changed-100274c1-800c-4d7f-a6b2-f3f74ec1d682. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:43:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-9efa11f2-c763-4982-adf4-fb5cd433a0c3 req-3b99b98a-ff32-49c0-8811-81dccaad4af4 service nova] Acquiring lock "refresh_cache-f045ae6d-889e-40c0-bd71-9b107dba9a70" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG nova.network.neutron [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG nova.network.neutron [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Updating instance_info_cache with network_info: [{"id": "100274c1-800c-4d7f-a6b2-f3f74ec1d682", "address": "fa:16:3e:d7:62:7d", "network": {"id": "6569db42-40ba-4426-a76b-b3e64ecae5b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1148770119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a409270d6d4d408de33c5e71a56da9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap100274c1-80", "ovs_interfaceid": "100274c1-800c-4d7f-a6b2-f3f74ec1d682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Releasing lock "refresh_cache-f045ae6d-889e-40c0-bd71-9b107dba9a70" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG nova.compute.manager [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Instance network_info: |[{"id": "100274c1-800c-4d7f-a6b2-f3f74ec1d682", "address": "fa:16:3e:d7:62:7d", "network": {"id": "6569db42-40ba-4426-a76b-b3e64ecae5b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1148770119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a409270d6d4d408de33c5e71a56da9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap100274c1-80", "ovs_interfaceid": "100274c1-800c-4d7f-a6b2-f3f74ec1d682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-9efa11f2-c763-4982-adf4-fb5cd433a0c3 req-3b99b98a-ff32-49c0-8811-81dccaad4af4 service nova] Acquired lock "refresh_cache-f045ae6d-889e-40c0-bd71-9b107dba9a70" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG nova.network.neutron [req-9efa11f2-c763-4982-adf4-fb5cd433a0c3 req-3b99b98a-ff32-49c0-8811-81dccaad4af4 service nova] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Refreshing network info cache for port 100274c1-800c-4d7f-a6b2-f3f74ec1d682 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Start _get_guest_xml network_info=[{"id": "100274c1-800c-4d7f-a6b2-f3f74ec1d682", "address": "fa:16:3e:d7:62:7d", "network": {"id": "6569db42-40ba-4426-a76b-b3e64ecae5b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1148770119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a409270d6d4d408de33c5e71a56da9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap100274c1-80", "ovs_interfaceid": "100274c1-800c-4d7f-a6b2-f3f74ec1d682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:43:59 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:43:59 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:43:59 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:43:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2127231950',display_name='tempest-VolumesAdminNegativeTest-server-2127231950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2127231950',id=15,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0a409270d6d4d408de33c5e71a56da9',ramdisk_id='',reservation_id='r-yhgdf38j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1981219566',owner_user_name='tempest-VolumesAdminNegativeTest-1981219566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:43:57Z,user_data=None,user_id='bbaf843e44ff4359a15ab6d625134b07',uuid=f045ae6d-889e-40c0-bd71-9b107dba9a70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "100274c1-800c-4d7f-a6b2-f3f74ec1d682", "address": "fa:16:3e:d7:62:7d", "network": {"id": "6569db42-40ba-4426-a76b-b3e64ecae5b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1148770119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a409270d6d4d408de33c5e71a56da9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap100274c1-80", "ovs_interfaceid": "100274c1-800c-4d7f-a6b2-f3f74ec1d682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Converting VIF {"id": "100274c1-800c-4d7f-a6b2-f3f74ec1d682", "address": "fa:16:3e:d7:62:7d", "network": {"id": "6569db42-40ba-4426-a76b-b3e64ecae5b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1148770119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a409270d6d4d408de33c5e71a56da9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap100274c1-80", "ovs_interfaceid": "100274c1-800c-4d7f-a6b2-f3f74ec1d682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:62:7d,bridge_name='br-int',has_traffic_filtering=True,id=100274c1-800c-4d7f-a6b2-f3f74ec1d682,network=Network(6569db42-40ba-4426-a76b-b3e64ecae5b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap100274c1-80') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG nova.objects.instance [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lazy-loading 'pci_devices' on Instance uuid f045ae6d-889e-40c0-bd71-9b107dba9a70 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:43:59 user nova-compute[71498]:   <uuid>f045ae6d-889e-40c0-bd71-9b107dba9a70</uuid>
Apr 14 01:43:59 user nova-compute[71498]:   <name>instance-0000000f</name>
Apr 14 01:43:59 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:43:59 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:43:59 user nova-compute[71498]:   <metadata>
Apr 14 01:43:59 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:43:59 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:43:59 user nova-compute[71498]:       <nova:name>tempest-VolumesAdminNegativeTest-server-2127231950</nova:name>
Apr 14 01:43:59 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:43:59</nova:creationTime>
Apr 14 01:43:59 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:43:59 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:43:59 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:43:59 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:43:59 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:43:59 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:43:59 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:43:59 user nova-compute[71498]:       <nova:owner>
Apr 14 01:43:59 user nova-compute[71498]:         <nova:user uuid="bbaf843e44ff4359a15ab6d625134b07">tempest-VolumesAdminNegativeTest-1981219566-project-member</nova:user>
Apr 14 01:43:59 user nova-compute[71498]:         <nova:project uuid="d0a409270d6d4d408de33c5e71a56da9">tempest-VolumesAdminNegativeTest-1981219566</nova:project>
Apr 14 01:43:59 user nova-compute[71498]:       </nova:owner>
Apr 14 01:43:59 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:43:59 user nova-compute[71498]:       <nova:ports>
Apr 14 01:43:59 user nova-compute[71498]:         <nova:port uuid="100274c1-800c-4d7f-a6b2-f3f74ec1d682">
Apr 14 01:43:59 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 01:43:59 user nova-compute[71498]:         </nova:port>
Apr 14 01:43:59 user nova-compute[71498]:       </nova:ports>
Apr 14 01:43:59 user nova-compute[71498]:     </nova:instance>
Apr 14 01:43:59 user nova-compute[71498]:   </metadata>
Apr 14 01:43:59 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:43:59 user nova-compute[71498]:     <system>
Apr 14 01:43:59 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:43:59 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:43:59 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:43:59 user nova-compute[71498]:       <entry name="serial">f045ae6d-889e-40c0-bd71-9b107dba9a70</entry>
Apr 14 01:43:59 user nova-compute[71498]:       <entry name="uuid">f045ae6d-889e-40c0-bd71-9b107dba9a70</entry>
Apr 14 01:43:59 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:43:59 user nova-compute[71498]:     </system>
Apr 14 01:43:59 user nova-compute[71498]:   </sysinfo>
Apr 14 01:43:59 user nova-compute[71498]:   <os>
Apr 14 01:43:59 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:43:59 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:43:59 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:43:59 user nova-compute[71498]:   </os>
Apr 14 01:43:59 user nova-compute[71498]:   <features>
Apr 14 01:43:59 user nova-compute[71498]:     <acpi/>
Apr 14 01:43:59 user nova-compute[71498]:     <apic/>
Apr 14 01:43:59 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:43:59 user nova-compute[71498]:   </features>
Apr 14 01:43:59 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:43:59 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:43:59 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:43:59 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:43:59 user nova-compute[71498]:   </clock>
Apr 14 01:43:59 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:43:59 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:43:59 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:43:59 user nova-compute[71498]:   </cpu>
Apr 14 01:43:59 user nova-compute[71498]:   <devices>
Apr 14 01:43:59 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:43:59 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:43:59 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/f045ae6d-889e-40c0-bd71-9b107dba9a70/disk"/>
Apr 14 01:43:59 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:43:59 user nova-compute[71498]:     </disk>
Apr 14 01:43:59 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:43:59 user nova-compute[71498]:       <mac address="fa:16:3e:d7:62:7d"/>
Apr 14 01:43:59 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:43:59 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:43:59 user nova-compute[71498]:       <target dev="tap100274c1-80"/>
Apr 14 01:43:59 user nova-compute[71498]:     </interface>
Apr 14 01:43:59 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:43:59 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/f045ae6d-889e-40c0-bd71-9b107dba9a70/console.log" append="off"/>
Apr 14 01:43:59 user nova-compute[71498]:     </serial>
Apr 14 01:43:59 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:43:59 user nova-compute[71498]:     <video>
Apr 14 01:43:59 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:43:59 user nova-compute[71498]:     </video>
Apr 14 01:43:59 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:43:59 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:43:59 user nova-compute[71498]:     </rng>
Apr 14 01:43:59 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:43:59 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:43:59 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:43:59 user nova-compute[71498]:     </memballoon>
Apr 14 01:43:59 user nova-compute[71498]:   </devices>
Apr 14 01:43:59 user nova-compute[71498]: </domain>
Apr 14 01:43:59 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:43:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2127231950',display_name='tempest-VolumesAdminNegativeTest-server-2127231950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2127231950',id=15,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0a409270d6d4d408de33c5e71a56da9',ramdisk_id='',reservation_id='r-yhgdf38j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1981219566',owner_user_name='tempest-VolumesAdminNegativeTest-1981219566-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:43:57Z,user_data=None,user_id='bbaf843e44ff4359a15ab6d625134b07',uuid=f045ae6d-889e-40c0-bd71-9b107dba9a70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "100274c1-800c-4d7f-a6b2-f3f74ec1d682", "address": "fa:16:3e:d7:62:7d", "network": {"id": "6569db42-40ba-4426-a76b-b3e64ecae5b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1148770119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a409270d6d4d408de33c5e71a56da9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap100274c1-80", "ovs_interfaceid": "100274c1-800c-4d7f-a6b2-f3f74ec1d682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Converting VIF {"id": "100274c1-800c-4d7f-a6b2-f3f74ec1d682", "address": "fa:16:3e:d7:62:7d", "network": {"id": "6569db42-40ba-4426-a76b-b3e64ecae5b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1148770119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a409270d6d4d408de33c5e71a56da9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap100274c1-80", "ovs_interfaceid": "100274c1-800c-4d7f-a6b2-f3f74ec1d682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:62:7d,bridge_name='br-int',has_traffic_filtering=True,id=100274c1-800c-4d7f-a6b2-f3f74ec1d682,network=Network(6569db42-40ba-4426-a76b-b3e64ecae5b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap100274c1-80') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG os_vif [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:62:7d,bridge_name='br-int',has_traffic_filtering=True,id=100274c1-800c-4d7f-a6b2-f3f74ec1d682,network=Network(6569db42-40ba-4426-a76b-b3e64ecae5b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap100274c1-80') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap100274c1-80, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap100274c1-80, col_values=(('external_ids', {'iface-id': '100274c1-800c-4d7f-a6b2-f3f74ec1d682', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:62:7d', 'vm-uuid': 'f045ae6d-889e-40c0-bd71-9b107dba9a70'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:43:59 user nova-compute[71498]: INFO os_vif [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:62:7d,bridge_name='br-int',has_traffic_filtering=True,id=100274c1-800c-4d7f-a6b2-f3f74ec1d682,network=Network(6569db42-40ba-4426-a76b-b3e64ecae5b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap100274c1-80')
Apr 14 01:43:59 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] No VIF found with MAC fa:16:3e:d7:62:7d, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG nova.network.neutron [req-9efa11f2-c763-4982-adf4-fb5cd433a0c3 req-3b99b98a-ff32-49c0-8811-81dccaad4af4 service nova] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Updated VIF entry in instance network info cache for port 100274c1-800c-4d7f-a6b2-f3f74ec1d682. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG nova.network.neutron [req-9efa11f2-c763-4982-adf4-fb5cd433a0c3 req-3b99b98a-ff32-49c0-8811-81dccaad4af4 service nova] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Updating instance_info_cache with network_info: [{"id": "100274c1-800c-4d7f-a6b2-f3f74ec1d682", "address": "fa:16:3e:d7:62:7d", "network": {"id": "6569db42-40ba-4426-a76b-b3e64ecae5b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1148770119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a409270d6d4d408de33c5e71a56da9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap100274c1-80", "ovs_interfaceid": "100274c1-800c-4d7f-a6b2-f3f74ec1d682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:43:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-9efa11f2-c763-4982-adf4-fb5cd433a0c3 req-3b99b98a-ff32-49c0-8811-81dccaad4af4 service nova] Releasing lock "refresh_cache-f045ae6d-889e-40c0-bd71-9b107dba9a70" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:44:00 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436640.1870646, 73fd9bc1-af0f-41e9-adea-d73323b4a76c => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:44:00 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] VM Resumed (Lifecycle Event)
Apr 14 01:44:00 user nova-compute[71498]: DEBUG nova.compute.manager [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:44:00 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:44:00 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Instance spawned successfully.
Apr 14 01:44:00 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:44:00 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:44:00 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:44:00 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:44:00 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:44:00 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:44:00 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:44:00 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:44:00 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:44:00 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:44:00 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436640.1886215, 73fd9bc1-af0f-41e9-adea-d73323b4a76c => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:44:00 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] VM Started (Lifecycle Event)
Apr 14 01:44:00 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:44:00 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:44:00 user nova-compute[71498]: DEBUG nova.compute.manager [req-a79c2b52-a162-4be5-aa4b-4e7e89999175 req-7200e711-46ce-4903-9915-d44de92059a3 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Received event network-vif-plugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:44:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a79c2b52-a162-4be5-aa4b-4e7e89999175 req-7200e711-46ce-4903-9915-d44de92059a3 service nova] Acquiring lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a79c2b52-a162-4be5-aa4b-4e7e89999175 req-7200e711-46ce-4903-9915-d44de92059a3 service nova] Lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a79c2b52-a162-4be5-aa4b-4e7e89999175 req-7200e711-46ce-4903-9915-d44de92059a3 service nova] Lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:00 user nova-compute[71498]: DEBUG nova.compute.manager [req-a79c2b52-a162-4be5-aa4b-4e7e89999175 req-7200e711-46ce-4903-9915-d44de92059a3 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] No waiting events found dispatching network-vif-plugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:44:00 user nova-compute[71498]: WARNING nova.compute.manager [req-a79c2b52-a162-4be5-aa4b-4e7e89999175 req-7200e711-46ce-4903-9915-d44de92059a3 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Received unexpected event network-vif-plugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 for instance with vm_state building and task_state spawning.
Apr 14 01:44:00 user nova-compute[71498]: INFO nova.compute.manager [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Took 5.15 seconds to spawn the instance on the hypervisor.
Apr 14 01:44:00 user nova-compute[71498]: DEBUG nova.compute.manager [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:44:00 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:44:00 user nova-compute[71498]: INFO nova.compute.manager [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Took 16.12 seconds to build instance.
Apr 14 01:44:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e74ea766-ad24-4f86-a2d5-f66e163582f6 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.219s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:00 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:00 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:00 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:00 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:01 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:01 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:02 user nova-compute[71498]: DEBUG nova.compute.manager [req-5ae7c3ca-8a1f-4a4f-8f7e-7e05e971e3c2 req-a3783ab6-b85e-4ea7-a742-253bca662a91 service nova] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Received event network-vif-plugged-100274c1-800c-4d7f-a6b2-f3f74ec1d682 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:44:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5ae7c3ca-8a1f-4a4f-8f7e-7e05e971e3c2 req-a3783ab6-b85e-4ea7-a742-253bca662a91 service nova] Acquiring lock "f045ae6d-889e-40c0-bd71-9b107dba9a70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5ae7c3ca-8a1f-4a4f-8f7e-7e05e971e3c2 req-a3783ab6-b85e-4ea7-a742-253bca662a91 service nova] Lock "f045ae6d-889e-40c0-bd71-9b107dba9a70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5ae7c3ca-8a1f-4a4f-8f7e-7e05e971e3c2 req-a3783ab6-b85e-4ea7-a742-253bca662a91 service nova] Lock "f045ae6d-889e-40c0-bd71-9b107dba9a70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:02 user nova-compute[71498]: DEBUG nova.compute.manager [req-5ae7c3ca-8a1f-4a4f-8f7e-7e05e971e3c2 req-a3783ab6-b85e-4ea7-a742-253bca662a91 service nova] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] No waiting events found dispatching network-vif-plugged-100274c1-800c-4d7f-a6b2-f3f74ec1d682 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:44:02 user nova-compute[71498]: WARNING nova.compute.manager [req-5ae7c3ca-8a1f-4a4f-8f7e-7e05e971e3c2 req-a3783ab6-b85e-4ea7-a742-253bca662a91 service nova] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Received unexpected event network-vif-plugged-100274c1-800c-4d7f-a6b2-f3f74ec1d682 for instance with vm_state building and task_state spawning.
Apr 14 01:44:02 user nova-compute[71498]: DEBUG nova.compute.manager [req-5ae7c3ca-8a1f-4a4f-8f7e-7e05e971e3c2 req-a3783ab6-b85e-4ea7-a742-253bca662a91 service nova] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Received event network-vif-plugged-100274c1-800c-4d7f-a6b2-f3f74ec1d682 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:44:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5ae7c3ca-8a1f-4a4f-8f7e-7e05e971e3c2 req-a3783ab6-b85e-4ea7-a742-253bca662a91 service nova] Acquiring lock "f045ae6d-889e-40c0-bd71-9b107dba9a70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5ae7c3ca-8a1f-4a4f-8f7e-7e05e971e3c2 req-a3783ab6-b85e-4ea7-a742-253bca662a91 service nova] Lock "f045ae6d-889e-40c0-bd71-9b107dba9a70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5ae7c3ca-8a1f-4a4f-8f7e-7e05e971e3c2 req-a3783ab6-b85e-4ea7-a742-253bca662a91 service nova] Lock "f045ae6d-889e-40c0-bd71-9b107dba9a70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:02 user nova-compute[71498]: DEBUG nova.compute.manager [req-5ae7c3ca-8a1f-4a4f-8f7e-7e05e971e3c2 req-a3783ab6-b85e-4ea7-a742-253bca662a91 service nova] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] No waiting events found dispatching network-vif-plugged-100274c1-800c-4d7f-a6b2-f3f74ec1d682 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:44:02 user nova-compute[71498]: WARNING nova.compute.manager [req-5ae7c3ca-8a1f-4a4f-8f7e-7e05e971e3c2 req-a3783ab6-b85e-4ea7-a742-253bca662a91 service nova] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Received unexpected event network-vif-plugged-100274c1-800c-4d7f-a6b2-f3f74ec1d682 for instance with vm_state building and task_state spawning.
Apr 14 01:44:02 user nova-compute[71498]: DEBUG nova.compute.manager [req-5ae7c3ca-8a1f-4a4f-8f7e-7e05e971e3c2 req-a3783ab6-b85e-4ea7-a742-253bca662a91 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Received event network-changed-9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:44:02 user nova-compute[71498]: DEBUG nova.compute.manager [req-5ae7c3ca-8a1f-4a4f-8f7e-7e05e971e3c2 req-a3783ab6-b85e-4ea7-a742-253bca662a91 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Refreshing instance network info cache due to event network-changed-9b10b56a-df5a-429e-a551-db729007648a. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:44:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5ae7c3ca-8a1f-4a4f-8f7e-7e05e971e3c2 req-a3783ab6-b85e-4ea7-a742-253bca662a91 service nova] Acquiring lock "refresh_cache-ee4cf01f-8d33-4696-b6ec-7f188ee18026" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:44:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5ae7c3ca-8a1f-4a4f-8f7e-7e05e971e3c2 req-a3783ab6-b85e-4ea7-a742-253bca662a91 service nova] Acquired lock "refresh_cache-ee4cf01f-8d33-4696-b6ec-7f188ee18026" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:44:02 user nova-compute[71498]: DEBUG nova.network.neutron [req-5ae7c3ca-8a1f-4a4f-8f7e-7e05e971e3c2 req-a3783ab6-b85e-4ea7-a742-253bca662a91 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Refreshing network info cache for port 9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:44:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:02 user nova-compute[71498]: INFO nova.compute.manager [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Shelve offloading
Apr 14 01:44:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:02 user nova-compute[71498]: DEBUG nova.compute.manager [req-5313c973-9d15-4ef5-87a7-fa53cdac0bd3 req-1da2fa51-e3d0-4301-a0fb-bba988229425 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Received event network-vif-unplugged-9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:44:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5313c973-9d15-4ef5-87a7-fa53cdac0bd3 req-1da2fa51-e3d0-4301-a0fb-bba988229425 service nova] Acquiring lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5313c973-9d15-4ef5-87a7-fa53cdac0bd3 req-1da2fa51-e3d0-4301-a0fb-bba988229425 service nova] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5313c973-9d15-4ef5-87a7-fa53cdac0bd3 req-1da2fa51-e3d0-4301-a0fb-bba988229425 service nova] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:02 user nova-compute[71498]: DEBUG nova.compute.manager [req-5313c973-9d15-4ef5-87a7-fa53cdac0bd3 req-1da2fa51-e3d0-4301-a0fb-bba988229425 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] No waiting events found dispatching network-vif-unplugged-9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:44:02 user nova-compute[71498]: WARNING nova.compute.manager [req-5313c973-9d15-4ef5-87a7-fa53cdac0bd3 req-1da2fa51-e3d0-4301-a0fb-bba988229425 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Received unexpected event network-vif-unplugged-9b10b56a-df5a-429e-a551-db729007648a for instance with vm_state active and task_state shelving.
Apr 14 01:44:03 user nova-compute[71498]: DEBUG nova.network.neutron [req-5ae7c3ca-8a1f-4a4f-8f7e-7e05e971e3c2 req-a3783ab6-b85e-4ea7-a742-253bca662a91 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Updated VIF entry in instance network info cache for port 9b10b56a-df5a-429e-a551-db729007648a. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:44:03 user nova-compute[71498]: DEBUG nova.network.neutron [req-5ae7c3ca-8a1f-4a4f-8f7e-7e05e971e3c2 req-a3783ab6-b85e-4ea7-a742-253bca662a91 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Updating instance_info_cache with network_info: [{"id": "9b10b56a-df5a-429e-a551-db729007648a", "address": "fa:16:3e:89:b1:39", "network": {"id": "4f7f7e24-860c-47ce-b635-be72e8fe2913", "bridge": "br-int", "label": "tempest-TestShelveInstance-1817709221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef081a56d11d4b4d82ba5fe6572f3b95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b10b56a-df", "ovs_interfaceid": "9b10b56a-df5a-429e-a551-db729007648a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:44:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5ae7c3ca-8a1f-4a4f-8f7e-7e05e971e3c2 req-a3783ab6-b85e-4ea7-a742-253bca662a91 service nova] Releasing lock "refresh_cache-ee4cf01f-8d33-4696-b6ec-7f188ee18026" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:44:03 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436643.0902212, f045ae6d-889e-40c0-bd71-9b107dba9a70 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:44:03 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] VM Resumed (Lifecycle Event)
Apr 14 01:44:03 user nova-compute[71498]: DEBUG nova.compute.manager [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:44:03 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:44:03 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:44:03 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Instance spawned successfully.
Apr 14 01:44:03 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:44:03 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:44:03 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:44:03 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:44:03 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:44:03 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:44:03 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:44:03 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:44:03 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:44:03 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436643.0935273, f045ae6d-889e-40c0-bd71-9b107dba9a70 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:44:03 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] VM Started (Lifecycle Event)
Apr 14 01:44:03 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:44:03 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:44:03 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:44:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:03 user nova-compute[71498]: INFO nova.compute.manager [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Took 5.88 seconds to spawn the instance on the hypervisor.
Apr 14 01:44:03 user nova-compute[71498]: DEBUG nova.compute.manager [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:44:03 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Instance destroyed successfully.
Apr 14 01:44:03 user nova-compute[71498]: DEBUG nova.compute.manager [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:44:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "refresh_cache-ee4cf01f-8d33-4696-b6ec-7f188ee18026" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:44:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquired lock "refresh_cache-ee4cf01f-8d33-4696-b6ec-7f188ee18026" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:44:03 user nova-compute[71498]: DEBUG nova.network.neutron [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:44:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:03 user nova-compute[71498]: INFO nova.compute.manager [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Took 6.69 seconds to build instance.
Apr 14 01:44:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-39d6a454-cad8-4965-9276-1c54ad95d93a tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "f045ae6d-889e-40c0-bd71-9b107dba9a70" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.831s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:04 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:04 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:04 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:04 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:04 user nova-compute[71498]: DEBUG nova.network.neutron [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Updating instance_info_cache with network_info: [{"id": "9b10b56a-df5a-429e-a551-db729007648a", "address": "fa:16:3e:89:b1:39", "network": {"id": "4f7f7e24-860c-47ce-b635-be72e8fe2913", "bridge": "br-int", "label": "tempest-TestShelveInstance-1817709221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef081a56d11d4b4d82ba5fe6572f3b95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b10b56a-df", "ovs_interfaceid": "9b10b56a-df5a-429e-a551-db729007648a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:44:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Releasing lock "refresh_cache-ee4cf01f-8d33-4696-b6ec-7f188ee18026" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:44:04 user nova-compute[71498]: DEBUG nova.compute.manager [req-f7da4df0-abf1-4e49-8a20-bb5d9fff9072 req-01202728-2d65-4e34-8274-b61707a3f878 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Received event network-vif-plugged-9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:44:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f7da4df0-abf1-4e49-8a20-bb5d9fff9072 req-01202728-2d65-4e34-8274-b61707a3f878 service nova] Acquiring lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f7da4df0-abf1-4e49-8a20-bb5d9fff9072 req-01202728-2d65-4e34-8274-b61707a3f878 service nova] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f7da4df0-abf1-4e49-8a20-bb5d9fff9072 req-01202728-2d65-4e34-8274-b61707a3f878 service nova] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:04 user nova-compute[71498]: DEBUG nova.compute.manager [req-f7da4df0-abf1-4e49-8a20-bb5d9fff9072 req-01202728-2d65-4e34-8274-b61707a3f878 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] No waiting events found dispatching network-vif-plugged-9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:44:04 user nova-compute[71498]: WARNING nova.compute.manager [req-f7da4df0-abf1-4e49-8a20-bb5d9fff9072 req-01202728-2d65-4e34-8274-b61707a3f878 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Received unexpected event network-vif-plugged-9b10b56a-df5a-429e-a551-db729007648a for instance with vm_state active and task_state shelving.
Apr 14 01:44:04 user nova-compute[71498]: DEBUG nova.compute.manager [req-f7da4df0-abf1-4e49-8a20-bb5d9fff9072 req-01202728-2d65-4e34-8274-b61707a3f878 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Received event network-vif-plugged-9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:44:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f7da4df0-abf1-4e49-8a20-bb5d9fff9072 req-01202728-2d65-4e34-8274-b61707a3f878 service nova] Acquiring lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f7da4df0-abf1-4e49-8a20-bb5d9fff9072 req-01202728-2d65-4e34-8274-b61707a3f878 service nova] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f7da4df0-abf1-4e49-8a20-bb5d9fff9072 req-01202728-2d65-4e34-8274-b61707a3f878 service nova] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:04 user nova-compute[71498]: DEBUG nova.compute.manager [req-f7da4df0-abf1-4e49-8a20-bb5d9fff9072 req-01202728-2d65-4e34-8274-b61707a3f878 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] No waiting events found dispatching network-vif-plugged-9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:44:04 user nova-compute[71498]: WARNING nova.compute.manager [req-f7da4df0-abf1-4e49-8a20-bb5d9fff9072 req-01202728-2d65-4e34-8274-b61707a3f878 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Received unexpected event network-vif-plugged-9b10b56a-df5a-429e-a551-db729007648a for instance with vm_state active and task_state shelving.
Apr 14 01:44:04 user nova-compute[71498]: DEBUG nova.compute.manager [req-f7da4df0-abf1-4e49-8a20-bb5d9fff9072 req-01202728-2d65-4e34-8274-b61707a3f878 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Received event network-vif-plugged-9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:44:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f7da4df0-abf1-4e49-8a20-bb5d9fff9072 req-01202728-2d65-4e34-8274-b61707a3f878 service nova] Acquiring lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f7da4df0-abf1-4e49-8a20-bb5d9fff9072 req-01202728-2d65-4e34-8274-b61707a3f878 service nova] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f7da4df0-abf1-4e49-8a20-bb5d9fff9072 req-01202728-2d65-4e34-8274-b61707a3f878 service nova] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:04 user nova-compute[71498]: DEBUG nova.compute.manager [req-f7da4df0-abf1-4e49-8a20-bb5d9fff9072 req-01202728-2d65-4e34-8274-b61707a3f878 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] No waiting events found dispatching network-vif-plugged-9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:44:04 user nova-compute[71498]: WARNING nova.compute.manager [req-f7da4df0-abf1-4e49-8a20-bb5d9fff9072 req-01202728-2d65-4e34-8274-b61707a3f878 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Received unexpected event network-vif-plugged-9b10b56a-df5a-429e-a551-db729007648a for instance with vm_state active and task_state shelving.
Apr 14 01:44:05 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Instance destroyed successfully.
Apr 14 01:44:05 user nova-compute[71498]: DEBUG nova.objects.instance [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lazy-loading 'resources' on Instance uuid ee4cf01f-8d33-4696-b6ec-7f188ee18026 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:42:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1018221636',display_name='tempest-TestShelveInstance-server-1018221636',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1018221636',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8oQGYR+FY0LiM859XrQ9H3YlzTk6smIp49cfjoqSvxd/aONSV1r/k9gt1d5Db4fmA7gXaDRWLZ6VOsvQ07UleStWf5lgaLtfeieMukM+I8PpxvvoXTX8ZP8xMyS5I5RA==',key_name='tempest-TestShelveInstance-711764184',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:42:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef081a56d11d4b4d82ba5fe6572f3b95',ramdisk_id='',reservation_id='r-fjanozaf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-437254779',owner_user_name='tempest-TestShelveInstance-437254779-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:42:23Z,user_data=None,user_id='447da297b18f4e7f86fa94cd4d5d7918',uuid=ee4cf01f-8d33-4696-b6ec-7f188ee18026,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b10b56a-df5a-429e-a551-db729007648a", "address": "fa:16:3e:89:b1:39", "network": {"id": "4f7f7e24-860c-47ce-b635-be72e8fe2913", "bridge": "br-int", "label": "tempest-TestShelveInstance-1817709221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef081a56d11d4b4d82ba5fe6572f3b95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b10b56a-df", "ovs_interfaceid": "9b10b56a-df5a-429e-a551-db729007648a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Converting VIF {"id": "9b10b56a-df5a-429e-a551-db729007648a", "address": "fa:16:3e:89:b1:39", "network": {"id": "4f7f7e24-860c-47ce-b635-be72e8fe2913", "bridge": "br-int", "label": "tempest-TestShelveInstance-1817709221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef081a56d11d4b4d82ba5fe6572f3b95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b10b56a-df", "ovs_interfaceid": "9b10b56a-df5a-429e-a551-db729007648a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:b1:39,bridge_name='br-int',has_traffic_filtering=True,id=9b10b56a-df5a-429e-a551-db729007648a,network=Network(4f7f7e24-860c-47ce-b635-be72e8fe2913),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b10b56a-df') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG os_vif [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:b1:39,bridge_name='br-int',has_traffic_filtering=True,id=9b10b56a-df5a-429e-a551-db729007648a,network=Network(4f7f7e24-860c-47ce-b635-be72e8fe2913),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b10b56a-df') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b10b56a-df, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:05 user nova-compute[71498]: INFO os_vif [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:b1:39,bridge_name='br-int',has_traffic_filtering=True,id=9b10b56a-df5a-429e-a551-db729007648a,network=Network(4f7f7e24-860c-47ce-b635-be72e8fe2913),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b10b56a-df')
Apr 14 01:44:05 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eLIEctAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:44:05 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:44:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e94c27e-576e-4060-a9cc-0db231b809f5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:44:05 user nova-compute[71498]: No targets found.
Apr 14 01:44:05 user nova-compute[71498]: iSNS:
Apr 14 01:44:05 user nova-compute[71498]: No targets found.
Apr 14 01:44:05 user nova-compute[71498]: STATIC:
Apr 14 01:44:05 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53
Apr 14 01:44:05 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:44:05 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:44:05 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22
Apr 14 01:44:05 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:44:05 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:44:05 user nova-compute[71498]: FIRMWARE:
Apr 14 01:44:05 user nova-compute[71498]: No targets found.
Apr 14 01:44:05 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:44:05 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:44:05 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e338bfb0-f0a5-4905-8934-d24dae12c54e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6586070e-4e35-44f8-9758-c1aaf6ac8573]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:44:05 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:44:05 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:44:05 user nova-compute[71498]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:44:05 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51f42ac160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53'): ({'sde'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Removing single pathed devices sde {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd35154-6e7a-4d29-884b-69418e491f1a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7db8ad2-3117-4450-9bd1-a3545ed9a1c2]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Flushing IO for device /dev/sde {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd47f169-c96d-4c76-9aef-f1b6ecbc99f7]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.061s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed876f1e-3a8d-46a0-aba9-64e4b3c6ce0c]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] SCSI volumes sde have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bfb692-2680-4717-9cd2-19bc1dd4d983]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:44:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6955ba-620e-4920-99d7-46b93f212003]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53, portal: 172.16.0.220,3260]
Apr 14 01:44:06 user nova-compute[71498]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53, portal: 172.16.0.220,3260] successful.
Apr 14 01:44:06 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:44:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb614f0-7db7-4477-9ab0-a5e92f66c8a8]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:44:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:44:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] <== disconnect_volume: return (331ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:44:06 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:44:06 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Deleting instance files /opt/stack/data/nova/instances/ee4cf01f-8d33-4696-b6ec-7f188ee18026_del
Apr 14 01:44:06 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Deletion of /opt/stack/data/nova/instances/ee4cf01f-8d33-4696-b6ec-7f188ee18026_del complete
Apr 14 01:44:07 user nova-compute[71498]: DEBUG nova.compute.manager [req-6f651c70-f16d-4ee4-81b6-899ea296cbc3 req-76c0a58e-631f-45b4-8887-b5d51993e371 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Received event network-vif-unplugged-9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:44:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6f651c70-f16d-4ee4-81b6-899ea296cbc3 req-76c0a58e-631f-45b4-8887-b5d51993e371 service nova] Acquiring lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6f651c70-f16d-4ee4-81b6-899ea296cbc3 req-76c0a58e-631f-45b4-8887-b5d51993e371 service nova] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6f651c70-f16d-4ee4-81b6-899ea296cbc3 req-76c0a58e-631f-45b4-8887-b5d51993e371 service nova] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:07 user nova-compute[71498]: DEBUG nova.compute.manager [req-6f651c70-f16d-4ee4-81b6-899ea296cbc3 req-76c0a58e-631f-45b4-8887-b5d51993e371 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] No waiting events found dispatching network-vif-unplugged-9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:44:07 user nova-compute[71498]: WARNING nova.compute.manager [req-6f651c70-f16d-4ee4-81b6-899ea296cbc3 req-76c0a58e-631f-45b4-8887-b5d51993e371 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Received unexpected event network-vif-unplugged-9b10b56a-df5a-429e-a551-db729007648a for instance with vm_state active and task_state shelving.
Apr 14 01:44:07 user nova-compute[71498]: DEBUG nova.compute.manager [req-6f651c70-f16d-4ee4-81b6-899ea296cbc3 req-76c0a58e-631f-45b4-8887-b5d51993e371 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Received event network-vif-plugged-9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:44:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6f651c70-f16d-4ee4-81b6-899ea296cbc3 req-76c0a58e-631f-45b4-8887-b5d51993e371 service nova] Acquiring lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6f651c70-f16d-4ee4-81b6-899ea296cbc3 req-76c0a58e-631f-45b4-8887-b5d51993e371 service nova] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6f651c70-f16d-4ee4-81b6-899ea296cbc3 req-76c0a58e-631f-45b4-8887-b5d51993e371 service nova] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:07 user nova-compute[71498]: DEBUG nova.compute.manager [req-6f651c70-f16d-4ee4-81b6-899ea296cbc3 req-76c0a58e-631f-45b4-8887-b5d51993e371 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] No waiting events found dispatching network-vif-plugged-9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:44:07 user nova-compute[71498]: WARNING nova.compute.manager [req-6f651c70-f16d-4ee4-81b6-899ea296cbc3 req-76c0a58e-631f-45b4-8887-b5d51993e371 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Received unexpected event network-vif-plugged-9b10b56a-df5a-429e-a551-db729007648a for instance with vm_state active and task_state shelving.
Apr 14 01:44:07 user nova-compute[71498]: DEBUG nova.compute.manager [req-6f651c70-f16d-4ee4-81b6-899ea296cbc3 req-76c0a58e-631f-45b4-8887-b5d51993e371 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Received event network-changed-9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:44:07 user nova-compute[71498]: DEBUG nova.compute.manager [req-6f651c70-f16d-4ee4-81b6-899ea296cbc3 req-76c0a58e-631f-45b4-8887-b5d51993e371 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Refreshing instance network info cache due to event network-changed-9b10b56a-df5a-429e-a551-db729007648a. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:44:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6f651c70-f16d-4ee4-81b6-899ea296cbc3 req-76c0a58e-631f-45b4-8887-b5d51993e371 service nova] Acquiring lock "refresh_cache-ee4cf01f-8d33-4696-b6ec-7f188ee18026" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:44:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6f651c70-f16d-4ee4-81b6-899ea296cbc3 req-76c0a58e-631f-45b4-8887-b5d51993e371 service nova] Acquired lock "refresh_cache-ee4cf01f-8d33-4696-b6ec-7f188ee18026" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:44:07 user nova-compute[71498]: DEBUG nova.network.neutron [req-6f651c70-f16d-4ee4-81b6-899ea296cbc3 req-76c0a58e-631f-45b4-8887-b5d51993e371 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Refreshing network info cache for port 9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:44:07 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Deleted allocations for instance ee4cf01f-8d33-4696-b6ec-7f188ee18026
Apr 14 01:44:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:07 user nova-compute[71498]: DEBUG nova.objects.instance [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lazy-loading 'numa_topology' on Instance uuid ee4cf01f-8d33-4696-b6ec-7f188ee18026 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:44:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:07 user nova-compute[71498]: DEBUG nova.network.neutron [req-6f651c70-f16d-4ee4-81b6-899ea296cbc3 req-76c0a58e-631f-45b4-8887-b5d51993e371 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Updated VIF entry in instance network info cache for port 9b10b56a-df5a-429e-a551-db729007648a. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:44:07 user nova-compute[71498]: DEBUG nova.network.neutron [req-6f651c70-f16d-4ee4-81b6-899ea296cbc3 req-76c0a58e-631f-45b4-8887-b5d51993e371 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Updating instance_info_cache with network_info: [{"id": "9b10b56a-df5a-429e-a551-db729007648a", "address": "fa:16:3e:89:b1:39", "network": {"id": "4f7f7e24-860c-47ce-b635-be72e8fe2913", "bridge": null, "label": "tempest-TestShelveInstance-1817709221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef081a56d11d4b4d82ba5fe6572f3b95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap9b10b56a-df", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:44:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6f651c70-f16d-4ee4-81b6-899ea296cbc3 req-76c0a58e-631f-45b4-8887-b5d51993e371 service nova] Releasing lock "refresh_cache-ee4cf01f-8d33-4696-b6ec-7f188ee18026" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:44:07 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:44:07 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:44:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b9324ea9-1ea6-439e-a025-0fc2cd948f55 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 5.238s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9680b529-b331-4dca-8ba0-6bd58861e8ea tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "f45130b1-9e83-47a0-b335-a6e74875b79e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9680b529-b331-4dca-8ba0-6bd58861e8ea tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "f45130b1-9e83-47a0-b335-a6e74875b79e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9680b529-b331-4dca-8ba0-6bd58861e8ea tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "f45130b1-9e83-47a0-b335-a6e74875b79e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9680b529-b331-4dca-8ba0-6bd58861e8ea tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "f45130b1-9e83-47a0-b335-a6e74875b79e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9680b529-b331-4dca-8ba0-6bd58861e8ea tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "f45130b1-9e83-47a0-b335-a6e74875b79e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:07 user nova-compute[71498]: INFO nova.compute.manager [None req-9680b529-b331-4dca-8ba0-6bd58861e8ea tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Terminating instance
Apr 14 01:44:07 user nova-compute[71498]: DEBUG nova.compute.manager [None req-9680b529-b331-4dca-8ba0-6bd58861e8ea tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 01:44:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:08 user nova-compute[71498]: DEBUG nova.compute.manager [req-b078d45e-51c9-4782-97c3-ba1c8b8a4bed req-a32fd436-4ab1-45b2-a1a5-6e39ddbc39b3 service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Received event network-vif-unplugged-6762a294-eced-41bd-87c0-ac112e954d3a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:44:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b078d45e-51c9-4782-97c3-ba1c8b8a4bed req-a32fd436-4ab1-45b2-a1a5-6e39ddbc39b3 service nova] Acquiring lock "f45130b1-9e83-47a0-b335-a6e74875b79e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b078d45e-51c9-4782-97c3-ba1c8b8a4bed req-a32fd436-4ab1-45b2-a1a5-6e39ddbc39b3 service nova] Lock "f45130b1-9e83-47a0-b335-a6e74875b79e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b078d45e-51c9-4782-97c3-ba1c8b8a4bed req-a32fd436-4ab1-45b2-a1a5-6e39ddbc39b3 service nova] Lock "f45130b1-9e83-47a0-b335-a6e74875b79e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:08 user nova-compute[71498]: DEBUG nova.compute.manager [req-b078d45e-51c9-4782-97c3-ba1c8b8a4bed req-a32fd436-4ab1-45b2-a1a5-6e39ddbc39b3 service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] No waiting events found dispatching network-vif-unplugged-6762a294-eced-41bd-87c0-ac112e954d3a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:44:08 user nova-compute[71498]: DEBUG nova.compute.manager [req-b078d45e-51c9-4782-97c3-ba1c8b8a4bed req-a32fd436-4ab1-45b2-a1a5-6e39ddbc39b3 service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Received event network-vif-unplugged-6762a294-eced-41bd-87c0-ac112e954d3a for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:44:08 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Instance destroyed successfully.
Apr 14 01:44:08 user nova-compute[71498]: DEBUG nova.objects.instance [None req-9680b529-b331-4dca-8ba0-6bd58861e8ea tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lazy-loading 'resources' on Instance uuid f45130b1-9e83-47a0-b335-a6e74875b79e {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:44:08 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-9680b529-b331-4dca-8ba0-6bd58861e8ea tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:41:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1373277645',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1373277645',id=7,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUT3ZOn0Mn2ktm54d2qA9xktIMZqL7Q40F6rrStB8sUhSSG/BBymdkGPGHtlWKKsqIfu1Qyxy455mqWjjowlE5hNoX4c7IQemPoagPLG/KJKleE/aVTRO8q8iRe5UAbxg==',key_name='tempest-keypair-658101980',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:41:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='58f0122cc9864fcea660891e2826ca7b',ramdisk_id='',reservation_id='r-svkr1ynm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-242857735',owner_user_name='tempest-TaggedAttachmentsTest-242857735-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:41:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bada5cdb7704f6b956eb48b3729388d',uuid=f45130b1-9e83-47a0-b335-a6e74875b79e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6762a294-eced-41bd-87c0-ac112e954d3a", "address": "fa:16:3e:41:81:59", "network": {"id": "c7acaa49-fce0-41b5-8dd6-d5ef02e27e23", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1296085277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58f0122cc9864fcea660891e2826ca7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6762a294-ec", "ovs_interfaceid": "6762a294-eced-41bd-87c0-ac112e954d3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:44:08 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-9680b529-b331-4dca-8ba0-6bd58861e8ea tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Converting VIF {"id": "6762a294-eced-41bd-87c0-ac112e954d3a", "address": "fa:16:3e:41:81:59", "network": {"id": "c7acaa49-fce0-41b5-8dd6-d5ef02e27e23", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1296085277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58f0122cc9864fcea660891e2826ca7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6762a294-ec", "ovs_interfaceid": "6762a294-eced-41bd-87c0-ac112e954d3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:44:08 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-9680b529-b331-4dca-8ba0-6bd58861e8ea tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:81:59,bridge_name='br-int',has_traffic_filtering=True,id=6762a294-eced-41bd-87c0-ac112e954d3a,network=Network(c7acaa49-fce0-41b5-8dd6-d5ef02e27e23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6762a294-ec') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:44:08 user nova-compute[71498]: DEBUG os_vif [None req-9680b529-b331-4dca-8ba0-6bd58861e8ea tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:81:59,bridge_name='br-int',has_traffic_filtering=True,id=6762a294-eced-41bd-87c0-ac112e954d3a,network=Network(c7acaa49-fce0-41b5-8dd6-d5ef02e27e23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6762a294-ec') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:44:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6762a294-ec, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:44:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:44:08 user nova-compute[71498]: INFO os_vif [None req-9680b529-b331-4dca-8ba0-6bd58861e8ea tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:81:59,bridge_name='br-int',has_traffic_filtering=True,id=6762a294-eced-41bd-87c0-ac112e954d3a,network=Network(c7acaa49-fce0-41b5-8dd6-d5ef02e27e23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6762a294-ec')
Apr 14 01:44:08 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-9680b529-b331-4dca-8ba0-6bd58861e8ea tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Deleting instance files /opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e_del
Apr 14 01:44:08 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-9680b529-b331-4dca-8ba0-6bd58861e8ea tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Deletion of /opt/stack/data/nova/instances/f45130b1-9e83-47a0-b335-a6e74875b79e_del complete
Apr 14 01:44:08 user nova-compute[71498]: INFO nova.compute.manager [None req-9680b529-b331-4dca-8ba0-6bd58861e8ea tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Took 0.95 seconds to destroy the instance on the hypervisor.
Apr 14 01:44:08 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-9680b529-b331-4dca-8ba0-6bd58861e8ea tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 01:44:08 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 01:44:08 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 01:44:10 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:44:10 user nova-compute[71498]: DEBUG nova.compute.manager [req-d0bae0e7-c613-484f-b2ec-12e8356ed671 req-b1e93203-456f-4499-aa33-da569fbfecd3 service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Received event network-vif-plugged-6762a294-eced-41bd-87c0-ac112e954d3a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:44:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d0bae0e7-c613-484f-b2ec-12e8356ed671 req-b1e93203-456f-4499-aa33-da569fbfecd3 service nova] Acquiring lock "f45130b1-9e83-47a0-b335-a6e74875b79e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d0bae0e7-c613-484f-b2ec-12e8356ed671 req-b1e93203-456f-4499-aa33-da569fbfecd3 service nova] Lock "f45130b1-9e83-47a0-b335-a6e74875b79e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d0bae0e7-c613-484f-b2ec-12e8356ed671 req-b1e93203-456f-4499-aa33-da569fbfecd3 service nova] Lock "f45130b1-9e83-47a0-b335-a6e74875b79e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:10 user nova-compute[71498]: DEBUG nova.compute.manager [req-d0bae0e7-c613-484f-b2ec-12e8356ed671 req-b1e93203-456f-4499-aa33-da569fbfecd3 service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] No waiting events found dispatching network-vif-plugged-6762a294-eced-41bd-87c0-ac112e954d3a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:44:10 user nova-compute[71498]: WARNING nova.compute.manager [req-d0bae0e7-c613-484f-b2ec-12e8356ed671 req-b1e93203-456f-4499-aa33-da569fbfecd3 service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Received unexpected event network-vif-plugged-6762a294-eced-41bd-87c0-ac112e954d3a for instance with vm_state active and task_state deleting.
Apr 14 01:44:10 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Took 1.46 seconds to deallocate network for instance.
Apr 14 01:44:10 user nova-compute[71498]: DEBUG nova.compute.manager [req-dca82e25-2f4a-4db8-87ae-7b3598c08795 req-2d820ee3-2e65-400b-9d6b-544d2a2a31c3 service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Received event network-vif-deleted-6762a294-eced-41bd-87c0-ac112e954d3a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:44:10 user nova-compute[71498]: INFO nova.compute.manager [req-dca82e25-2f4a-4db8-87ae-7b3598c08795 req-2d820ee3-2e65-400b-9d6b-544d2a2a31c3 service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Neutron deleted interface 6762a294-eced-41bd-87c0-ac112e954d3a; detaching it from the instance and deleting it from the info cache
Apr 14 01:44:10 user nova-compute[71498]: DEBUG nova.network.neutron [req-dca82e25-2f4a-4db8-87ae-7b3598c08795 req-2d820ee3-2e65-400b-9d6b-544d2a2a31c3 service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:44:10 user nova-compute[71498]: DEBUG nova.compute.manager [req-dca82e25-2f4a-4db8-87ae-7b3598c08795 req-2d820ee3-2e65-400b-9d6b-544d2a2a31c3 service nova] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Detach interface failed, port_id=6762a294-eced-41bd-87c0-ac112e954d3a, reason: Instance f45130b1-9e83-47a0-b335-a6e74875b79e could not be found. {{(pid=71498) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 01:44:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9680b529-b331-4dca-8ba0-6bd58861e8ea tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9680b529-b331-4dca-8ba0-6bd58861e8ea tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:10 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-9680b529-b331-4dca-8ba0-6bd58861e8ea tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:44:10 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-9680b529-b331-4dca-8ba0-6bd58861e8ea tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:44:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9680b529-b331-4dca-8ba0-6bd58861e8ea tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:10 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-9680b529-b331-4dca-8ba0-6bd58861e8ea tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Deleted allocations for instance f45130b1-9e83-47a0-b335-a6e74875b79e
Apr 14 01:44:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9680b529-b331-4dca-8ba0-6bd58861e8ea tempest-TaggedAttachmentsTest-242857735 tempest-TaggedAttachmentsTest-242857735-project-member] Lock "f45130b1-9e83-47a0-b335-a6e74875b79e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.948s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-be7f9f1f-be23-4d55-b0e1-23e74491b02d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Acquiring lock "160b86fd-8405-42f5-90b2-8069917e4df1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-be7f9f1f-be23-4d55-b0e1-23e74491b02d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "160b86fd-8405-42f5-90b2-8069917e4df1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-be7f9f1f-be23-4d55-b0e1-23e74491b02d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Acquiring lock "160b86fd-8405-42f5-90b2-8069917e4df1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-be7f9f1f-be23-4d55-b0e1-23e74491b02d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "160b86fd-8405-42f5-90b2-8069917e4df1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-be7f9f1f-be23-4d55-b0e1-23e74491b02d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "160b86fd-8405-42f5-90b2-8069917e4df1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:11 user nova-compute[71498]: INFO nova.compute.manager [None req-be7f9f1f-be23-4d55-b0e1-23e74491b02d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Terminating instance
Apr 14 01:44:11 user nova-compute[71498]: DEBUG nova.compute.manager [None req-be7f9f1f-be23-4d55-b0e1-23e74491b02d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 01:44:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:11 user nova-compute[71498]: DEBUG nova.compute.manager [req-e920d212-81b3-4438-9979-b1c7a3f66b7f req-3fd9e3f4-1d59-4d14-8003-8c6a29efb0a6 service nova] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Received event network-vif-unplugged-54ba4ed4-462e-4ba6-896d-748b91cfa41e {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:44:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e920d212-81b3-4438-9979-b1c7a3f66b7f req-3fd9e3f4-1d59-4d14-8003-8c6a29efb0a6 service nova] Acquiring lock "160b86fd-8405-42f5-90b2-8069917e4df1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e920d212-81b3-4438-9979-b1c7a3f66b7f req-3fd9e3f4-1d59-4d14-8003-8c6a29efb0a6 service nova] Lock "160b86fd-8405-42f5-90b2-8069917e4df1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e920d212-81b3-4438-9979-b1c7a3f66b7f req-3fd9e3f4-1d59-4d14-8003-8c6a29efb0a6 service nova] Lock "160b86fd-8405-42f5-90b2-8069917e4df1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:11 user nova-compute[71498]: DEBUG nova.compute.manager [req-e920d212-81b3-4438-9979-b1c7a3f66b7f req-3fd9e3f4-1d59-4d14-8003-8c6a29efb0a6 service nova] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] No waiting events found dispatching network-vif-unplugged-54ba4ed4-462e-4ba6-896d-748b91cfa41e {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:44:11 user nova-compute[71498]: DEBUG nova.compute.manager [req-e920d212-81b3-4438-9979-b1c7a3f66b7f req-3fd9e3f4-1d59-4d14-8003-8c6a29efb0a6 service nova] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Received event network-vif-unplugged-54ba4ed4-462e-4ba6-896d-748b91cfa41e for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:44:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:11 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Instance destroyed successfully.
Apr 14 01:44:11 user nova-compute[71498]: DEBUG nova.objects.instance [None req-be7f9f1f-be23-4d55-b0e1-23e74491b02d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lazy-loading 'resources' on Instance uuid 160b86fd-8405-42f5-90b2-8069917e4df1 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:44:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-be7f9f1f-be23-4d55-b0e1-23e74491b02d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:42:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1371662919',display_name='tempest-VolumesNegativeTest-instance-1371662919',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1371662919',id=12,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:42:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4910c626438f42e9a5db828ae4dae86c',ramdisk_id='',reservation_id='r-kdf6md0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-116646311',owner_user_name='tempest-VolumesNegativeTest-116646311-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:42:28Z,user_data=None,user_id='8ebae9b1685f46aea0064cf83813e4d8',uuid=160b86fd-8405-42f5-90b2-8069917e4df1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54ba4ed4-462e-4ba6-896d-748b91cfa41e", "address": "fa:16:3e:e9:b9:b3", "network": {"id": "3f3dcd60-d01f-4287-9d8c-990be91e165c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3663dea83d234eeca8dc09f5d706a616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ba4ed4-46", "ovs_interfaceid": "54ba4ed4-462e-4ba6-896d-748b91cfa41e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:44:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-be7f9f1f-be23-4d55-b0e1-23e74491b02d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Converting VIF {"id": "54ba4ed4-462e-4ba6-896d-748b91cfa41e", "address": "fa:16:3e:e9:b9:b3", "network": {"id": "3f3dcd60-d01f-4287-9d8c-990be91e165c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "3663dea83d234eeca8dc09f5d706a616", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ba4ed4-46", "ovs_interfaceid": "54ba4ed4-462e-4ba6-896d-748b91cfa41e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:44:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-be7f9f1f-be23-4d55-b0e1-23e74491b02d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:b9:b3,bridge_name='br-int',has_traffic_filtering=True,id=54ba4ed4-462e-4ba6-896d-748b91cfa41e,network=Network(3f3dcd60-d01f-4287-9d8c-990be91e165c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ba4ed4-46') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:44:11 user nova-compute[71498]: DEBUG os_vif [None req-be7f9f1f-be23-4d55-b0e1-23e74491b02d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:b9:b3,bridge_name='br-int',has_traffic_filtering=True,id=54ba4ed4-462e-4ba6-896d-748b91cfa41e,network=Network(3f3dcd60-d01f-4287-9d8c-990be91e165c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ba4ed4-46') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:44:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54ba4ed4-46, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:44:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:44:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:11 user nova-compute[71498]: INFO os_vif [None req-be7f9f1f-be23-4d55-b0e1-23e74491b02d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:b9:b3,bridge_name='br-int',has_traffic_filtering=True,id=54ba4ed4-462e-4ba6-896d-748b91cfa41e,network=Network(3f3dcd60-d01f-4287-9d8c-990be91e165c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ba4ed4-46')
Apr 14 01:44:11 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-be7f9f1f-be23-4d55-b0e1-23e74491b02d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Deleting instance files /opt/stack/data/nova/instances/160b86fd-8405-42f5-90b2-8069917e4df1_del
Apr 14 01:44:11 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-be7f9f1f-be23-4d55-b0e1-23e74491b02d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Deletion of /opt/stack/data/nova/instances/160b86fd-8405-42f5-90b2-8069917e4df1_del complete
Apr 14 01:44:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:12 user nova-compute[71498]: INFO nova.compute.manager [None req-be7f9f1f-be23-4d55-b0e1-23e74491b02d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Took 0.99 seconds to destroy the instance on the hypervisor.
Apr 14 01:44:12 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-be7f9f1f-be23-4d55-b0e1-23e74491b02d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 01:44:12 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 01:44:12 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 01:44:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:12 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:44:12 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Took 0.86 seconds to deallocate network for instance.
Apr 14 01:44:12 user nova-compute[71498]: DEBUG nova.compute.manager [req-e3c5946b-551a-4559-b13e-cb0c1f665e56 req-ef023514-9a34-4e7b-bd5c-b1cff5cc4d33 service nova] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Received event network-vif-deleted-54ba4ed4-462e-4ba6-896d-748b91cfa41e {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:44:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-be7f9f1f-be23-4d55-b0e1-23e74491b02d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-be7f9f1f-be23-4d55-b0e1-23e74491b02d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:13 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-be7f9f1f-be23-4d55-b0e1-23e74491b02d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:44:13 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-be7f9f1f-be23-4d55-b0e1-23e74491b02d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:44:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-be7f9f1f-be23-4d55-b0e1-23e74491b02d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:13 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-be7f9f1f-be23-4d55-b0e1-23e74491b02d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Deleted allocations for instance 160b86fd-8405-42f5-90b2-8069917e4df1
Apr 14 01:44:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-be7f9f1f-be23-4d55-b0e1-23e74491b02d tempest-VolumesNegativeTest-116646311 tempest-VolumesNegativeTest-116646311-project-member] Lock "160b86fd-8405-42f5-90b2-8069917e4df1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.348s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:13 user nova-compute[71498]: DEBUG nova.compute.manager [req-f491064b-6fc8-4cf8-8a10-fc20d0d6eb92 req-3f1bdcae-49d1-4ac6-8754-df1f3d2ecd66 service nova] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Received event network-vif-plugged-54ba4ed4-462e-4ba6-896d-748b91cfa41e {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:44:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f491064b-6fc8-4cf8-8a10-fc20d0d6eb92 req-3f1bdcae-49d1-4ac6-8754-df1f3d2ecd66 service nova] Acquiring lock "160b86fd-8405-42f5-90b2-8069917e4df1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f491064b-6fc8-4cf8-8a10-fc20d0d6eb92 req-3f1bdcae-49d1-4ac6-8754-df1f3d2ecd66 service nova] Lock "160b86fd-8405-42f5-90b2-8069917e4df1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f491064b-6fc8-4cf8-8a10-fc20d0d6eb92 req-3f1bdcae-49d1-4ac6-8754-df1f3d2ecd66 service nova] Lock "160b86fd-8405-42f5-90b2-8069917e4df1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:13 user nova-compute[71498]: DEBUG nova.compute.manager [req-f491064b-6fc8-4cf8-8a10-fc20d0d6eb92 req-3f1bdcae-49d1-4ac6-8754-df1f3d2ecd66 service nova] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] No waiting events found dispatching network-vif-plugged-54ba4ed4-462e-4ba6-896d-748b91cfa41e {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:44:13 user nova-compute[71498]: WARNING nova.compute.manager [req-f491064b-6fc8-4cf8-8a10-fc20d0d6eb92 req-3f1bdcae-49d1-4ac6-8754-df1f3d2ecd66 service nova] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Received unexpected event network-vif-plugged-54ba4ed4-462e-4ba6-896d-748b91cfa41e for instance with vm_state deleted and task_state None.
Apr 14 01:44:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:18 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681436643.273668, ee4cf01f-8d33-4696-b6ec-7f188ee18026 => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:44:18 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] VM Stopped (Lifecycle Event)
Apr 14 01:44:18 user nova-compute[71498]: DEBUG nova.compute.manager [None req-c9cf656c-7d5c-45d0-8c8c-55383638b0ee None None] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:44:19 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:21 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:23 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681436648.7418077, f45130b1-9e83-47a0-b335-a6e74875b79e => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:44:23 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] VM Stopped (Lifecycle Event)
Apr 14 01:44:23 user nova-compute[71498]: DEBUG nova.compute.manager [None req-c8818312-31b1-4efa-96af-302c66415c81 None None] [instance: f45130b1-9e83-47a0-b335-a6e74875b79e] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:44:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8c370bc0-94c3-41b3-bb39-edd6486f11c2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "2dfd39c9-8535-40d0-863d-c30fc98103e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8c370bc0-94c3-41b3-bb39-edd6486f11c2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "2dfd39c9-8535-40d0-863d-c30fc98103e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8c370bc0-94c3-41b3-bb39-edd6486f11c2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "2dfd39c9-8535-40d0-863d-c30fc98103e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8c370bc0-94c3-41b3-bb39-edd6486f11c2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "2dfd39c9-8535-40d0-863d-c30fc98103e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8c370bc0-94c3-41b3-bb39-edd6486f11c2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "2dfd39c9-8535-40d0-863d-c30fc98103e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:24 user nova-compute[71498]: INFO nova.compute.manager [None req-8c370bc0-94c3-41b3-bb39-edd6486f11c2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Terminating instance
Apr 14 01:44:24 user nova-compute[71498]: DEBUG nova.compute.manager [None req-8c370bc0-94c3-41b3-bb39-edd6486f11c2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 01:44:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:25 user nova-compute[71498]: DEBUG nova.compute.manager [req-65d1b984-99e7-4bac-8d73-d456038fb95e req-1e3e7a63-07ba-4bfd-a72e-de4bbf4d59fa service nova] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Received event network-vif-unplugged-2baffc32-6ecf-4d00-b556-31dc99113a1a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:44:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-65d1b984-99e7-4bac-8d73-d456038fb95e req-1e3e7a63-07ba-4bfd-a72e-de4bbf4d59fa service nova] Acquiring lock "2dfd39c9-8535-40d0-863d-c30fc98103e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-65d1b984-99e7-4bac-8d73-d456038fb95e req-1e3e7a63-07ba-4bfd-a72e-de4bbf4d59fa service nova] Lock "2dfd39c9-8535-40d0-863d-c30fc98103e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-65d1b984-99e7-4bac-8d73-d456038fb95e req-1e3e7a63-07ba-4bfd-a72e-de4bbf4d59fa service nova] Lock "2dfd39c9-8535-40d0-863d-c30fc98103e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:25 user nova-compute[71498]: DEBUG nova.compute.manager [req-65d1b984-99e7-4bac-8d73-d456038fb95e req-1e3e7a63-07ba-4bfd-a72e-de4bbf4d59fa service nova] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] No waiting events found dispatching network-vif-unplugged-2baffc32-6ecf-4d00-b556-31dc99113a1a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:44:25 user nova-compute[71498]: DEBUG nova.compute.manager [req-65d1b984-99e7-4bac-8d73-d456038fb95e req-1e3e7a63-07ba-4bfd-a72e-de4bbf4d59fa service nova] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Received event network-vif-unplugged-2baffc32-6ecf-4d00-b556-31dc99113a1a for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:44:25 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Instance destroyed successfully.
Apr 14 01:44:25 user nova-compute[71498]: DEBUG nova.objects.instance [None req-8c370bc0-94c3-41b3-bb39-edd6486f11c2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lazy-loading 'resources' on Instance uuid 2dfd39c9-8535-40d0-863d-c30fc98103e6 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:44:25 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-8c370bc0-94c3-41b3-bb39-edd6486f11c2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:42:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1686309236',display_name='tempest-ServersNegativeTestJSON-server-1686309236',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1686309236',id=13,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:42:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='907f632263e04bf2a6c8ff1bae77a5c7',ramdisk_id='',reservation_id='r-bl7bmbcz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1259366012',owner_user_name='tempest-ServersNegativeTestJSON-1259366012-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:42:43Z,user_data=None,user_id='236828e284154097a25f59eaedf47c29',uuid=2dfd39c9-8535-40d0-863d-c30fc98103e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2baffc32-6ecf-4d00-b556-31dc99113a1a", "address": "fa:16:3e:2b:71:ed", "network": {"id": "93155729-11d3-4eff-bbd2-8860a881e233", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047423124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "907f632263e04bf2a6c8ff1bae77a5c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2baffc32-6e", "ovs_interfaceid": "2baffc32-6ecf-4d00-b556-31dc99113a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:44:25 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8c370bc0-94c3-41b3-bb39-edd6486f11c2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Converting VIF {"id": "2baffc32-6ecf-4d00-b556-31dc99113a1a", "address": "fa:16:3e:2b:71:ed", "network": {"id": "93155729-11d3-4eff-bbd2-8860a881e233", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047423124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "907f632263e04bf2a6c8ff1bae77a5c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2baffc32-6e", "ovs_interfaceid": "2baffc32-6ecf-4d00-b556-31dc99113a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:44:25 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8c370bc0-94c3-41b3-bb39-edd6486f11c2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:71:ed,bridge_name='br-int',has_traffic_filtering=True,id=2baffc32-6ecf-4d00-b556-31dc99113a1a,network=Network(93155729-11d3-4eff-bbd2-8860a881e233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2baffc32-6e') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:44:25 user nova-compute[71498]: DEBUG os_vif [None req-8c370bc0-94c3-41b3-bb39-edd6486f11c2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:71:ed,bridge_name='br-int',has_traffic_filtering=True,id=2baffc32-6ecf-4d00-b556-31dc99113a1a,network=Network(93155729-11d3-4eff-bbd2-8860a881e233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2baffc32-6e') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:44:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2baffc32-6e, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:44:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:44:25 user nova-compute[71498]: INFO os_vif [None req-8c370bc0-94c3-41b3-bb39-edd6486f11c2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:71:ed,bridge_name='br-int',has_traffic_filtering=True,id=2baffc32-6ecf-4d00-b556-31dc99113a1a,network=Network(93155729-11d3-4eff-bbd2-8860a881e233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2baffc32-6e')
Apr 14 01:44:25 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-8c370bc0-94c3-41b3-bb39-edd6486f11c2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Deleting instance files /opt/stack/data/nova/instances/2dfd39c9-8535-40d0-863d-c30fc98103e6_del
Apr 14 01:44:25 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-8c370bc0-94c3-41b3-bb39-edd6486f11c2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Deletion of /opt/stack/data/nova/instances/2dfd39c9-8535-40d0-863d-c30fc98103e6_del complete
Apr 14 01:44:25 user nova-compute[71498]: INFO nova.compute.manager [None req-8c370bc0-94c3-41b3-bb39-edd6486f11c2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Took 0.77 seconds to destroy the instance on the hypervisor.
Apr 14 01:44:25 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-8c370bc0-94c3-41b3-bb39-edd6486f11c2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 01:44:25 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 01:44:25 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 01:44:26 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:44:26 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Took 0.71 seconds to deallocate network for instance.
Apr 14 01:44:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8c370bc0-94c3-41b3-bb39-edd6486f11c2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8c370bc0-94c3-41b3-bb39-edd6486f11c2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:26 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-8c370bc0-94c3-41b3-bb39-edd6486f11c2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:44:26 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-8c370bc0-94c3-41b3-bb39-edd6486f11c2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:44:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8c370bc0-94c3-41b3-bb39-edd6486f11c2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:26 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-8c370bc0-94c3-41b3-bb39-edd6486f11c2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Deleted allocations for instance 2dfd39c9-8535-40d0-863d-c30fc98103e6
Apr 14 01:44:26 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:26 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681436651.9039714, 160b86fd-8405-42f5-90b2-8069917e4df1 => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:44:26 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] VM Stopped (Lifecycle Event)
Apr 14 01:44:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8c370bc0-94c3-41b3-bb39-edd6486f11c2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "2dfd39c9-8535-40d0-863d-c30fc98103e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.054s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-c6d82dba-bff0-42d5-92c9-e18c5804e65a None None] [instance: 160b86fd-8405-42f5-90b2-8069917e4df1] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:44:27 user nova-compute[71498]: DEBUG nova.compute.manager [req-7b2804ae-1a8b-47eb-b0e4-0c7e12d5f339 req-829cc32e-411e-498f-9c97-fde63554e380 service nova] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Received event network-vif-plugged-2baffc32-6ecf-4d00-b556-31dc99113a1a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:44:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7b2804ae-1a8b-47eb-b0e4-0c7e12d5f339 req-829cc32e-411e-498f-9c97-fde63554e380 service nova] Acquiring lock "2dfd39c9-8535-40d0-863d-c30fc98103e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7b2804ae-1a8b-47eb-b0e4-0c7e12d5f339 req-829cc32e-411e-498f-9c97-fde63554e380 service nova] Lock "2dfd39c9-8535-40d0-863d-c30fc98103e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7b2804ae-1a8b-47eb-b0e4-0c7e12d5f339 req-829cc32e-411e-498f-9c97-fde63554e380 service nova] Lock "2dfd39c9-8535-40d0-863d-c30fc98103e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:27 user nova-compute[71498]: DEBUG nova.compute.manager [req-7b2804ae-1a8b-47eb-b0e4-0c7e12d5f339 req-829cc32e-411e-498f-9c97-fde63554e380 service nova] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] No waiting events found dispatching network-vif-plugged-2baffc32-6ecf-4d00-b556-31dc99113a1a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:44:27 user nova-compute[71498]: WARNING nova.compute.manager [req-7b2804ae-1a8b-47eb-b0e4-0c7e12d5f339 req-829cc32e-411e-498f-9c97-fde63554e380 service nova] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Received unexpected event network-vif-plugged-2baffc32-6ecf-4d00-b556-31dc99113a1a for instance with vm_state deleted and task_state None.
Apr 14 01:44:27 user nova-compute[71498]: DEBUG nova.compute.manager [req-7b2804ae-1a8b-47eb-b0e4-0c7e12d5f339 req-829cc32e-411e-498f-9c97-fde63554e380 service nova] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Received event network-vif-deleted-2baffc32-6ecf-4d00-b556-31dc99113a1a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:44:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:28 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:44:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:28 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 01:44:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:29 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:44:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f045ae6d-889e-40c0-bd71-9b107dba9a70/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f045ae6d-889e-40c0-bd71-9b107dba9a70/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f045ae6d-889e-40c0-bd71-9b107dba9a70/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f045ae6d-889e-40c0-bd71-9b107dba9a70/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:30 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:44:30 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:44:30 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=7957MB free_disk=26.546005249023438GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 01:44:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:31 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance da60f4f1-2474-453f-8f84-c95daf02431a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:44:31 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:44:31 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:44:31 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance f68784e7-578c-4a12-87d4-f35fbc5a1d59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:44:31 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:44:31 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:44:31 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance f045ae6d-889e-40c0-bd71-9b107dba9a70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:44:31 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 01:44:31 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 01:44:31 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:44:31 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:44:31 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 01:44:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.481s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-145f4952-3e8c-4ff5-a6d9-0c9cf12dff8f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-145f4952-3e8c-4ff5-a6d9-0c9cf12dff8f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-145f4952-3e8c-4ff5-a6d9-0c9cf12dff8f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-145f4952-3e8c-4ff5-a6d9-0c9cf12dff8f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-145f4952-3e8c-4ff5-a6d9-0c9cf12dff8f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:32 user nova-compute[71498]: INFO nova.compute.manager [None req-145f4952-3e8c-4ff5-a6d9-0c9cf12dff8f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Terminating instance
Apr 14 01:44:32 user nova-compute[71498]: DEBUG nova.compute.manager [None req-145f4952-3e8c-4ff5-a6d9-0c9cf12dff8f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 01:44:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:32 user nova-compute[71498]: DEBUG nova.compute.manager [req-b43da627-a39e-4cf5-8335-a6c88ad0ffea req-ea9e1167-e34e-414d-b013-b41547553a03 service nova] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Received event network-vif-unplugged-72f288aa-49e2-407b-9e41-47c8fd81286f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:44:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b43da627-a39e-4cf5-8335-a6c88ad0ffea req-ea9e1167-e34e-414d-b013-b41547553a03 service nova] Acquiring lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b43da627-a39e-4cf5-8335-a6c88ad0ffea req-ea9e1167-e34e-414d-b013-b41547553a03 service nova] Lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b43da627-a39e-4cf5-8335-a6c88ad0ffea req-ea9e1167-e34e-414d-b013-b41547553a03 service nova] Lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:32 user nova-compute[71498]: DEBUG nova.compute.manager [req-b43da627-a39e-4cf5-8335-a6c88ad0ffea req-ea9e1167-e34e-414d-b013-b41547553a03 service nova] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] No waiting events found dispatching network-vif-unplugged-72f288aa-49e2-407b-9e41-47c8fd81286f {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:44:32 user nova-compute[71498]: DEBUG nova.compute.manager [req-b43da627-a39e-4cf5-8335-a6c88ad0ffea req-ea9e1167-e34e-414d-b013-b41547553a03 service nova] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Received event network-vif-unplugged-72f288aa-49e2-407b-9e41-47c8fd81286f for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:44:33 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Instance destroyed successfully.
Apr 14 01:44:33 user nova-compute[71498]: DEBUG nova.objects.instance [None req-145f4952-3e8c-4ff5-a6d9-0c9cf12dff8f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lazy-loading 'resources' on Instance uuid 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:44:33 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-145f4952-3e8c-4ff5-a6d9-0c9cf12dff8f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:41:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1080614213',display_name='tempest-TestVolumeSwap-server-1080614213',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1080614213',id=8,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPNiUI2ug6LQUiapieczdsy9Wqi1WC3qcruFFPEMTuuD+5FKNmRUw7VMsnHH30l96OHFwUCmZQiDrlxZsDi3HAwnteFmFsj2Cvd/o8xLG4tOF7+RBcte95gdr83Q6b27w==',key_name='tempest-keypair-1595267406',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:41:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e707623638044e983b557119edd7673',ramdisk_id='',reservation_id='r-nf51tq0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-755712300',owner_user_name='tempest-TestVolumeSwap-755712300-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:41:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6e19e75aa9d4cda971c8d2449e85290',uuid=3decf8d9-7bb3-4395-a8b2-91c8dcf1880c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72f288aa-49e2-407b-9e41-47c8fd81286f", "address": "fa:16:3e:17:11:af", "network": {"id": "335d6a15-36dc-4fbc-ae2a-08b44984eb3a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1640804392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e707623638044e983b557119edd7673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72f288aa-49", "ovs_interfaceid": "72f288aa-49e2-407b-9e41-47c8fd81286f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:44:33 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-145f4952-3e8c-4ff5-a6d9-0c9cf12dff8f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Converting VIF {"id": "72f288aa-49e2-407b-9e41-47c8fd81286f", "address": "fa:16:3e:17:11:af", "network": {"id": "335d6a15-36dc-4fbc-ae2a-08b44984eb3a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1640804392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e707623638044e983b557119edd7673", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72f288aa-49", "ovs_interfaceid": "72f288aa-49e2-407b-9e41-47c8fd81286f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:44:33 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-145f4952-3e8c-4ff5-a6d9-0c9cf12dff8f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:11:af,bridge_name='br-int',has_traffic_filtering=True,id=72f288aa-49e2-407b-9e41-47c8fd81286f,network=Network(335d6a15-36dc-4fbc-ae2a-08b44984eb3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72f288aa-49') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:44:33 user nova-compute[71498]: DEBUG os_vif [None req-145f4952-3e8c-4ff5-a6d9-0c9cf12dff8f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:11:af,bridge_name='br-int',has_traffic_filtering=True,id=72f288aa-49e2-407b-9e41-47c8fd81286f,network=Network(335d6a15-36dc-4fbc-ae2a-08b44984eb3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72f288aa-49') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:44:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72f288aa-49, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:44:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:44:33 user nova-compute[71498]: INFO os_vif [None req-145f4952-3e8c-4ff5-a6d9-0c9cf12dff8f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:11:af,bridge_name='br-int',has_traffic_filtering=True,id=72f288aa-49e2-407b-9e41-47c8fd81286f,network=Network(335d6a15-36dc-4fbc-ae2a-08b44984eb3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72f288aa-49')
Apr 14 01:44:33 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-145f4952-3e8c-4ff5-a6d9-0c9cf12dff8f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Deleting instance files /opt/stack/data/nova/instances/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c_del
Apr 14 01:44:33 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-145f4952-3e8c-4ff5-a6d9-0c9cf12dff8f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Deletion of /opt/stack/data/nova/instances/3decf8d9-7bb3-4395-a8b2-91c8dcf1880c_del complete
Apr 14 01:44:33 user nova-compute[71498]: INFO nova.compute.manager [None req-145f4952-3e8c-4ff5-a6d9-0c9cf12dff8f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Took 1.01 seconds to destroy the instance on the hypervisor.
Apr 14 01:44:33 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-145f4952-3e8c-4ff5-a6d9-0c9cf12dff8f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 01:44:33 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 01:44:33 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 01:44:34 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:44:34 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:44:34 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:44:34 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 01:44:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-f68784e7-578c-4a12-87d4-f35fbc5a1d59" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:44:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-f68784e7-578c-4a12-87d4-f35fbc5a1d59" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:44:34 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 01:44:35 user nova-compute[71498]: DEBUG nova.compute.manager [req-d006eba5-9551-46aa-b171-ffd61136989d req-6d8768be-24fd-4410-a3c1-02b8f584f23b service nova] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Received event network-vif-plugged-72f288aa-49e2-407b-9e41-47c8fd81286f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:44:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d006eba5-9551-46aa-b171-ffd61136989d req-6d8768be-24fd-4410-a3c1-02b8f584f23b service nova] Acquiring lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d006eba5-9551-46aa-b171-ffd61136989d req-6d8768be-24fd-4410-a3c1-02b8f584f23b service nova] Lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d006eba5-9551-46aa-b171-ffd61136989d req-6d8768be-24fd-4410-a3c1-02b8f584f23b service nova] Lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:35 user nova-compute[71498]: DEBUG nova.compute.manager [req-d006eba5-9551-46aa-b171-ffd61136989d req-6d8768be-24fd-4410-a3c1-02b8f584f23b service nova] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] No waiting events found dispatching network-vif-plugged-72f288aa-49e2-407b-9e41-47c8fd81286f {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:44:35 user nova-compute[71498]: WARNING nova.compute.manager [req-d006eba5-9551-46aa-b171-ffd61136989d req-6d8768be-24fd-4410-a3c1-02b8f584f23b service nova] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Received unexpected event network-vif-plugged-72f288aa-49e2-407b-9e41-47c8fd81286f for instance with vm_state active and task_state deleting.
Apr 14 01:44:35 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Updating instance_info_cache with network_info: [{"id": "08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd", "address": "fa:16:3e:f5:7f:82", "network": {"id": "6569db42-40ba-4426-a76b-b3e64ecae5b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1148770119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a409270d6d4d408de33c5e71a56da9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c0ebf7-58", "ovs_interfaceid": "08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:44:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-f68784e7-578c-4a12-87d4-f35fbc5a1d59" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:44:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 01:44:35 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:44:35 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:44:35 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:44:35 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:44:35 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:44:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 01:44:35 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:44:35 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Took 1.98 seconds to deallocate network for instance.
Apr 14 01:44:35 user nova-compute[71498]: DEBUG nova.compute.manager [req-bbf4f6ce-ae23-4170-8c6b-68a16cded571 req-b679fcd2-adff-4956-af6d-3c0d6e4e277e service nova] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Received event network-vif-deleted-72f288aa-49e2-407b-9e41-47c8fd81286f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:44:35 user nova-compute[71498]: INFO nova.compute.manager [req-bbf4f6ce-ae23-4170-8c6b-68a16cded571 req-b679fcd2-adff-4956-af6d-3c0d6e4e277e service nova] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Neutron deleted interface 72f288aa-49e2-407b-9e41-47c8fd81286f; detaching it from the instance and deleting it from the info cache
Apr 14 01:44:35 user nova-compute[71498]: DEBUG nova.network.neutron [req-bbf4f6ce-ae23-4170-8c6b-68a16cded571 req-b679fcd2-adff-4956-af6d-3c0d6e4e277e service nova] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:44:35 user nova-compute[71498]: DEBUG nova.compute.manager [req-bbf4f6ce-ae23-4170-8c6b-68a16cded571 req-b679fcd2-adff-4956-af6d-3c0d6e4e277e service nova] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Detach interface failed, port_id=72f288aa-49e2-407b-9e41-47c8fd81286f, reason: Instance 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c could not be found. {{(pid=71498) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 01:44:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-145f4952-3e8c-4ff5-a6d9-0c9cf12dff8f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-145f4952-3e8c-4ff5-a6d9-0c9cf12dff8f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:35 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-145f4952-3e8c-4ff5-a6d9-0c9cf12dff8f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:44:35 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-145f4952-3e8c-4ff5-a6d9-0c9cf12dff8f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:44:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-145f4952-3e8c-4ff5-a6d9-0c9cf12dff8f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.285s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:35 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-145f4952-3e8c-4ff5-a6d9-0c9cf12dff8f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Deleted allocations for instance 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c
Apr 14 01:44:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-145f4952-3e8c-4ff5-a6d9-0c9cf12dff8f tempest-TestVolumeSwap-755712300 tempest-TestVolumeSwap-755712300-project-member] Lock "3decf8d9-7bb3-4395-a8b2-91c8dcf1880c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.545s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 01:44:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:36 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:44:36 user nova-compute[71498]: INFO nova.compute.claims [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Claim successful on node user
Apr 14 01:44:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "5803c8ed-f1fe-47ae-aaba-13b7cd8831ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "5803c8ed-f1fe-47ae-aaba-13b7cd8831ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:36 user nova-compute[71498]: DEBUG nova.compute.manager [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 01:44:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:36 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:44:36 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:44:36 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:44:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:36 user nova-compute[71498]: DEBUG nova.compute.manager [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 01:44:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.266s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:36 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:44:36 user nova-compute[71498]: INFO nova.compute.claims [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Claim successful on node user
Apr 14 01:44:36 user nova-compute[71498]: DEBUG nova.compute.manager [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 01:44:36 user nova-compute[71498]: DEBUG nova.network.neutron [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:44:36 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 01:44:36 user nova-compute[71498]: DEBUG nova.compute.manager [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 01:44:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:36 user nova-compute[71498]: DEBUG nova.objects.instance [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lazy-loading 'flavor' on Instance uuid 3a3fb53f-7b4a-48d3-85ab-418bad435c07 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:44:36 user nova-compute[71498]: DEBUG nova.policy [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8b18b911fcf847efbf4f814f3b687279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb176ac656c47b38e736fc629fc46e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:44:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:36 user nova-compute[71498]: DEBUG nova.compute.manager [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 01:44:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:44:36 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Creating image(s)
Apr 14 01:44:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "/opt/stack/data/nova/instances/d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "/opt/stack/data/nova/instances/d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "/opt/stack/data/nova/instances/d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:36 user nova-compute[71498]: INFO nova.compute.manager [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Attaching volume 7298e05a-b142-4365-95e1-f8551de0ae79 to /dev/vdb
Apr 14 01:44:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.163s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:36 user nova-compute[71498]: DEBUG os_brick.utils [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:44:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:36 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:44:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:36 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bca770c-63fa-4268-8cb5-766239538987]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ef1f73-986d-4776-a178-7e413473cd39]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.535s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG nova.compute.manager [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76058ac-59d6-4fa5-abbc-97e180bca966]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c8c5ad-3fd8-47a6-8c57-702772f174bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.155s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:44:37 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:44:37 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77dbcf6-3732-4f99-8506-48bde47fe1f1]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG os_brick.utils [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Updating existing volume attachment record: cca51a1e-a7f1-4078-bada-b708a9819bf2 {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG nova.compute.manager [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG nova.network.neutron [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb/disk 1073741824" returned: 0 in 0.074s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:37 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 01:44:37 user nova-compute[71498]: DEBUG nova.compute.manager [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 01:44:37 user nova-compute[71498]: INFO nova.virt.block_device [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Booting with volume snapshot 9407ec8e-7fa7-49e3-81a0-e6659fd98f5d at /dev/vda
Apr 14 01:44:37 user nova-compute[71498]: DEBUG nova.network.neutron [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Successfully created port: 4a26ba3d-6834-41d3-a4a5-e72c2126b739 {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.172s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG nova.policy [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50e3354ac1a84c59a7dee8e1ae6e771a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f4117a4adb4aa3b42951cf1fc84237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Cannot resize image /opt/stack/data/nova/instances/d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG nova.objects.instance [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lazy-loading 'migration_context' on Instance uuid d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Ensure instance console log exists: /opt/stack/data/nova/instances/d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG nova.network.neutron [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Successfully created port: 7e60c256-3f3d-4a16-bf10-d7b22347ec4f {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG nova.network.neutron [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Successfully updated port: 4a26ba3d-6834-41d3-a4a5-e72c2126b739 {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "refresh_cache-d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquired lock "refresh_cache-d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG nova.network.neutron [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG nova.compute.manager [req-4c5438a8-c805-493e-a4c8-457021c05156 req-2cfe1d84-2aa2-403d-9da7-62f44144303d service nova] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Received event network-changed-4a26ba3d-6834-41d3-a4a5-e72c2126b739 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG nova.compute.manager [req-4c5438a8-c805-493e-a4c8-457021c05156 req-2cfe1d84-2aa2-403d-9da7-62f44144303d service nova] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Refreshing instance network info cache due to event network-changed-4a26ba3d-6834-41d3-a4a5-e72c2126b739. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4c5438a8-c805-493e-a4c8-457021c05156 req-2cfe1d84-2aa2-403d-9da7-62f44144303d service nova] Acquiring lock "refresh_cache-d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG nova.network.neutron [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG nova.network.neutron [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Updating instance_info_cache with network_info: [{"id": "4a26ba3d-6834-41d3-a4a5-e72c2126b739", "address": "fa:16:3e:08:10:c2", "network": {"id": "d2f0bf5d-7422-436e-82b2-95cfe8eb77bd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1126078103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cdb176ac656c47b38e736fc629fc46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a26ba3d-68", "ovs_interfaceid": "4a26ba3d-6834-41d3-a4a5-e72c2126b739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Releasing lock "refresh_cache-d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG nova.compute.manager [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Instance network_info: |[{"id": "4a26ba3d-6834-41d3-a4a5-e72c2126b739", "address": "fa:16:3e:08:10:c2", "network": {"id": "d2f0bf5d-7422-436e-82b2-95cfe8eb77bd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1126078103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cdb176ac656c47b38e736fc629fc46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a26ba3d-68", "ovs_interfaceid": "4a26ba3d-6834-41d3-a4a5-e72c2126b739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4c5438a8-c805-493e-a4c8-457021c05156 req-2cfe1d84-2aa2-403d-9da7-62f44144303d service nova] Acquired lock "refresh_cache-d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG nova.network.neutron [req-4c5438a8-c805-493e-a4c8-457021c05156 req-2cfe1d84-2aa2-403d-9da7-62f44144303d service nova] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Refreshing network info cache for port 4a26ba3d-6834-41d3-a4a5-e72c2126b739 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Start _get_guest_xml network_info=[{"id": "4a26ba3d-6834-41d3-a4a5-e72c2126b739", "address": "fa:16:3e:08:10:c2", "network": {"id": "d2f0bf5d-7422-436e-82b2-95cfe8eb77bd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1126078103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cdb176ac656c47b38e736fc629fc46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a26ba3d-68", "ovs_interfaceid": "4a26ba3d-6834-41d3-a4a5-e72c2126b739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:44:38 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:44:38 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:44:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:44:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1283417063',display_name='tempest-VolumesActionsTest-instance-1283417063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1283417063',id=16,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cdb176ac656c47b38e736fc629fc46e0',ramdisk_id='',reservation_id='r-psck70kq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-193871514',owner_user_name='tempest-VolumesActionsTest-193871514-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:44:37Z,user_data=None,user_id='8b18b911fcf847efbf4f814f3b687279',uuid=d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a26ba3d-6834-41d3-a4a5-e72c2126b739", "address": "fa:16:3e:08:10:c2", "network": {"id": "d2f0bf5d-7422-436e-82b2-95cfe8eb77bd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1126078103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cdb176ac656c47b38e736fc629fc46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a26ba3d-68", "ovs_interfaceid": "4a26ba3d-6834-41d3-a4a5-e72c2126b739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Converting VIF {"id": "4a26ba3d-6834-41d3-a4a5-e72c2126b739", "address": "fa:16:3e:08:10:c2", "network": {"id": "d2f0bf5d-7422-436e-82b2-95cfe8eb77bd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1126078103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cdb176ac656c47b38e736fc629fc46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a26ba3d-68", "ovs_interfaceid": "4a26ba3d-6834-41d3-a4a5-e72c2126b739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:10:c2,bridge_name='br-int',has_traffic_filtering=True,id=4a26ba3d-6834-41d3-a4a5-e72c2126b739,network=Network(d2f0bf5d-7422-436e-82b2-95cfe8eb77bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a26ba3d-68') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG nova.objects.instance [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lazy-loading 'pci_devices' on Instance uuid d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:44:38 user nova-compute[71498]:   <uuid>d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb</uuid>
Apr 14 01:44:38 user nova-compute[71498]:   <name>instance-00000010</name>
Apr 14 01:44:38 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:44:38 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:44:38 user nova-compute[71498]:   <metadata>
Apr 14 01:44:38 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:44:38 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:44:38 user nova-compute[71498]:       <nova:name>tempest-VolumesActionsTest-instance-1283417063</nova:name>
Apr 14 01:44:38 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:44:38</nova:creationTime>
Apr 14 01:44:38 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:44:38 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:44:38 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:44:38 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:44:38 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:44:38 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:44:38 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:44:38 user nova-compute[71498]:       <nova:owner>
Apr 14 01:44:38 user nova-compute[71498]:         <nova:user uuid="8b18b911fcf847efbf4f814f3b687279">tempest-VolumesActionsTest-193871514-project-member</nova:user>
Apr 14 01:44:38 user nova-compute[71498]:         <nova:project uuid="cdb176ac656c47b38e736fc629fc46e0">tempest-VolumesActionsTest-193871514</nova:project>
Apr 14 01:44:38 user nova-compute[71498]:       </nova:owner>
Apr 14 01:44:38 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:44:38 user nova-compute[71498]:       <nova:ports>
Apr 14 01:44:38 user nova-compute[71498]:         <nova:port uuid="4a26ba3d-6834-41d3-a4a5-e72c2126b739">
Apr 14 01:44:38 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 01:44:38 user nova-compute[71498]:         </nova:port>
Apr 14 01:44:38 user nova-compute[71498]:       </nova:ports>
Apr 14 01:44:38 user nova-compute[71498]:     </nova:instance>
Apr 14 01:44:38 user nova-compute[71498]:   </metadata>
Apr 14 01:44:38 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:44:38 user nova-compute[71498]:     <system>
Apr 14 01:44:38 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:44:38 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:44:38 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:44:38 user nova-compute[71498]:       <entry name="serial">d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb</entry>
Apr 14 01:44:38 user nova-compute[71498]:       <entry name="uuid">d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb</entry>
Apr 14 01:44:38 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:44:38 user nova-compute[71498]:     </system>
Apr 14 01:44:38 user nova-compute[71498]:   </sysinfo>
Apr 14 01:44:38 user nova-compute[71498]:   <os>
Apr 14 01:44:38 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:44:38 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:44:38 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:44:38 user nova-compute[71498]:   </os>
Apr 14 01:44:38 user nova-compute[71498]:   <features>
Apr 14 01:44:38 user nova-compute[71498]:     <acpi/>
Apr 14 01:44:38 user nova-compute[71498]:     <apic/>
Apr 14 01:44:38 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:44:38 user nova-compute[71498]:   </features>
Apr 14 01:44:38 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:44:38 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:44:38 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:44:38 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:44:38 user nova-compute[71498]:   </clock>
Apr 14 01:44:38 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:44:38 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:44:38 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:44:38 user nova-compute[71498]:   </cpu>
Apr 14 01:44:38 user nova-compute[71498]:   <devices>
Apr 14 01:44:38 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:44:38 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:44:38 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb/disk"/>
Apr 14 01:44:38 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:44:38 user nova-compute[71498]:     </disk>
Apr 14 01:44:38 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:44:38 user nova-compute[71498]:       <mac address="fa:16:3e:08:10:c2"/>
Apr 14 01:44:38 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:44:38 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:44:38 user nova-compute[71498]:       <target dev="tap4a26ba3d-68"/>
Apr 14 01:44:38 user nova-compute[71498]:     </interface>
Apr 14 01:44:38 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:44:38 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb/console.log" append="off"/>
Apr 14 01:44:38 user nova-compute[71498]:     </serial>
Apr 14 01:44:38 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:44:38 user nova-compute[71498]:     <video>
Apr 14 01:44:38 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:44:38 user nova-compute[71498]:     </video>
Apr 14 01:44:38 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:44:38 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:44:38 user nova-compute[71498]:     </rng>
Apr 14 01:44:38 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:44:38 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:44:38 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:44:38 user nova-compute[71498]:     </memballoon>
Apr 14 01:44:38 user nova-compute[71498]:   </devices>
Apr 14 01:44:38 user nova-compute[71498]: </domain>
Apr 14 01:44:38 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:44:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1283417063',display_name='tempest-VolumesActionsTest-instance-1283417063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1283417063',id=16,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cdb176ac656c47b38e736fc629fc46e0',ramdisk_id='',reservation_id='r-psck70kq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-193871514',owner_user_name='tempest-VolumesActionsTest-193871514-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:44:37Z,user_data=None,user_id='8b18b911fcf847efbf4f814f3b687279',uuid=d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a26ba3d-6834-41d3-a4a5-e72c2126b739", "address": "fa:16:3e:08:10:c2", "network": {"id": "d2f0bf5d-7422-436e-82b2-95cfe8eb77bd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1126078103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cdb176ac656c47b38e736fc629fc46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a26ba3d-68", "ovs_interfaceid": "4a26ba3d-6834-41d3-a4a5-e72c2126b739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Converting VIF {"id": "4a26ba3d-6834-41d3-a4a5-e72c2126b739", "address": "fa:16:3e:08:10:c2", "network": {"id": "d2f0bf5d-7422-436e-82b2-95cfe8eb77bd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1126078103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cdb176ac656c47b38e736fc629fc46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a26ba3d-68", "ovs_interfaceid": "4a26ba3d-6834-41d3-a4a5-e72c2126b739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:10:c2,bridge_name='br-int',has_traffic_filtering=True,id=4a26ba3d-6834-41d3-a4a5-e72c2126b739,network=Network(d2f0bf5d-7422-436e-82b2-95cfe8eb77bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a26ba3d-68') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG os_vif [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:10:c2,bridge_name='br-int',has_traffic_filtering=True,id=4a26ba3d-6834-41d3-a4a5-e72c2126b739,network=Network(d2f0bf5d-7422-436e-82b2-95cfe8eb77bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a26ba3d-68') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a26ba3d-68, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4a26ba3d-68, col_values=(('external_ids', {'iface-id': '4a26ba3d-6834-41d3-a4a5-e72c2126b739', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:10:c2', 'vm-uuid': 'd579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:38 user nova-compute[71498]: INFO os_vif [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:10:c2,bridge_name='br-int',has_traffic_filtering=True,id=4a26ba3d-6834-41d3-a4a5-e72c2126b739,network=Network(d2f0bf5d-7422-436e-82b2-95cfe8eb77bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a26ba3d-68')
Apr 14 01:44:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:44:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] No VIF found with MAC fa:16:3e:08:10:c2, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:44:39 user nova-compute[71498]: DEBUG nova.network.neutron [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Successfully updated port: 7e60c256-3f3d-4a16-bf10-d7b22347ec4f {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:44:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "refresh_cache-5803c8ed-f1fe-47ae-aaba-13b7cd8831ae" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:44:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquired lock "refresh_cache-5803c8ed-f1fe-47ae-aaba-13b7cd8831ae" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:44:39 user nova-compute[71498]: DEBUG nova.network.neutron [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:44:39 user nova-compute[71498]: DEBUG nova.compute.manager [req-c1ed10bb-1adc-40f0-9ad8-4fadc124ead1 req-aa26a879-3182-4aaa-aae4-025aa38909ce service nova] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Received event network-changed-7e60c256-3f3d-4a16-bf10-d7b22347ec4f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:44:39 user nova-compute[71498]: DEBUG nova.compute.manager [req-c1ed10bb-1adc-40f0-9ad8-4fadc124ead1 req-aa26a879-3182-4aaa-aae4-025aa38909ce service nova] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Refreshing instance network info cache due to event network-changed-7e60c256-3f3d-4a16-bf10-d7b22347ec4f. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:44:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c1ed10bb-1adc-40f0-9ad8-4fadc124ead1 req-aa26a879-3182-4aaa-aae4-025aa38909ce service nova] Acquiring lock "refresh_cache-5803c8ed-f1fe-47ae-aaba-13b7cd8831ae" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:44:39 user nova-compute[71498]: DEBUG nova.network.neutron [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:44:39 user nova-compute[71498]: DEBUG nova.network.neutron [req-4c5438a8-c805-493e-a4c8-457021c05156 req-2cfe1d84-2aa2-403d-9da7-62f44144303d service nova] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Updated VIF entry in instance network info cache for port 4a26ba3d-6834-41d3-a4a5-e72c2126b739. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:44:39 user nova-compute[71498]: DEBUG nova.network.neutron [req-4c5438a8-c805-493e-a4c8-457021c05156 req-2cfe1d84-2aa2-403d-9da7-62f44144303d service nova] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Updating instance_info_cache with network_info: [{"id": "4a26ba3d-6834-41d3-a4a5-e72c2126b739", "address": "fa:16:3e:08:10:c2", "network": {"id": "d2f0bf5d-7422-436e-82b2-95cfe8eb77bd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1126078103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cdb176ac656c47b38e736fc629fc46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a26ba3d-68", "ovs_interfaceid": "4a26ba3d-6834-41d3-a4a5-e72c2126b739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:44:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4c5438a8-c805-493e-a4c8-457021c05156 req-2cfe1d84-2aa2-403d-9da7-62f44144303d service nova] Releasing lock "refresh_cache-d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:44:39 user nova-compute[71498]: DEBUG nova.network.neutron [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Updating instance_info_cache with network_info: [{"id": "7e60c256-3f3d-4a16-bf10-d7b22347ec4f", "address": "fa:16:3e:6e:a2:56", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e60c256-3f", "ovs_interfaceid": "7e60c256-3f3d-4a16-bf10-d7b22347ec4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:44:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Releasing lock "refresh_cache-5803c8ed-f1fe-47ae-aaba-13b7cd8831ae" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:44:39 user nova-compute[71498]: DEBUG nova.compute.manager [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Instance network_info: |[{"id": "7e60c256-3f3d-4a16-bf10-d7b22347ec4f", "address": "fa:16:3e:6e:a2:56", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e60c256-3f", "ovs_interfaceid": "7e60c256-3f3d-4a16-bf10-d7b22347ec4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 01:44:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c1ed10bb-1adc-40f0-9ad8-4fadc124ead1 req-aa26a879-3182-4aaa-aae4-025aa38909ce service nova] Acquired lock "refresh_cache-5803c8ed-f1fe-47ae-aaba-13b7cd8831ae" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:44:39 user nova-compute[71498]: DEBUG nova.network.neutron [req-c1ed10bb-1adc-40f0-9ad8-4fadc124ead1 req-aa26a879-3182-4aaa-aae4-025aa38909ce service nova] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Refreshing network info cache for port 7e60c256-3f3d-4a16-bf10-d7b22347ec4f {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:44:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:40 user nova-compute[71498]: DEBUG nova.network.neutron [req-c1ed10bb-1adc-40f0-9ad8-4fadc124ead1 req-aa26a879-3182-4aaa-aae4-025aa38909ce service nova] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Updated VIF entry in instance network info cache for port 7e60c256-3f3d-4a16-bf10-d7b22347ec4f. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:44:40 user nova-compute[71498]: DEBUG nova.network.neutron [req-c1ed10bb-1adc-40f0-9ad8-4fadc124ead1 req-aa26a879-3182-4aaa-aae4-025aa38909ce service nova] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Updating instance_info_cache with network_info: [{"id": "7e60c256-3f3d-4a16-bf10-d7b22347ec4f", "address": "fa:16:3e:6e:a2:56", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e60c256-3f", "ovs_interfaceid": "7e60c256-3f3d-4a16-bf10-d7b22347ec4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:44:40 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681436665.5294902, 2dfd39c9-8535-40d0-863d-c30fc98103e6 => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:44:40 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] VM Stopped (Lifecycle Event)
Apr 14 01:44:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c1ed10bb-1adc-40f0-9ad8-4fadc124ead1 req-aa26a879-3182-4aaa-aae4-025aa38909ce service nova] Releasing lock "refresh_cache-5803c8ed-f1fe-47ae-aaba-13b7cd8831ae" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:44:40 user nova-compute[71498]: DEBUG nova.compute.manager [None req-54743c3d-df6a-46ba-9095-0768adf2526a None None] [instance: 2dfd39c9-8535-40d0-863d-c30fc98103e6] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:44:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-ebfa13be-5ea8-45be-adba-d2df409a1d92 req-f2026146-c64f-4d08-a68a-80ac5be1050e service nova] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Received event network-vif-plugged-4a26ba3d-6834-41d3-a4a5-e72c2126b739 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:44:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ebfa13be-5ea8-45be-adba-d2df409a1d92 req-f2026146-c64f-4d08-a68a-80ac5be1050e service nova] Acquiring lock "d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ebfa13be-5ea8-45be-adba-d2df409a1d92 req-f2026146-c64f-4d08-a68a-80ac5be1050e service nova] Lock "d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ebfa13be-5ea8-45be-adba-d2df409a1d92 req-f2026146-c64f-4d08-a68a-80ac5be1050e service nova] Lock "d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-ebfa13be-5ea8-45be-adba-d2df409a1d92 req-f2026146-c64f-4d08-a68a-80ac5be1050e service nova] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] No waiting events found dispatching network-vif-plugged-4a26ba3d-6834-41d3-a4a5-e72c2126b739 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:44:40 user nova-compute[71498]: WARNING nova.compute.manager [req-ebfa13be-5ea8-45be-adba-d2df409a1d92 req-f2026146-c64f-4d08-a68a-80ac5be1050e service nova] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Received unexpected event network-vif-plugged-4a26ba3d-6834-41d3-a4a5-e72c2126b739 for instance with vm_state building and task_state spawning.
Apr 14 01:44:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nmkLiNCj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:44:42 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:44:42 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:44:42 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:44:42 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:44:42 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f65e22-eab0-4db4-a44d-aed56d386e6b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:44:42 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ea13a9-c223-481c-9719-7885e4f5dd4b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79] added
Apr 14 01:44:42 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c500d52-a5ec-498c-8304-0f59cf9f3731]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c277b008-eed3-45d0-b38e-49e0dd113704]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nmkLiNCj {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nmkLiNCj" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[df531a74-e318-4bee-bd64-65d1dd04423f]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nmkLiNCj'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4f1122-2f8d-40aa-9d34-dbeabbce9b2d]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aaf66ab-84bf-4835-912e-e44cf753a804]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:44:42 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:44:42 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf791cc-6502-4bdc-9ff7-b2e9ff8bd96a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79, portal: 172.16.0.220,3260]
Apr 14 01:44:42 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79, portal: 172.16.0.220,3260] successful.
Apr 14 01:44:42 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e33205-dafe-4baf-9b88-1618d21ad0d4]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[065fa206-596c-493a-bae1-628b6c7050ce]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:44:42 user nova-compute[71498]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)
Apr 14 01:44:42 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:44:42 user nova-compute[71498]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)
Apr 14 01:44:42 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7f4be1-a5b9-4370-937c-1698142dafa2]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nmkLiNCj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436682.6340268, d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:44:42 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] VM Resumed (Lifecycle Event)
Apr 14 01:44:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:44:42 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Instance spawned successfully.
Apr 14 01:44:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:44:42 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:44:42 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436682.6356828, d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:44:42 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] VM Started (Lifecycle Event)
Apr 14 01:44:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:44:42 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:44:42 user nova-compute[71498]: INFO nova.compute.manager [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Took 5.99 seconds to spawn the instance on the hypervisor.
Apr 14 01:44:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:44:42 user nova-compute[71498]: INFO nova.compute.manager [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Took 6.82 seconds to build instance.
Apr 14 01:44:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-337aaa05-673e-4c6e-9706-945f018f8efb req-58881bad-0b6a-4fec-8842-95fb8e2da375 service nova] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Received event network-vif-plugged-4a26ba3d-6834-41d3-a4a5-e72c2126b739 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-337aaa05-673e-4c6e-9706-945f018f8efb req-58881bad-0b6a-4fec-8842-95fb8e2da375 service nova] Acquiring lock "d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-337aaa05-673e-4c6e-9706-945f018f8efb req-58881bad-0b6a-4fec-8842-95fb8e2da375 service nova] Lock "d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-337aaa05-673e-4c6e-9706-945f018f8efb req-58881bad-0b6a-4fec-8842-95fb8e2da375 service nova] Lock "d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-337aaa05-673e-4c6e-9706-945f018f8efb req-58881bad-0b6a-4fec-8842-95fb8e2da375 service nova] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] No waiting events found dispatching network-vif-plugged-4a26ba3d-6834-41d3-a4a5-e72c2126b739 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:44:42 user nova-compute[71498]: WARNING nova.compute.manager [req-337aaa05-673e-4c6e-9706-945f018f8efb req-58881bad-0b6a-4fec-8842-95fb8e2da375 service nova] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Received unexpected event network-vif-plugged-4a26ba3d-6834-41d3-a4a5-e72c2126b739 for instance with vm_state active and task_state None.
Apr 14 01:44:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9919276b-8eda-4c86-99d5-7bb18d2b09f0 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.918s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:43 user nova-compute[71498]: DEBUG os_brick.utils [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:44:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:43 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed25e72-1676-4cda-893e-fccc700c2fb8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:43 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cbfafe-2e05-4c25-94db-f478de9f1954]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:43 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2350b3bc-172b-4187-9018-2c64ea0de8a0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:43 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[742fffdc-b2e1-4a6d-aed0-c9864fb966d4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:44:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:44:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:44:43 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:44:43 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e62e0b-9bef-497f-915e-20641f0be0e9]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:44:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:44:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:44:43 user nova-compute[71498]: DEBUG os_brick.utils [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:44:43 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Updating existing volume attachment record: abb9a434-5221-494f-8d94-29fc7a6941ab {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:44:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:44:43 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26461643666363838', 'path': '/dev/sdc'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:44:43 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461643666363838', 'path': '/dev/sdc'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:44:43 user nova-compute[71498]: DEBUG nova.objects.instance [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lazy-loading 'flavor' on Instance uuid 3a3fb53f-7b4a-48d3-85ab-418bad435c07 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:44:43 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 01:44:43 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:44:43 user nova-compute[71498]:   <source dev="/dev/sdc"/>
Apr 14 01:44:43 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:44:43 user nova-compute[71498]:   <serial>7298e05a-b142-4365-95e1-f8551de0ae79</serial>
Apr 14 01:44:43 user nova-compute[71498]: </disk>
Apr 14 01:44:43 user nova-compute[71498]:  {{(pid=71498) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 01:44:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:43 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:44:43 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:44:43 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] No VIF found with MAC fa:16:3e:0c:0e:df, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:44:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ffab2b45-13ed-4dd5-9e39-9b3fce5543fa tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.199s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:44 user nova-compute[71498]: INFO nova.compute.manager [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Rescuing
Apr 14 01:44:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "refresh_cache-3a3fb53f-7b4a-48d3-85ab-418bad435c07" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:44:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquired lock "refresh_cache-3a3fb53f-7b4a-48d3-85ab-418bad435c07" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:44:44 user nova-compute[71498]: DEBUG nova.network.neutron [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:44:45 user nova-compute[71498]: DEBUG nova.network.neutron [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Updating instance_info_cache with network_info: [{"id": "7942720d-0958-4826-bedf-0a7eebfe45b6", "address": "fa:16:3e:0c:0e:df", "network": {"id": "95555a4e-9d95-4509-a683-f61ea2dc38a1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-560359898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4833ddea1fa74866b97ef52a730605aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7942720d-09", "ovs_interfaceid": "7942720d-0958-4826-bedf-0a7eebfe45b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:44:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Releasing lock "refresh_cache-3a3fb53f-7b4a-48d3-85ab-418bad435c07" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:44:45 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:45 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:45 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:45 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:45 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:45 user nova-compute[71498]: DEBUG nova.compute.manager [req-0f800997-4bea-4a2a-9a7f-f7e9acd2bc68 req-8ab317f5-585d-4c30-ad89-001e9442fafb service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Received event network-vif-unplugged-7942720d-0958-4826-bedf-0a7eebfe45b6 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:44:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0f800997-4bea-4a2a-9a7f-f7e9acd2bc68 req-8ab317f5-585d-4c30-ad89-001e9442fafb service nova] Acquiring lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0f800997-4bea-4a2a-9a7f-f7e9acd2bc68 req-8ab317f5-585d-4c30-ad89-001e9442fafb service nova] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0f800997-4bea-4a2a-9a7f-f7e9acd2bc68 req-8ab317f5-585d-4c30-ad89-001e9442fafb service nova] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:45 user nova-compute[71498]: DEBUG nova.compute.manager [req-0f800997-4bea-4a2a-9a7f-f7e9acd2bc68 req-8ab317f5-585d-4c30-ad89-001e9442fafb service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] No waiting events found dispatching network-vif-unplugged-7942720d-0958-4826-bedf-0a7eebfe45b6 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:44:45 user nova-compute[71498]: WARNING nova.compute.manager [req-0f800997-4bea-4a2a-9a7f-f7e9acd2bc68 req-8ab317f5-585d-4c30-ad89-001e9442fafb service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Received unexpected event network-vif-unplugged-7942720d-0958-4826-bedf-0a7eebfe45b6 for instance with vm_state active and task_state rescuing.
Apr 14 01:44:46 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:46 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Instance destroyed successfully.
Apr 14 01:44:46 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Attempting a stable device rescue
Apr 14 01:44:46 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=71498) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 01:44:46 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Instance directory exists: not creating {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 01:44:46 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Creating image(s)
Apr 14 01:44:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "/opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "/opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:46 user nova-compute[71498]: DEBUG nova.objects.instance [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3a3fb53f-7b4a-48d3-85ab-418bad435c07 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:44:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "d7a9b6b150e0e5b3bd47306d86b4756a569d8294" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "d7a9b6b150e0e5b3bd47306d86b4756a569d8294" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d7a9b6b150e0e5b3bd47306d86b4756a569d8294.part --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d7a9b6b150e0e5b3bd47306d86b4756a569d8294.part --force-share --output=json" returned: 0 in 0.203s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:47 user nova-compute[71498]: DEBUG nova.virt.images [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] 0abe5ca9-f8b7-4782-9d51-b632ce789e86 was qcow2, converting to raw {{(pid=71498) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 01:44:47 user nova-compute[71498]: DEBUG nova.privsep.utils [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71498) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 01:44:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d7a9b6b150e0e5b3bd47306d86b4756a569d8294.part /opt/stack/data/nova/instances/_base/d7a9b6b150e0e5b3bd47306d86b4756a569d8294.converted {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG nova.compute.manager [req-13a6ce75-2977-40cc-bb85-f5ff2d4e4db8 req-947bd59d-0c8d-4dc1-8ee2-a81e5492eef3 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Received event network-vif-plugged-7942720d-0958-4826-bedf-0a7eebfe45b6 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-13a6ce75-2977-40cc-bb85-f5ff2d4e4db8 req-947bd59d-0c8d-4dc1-8ee2-a81e5492eef3 service nova] Acquiring lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-13a6ce75-2977-40cc-bb85-f5ff2d4e4db8 req-947bd59d-0c8d-4dc1-8ee2-a81e5492eef3 service nova] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-13a6ce75-2977-40cc-bb85-f5ff2d4e4db8 req-947bd59d-0c8d-4dc1-8ee2-a81e5492eef3 service nova] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG nova.compute.manager [req-13a6ce75-2977-40cc-bb85-f5ff2d4e4db8 req-947bd59d-0c8d-4dc1-8ee2-a81e5492eef3 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] No waiting events found dispatching network-vif-plugged-7942720d-0958-4826-bedf-0a7eebfe45b6 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:44:48 user nova-compute[71498]: WARNING nova.compute.manager [req-13a6ce75-2977-40cc-bb85-f5ff2d4e4db8 req-947bd59d-0c8d-4dc1-8ee2-a81e5492eef3 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Received unexpected event network-vif-plugged-7942720d-0958-4826-bedf-0a7eebfe45b6 for instance with vm_state active and task_state rescuing.
Apr 14 01:44:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d7a9b6b150e0e5b3bd47306d86b4756a569d8294.part /opt/stack/data/nova/instances/_base/d7a9b6b150e0e5b3bd47306d86b4756a569d8294.converted" returned: 0 in 0.300s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d7a9b6b150e0e5b3bd47306d86b4756a569d8294.converted --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d7a9b6b150e0e5b3bd47306d86b4756a569d8294.converted --force-share --output=json" returned: 0 in 0.159s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "d7a9b6b150e0e5b3bd47306d86b4756a569d8294" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.663s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "d7a9b6b150e0e5b3bd47306d86b4756a569d8294" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "d7a9b6b150e0e5b3bd47306d86b4756a569d8294" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d7a9b6b150e0e5b3bd47306d86b4756a569d8294 --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681436673.2915, 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:44:48 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] VM Stopped (Lifecycle Event)
Apr 14 01:44:48 user nova-compute[71498]: DEBUG nova.compute.manager [None req-a37b313b-c6f5-4e6e-92b4-0608cbb9c17a None None] [instance: 3decf8d9-7bb3-4395-a8b2-91c8dcf1880c] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d7a9b6b150e0e5b3bd47306d86b4756a569d8294 --force-share --output=json" returned: 0 in 0.141s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d7a9b6b150e0e5b3bd47306d86b4756a569d8294,backing_fmt=raw /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk.rescue {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d7a9b6b150e0e5b3bd47306d86b4756a569d8294,backing_fmt=raw /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk.rescue" returned: 0 in 0.060s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "d7a9b6b150e0e5b3bd47306d86b4756a569d8294" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG nova.objects.instance [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lazy-loading 'migration_context' on Instance uuid 3a3fb53f-7b4a-48d3-85ab-418bad435c07 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Start _get_guest_xml network_info=[{"id": "7942720d-0958-4826-bedf-0a7eebfe45b6", "address": "fa:16:3e:0c:0e:df", "network": {"id": "95555a4e-9d95-4509-a683-f61ea2dc38a1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-560359898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-560359898-network", "vif_mac": "fa:16:3e:0c:0e:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4833ddea1fa74866b97ef52a730605aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7942720d-09", "ovs_interfaceid": "7942720d-0958-4826-bedf-0a7eebfe45b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0abe5ca9-f8b7-4782-9d51-b632ce789e86', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'cca51a1e-a7f1-4078-bada-b708a9819bf2', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nmkLiNCj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '3a3fb53f-7b4a-48d3-85ab-418bad435c07', 'attached_at': '', 'detached_at': '', 'volume_id': '7298e05a-b142-4365-95e1-f8551de0ae79', 'serial': '7298e05a-b142-4365-95e1-f8551de0ae79'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG nova.objects.instance [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lazy-loading 'resources' on Instance uuid 3a3fb53f-7b4a-48d3-85ab-418bad435c07 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG nova.objects.instance [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lazy-loading 'numa_topology' on Instance uuid 3a3fb53f-7b4a-48d3-85ab-418bad435c07 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:44:48 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:44:48 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:44:48 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG nova.objects.instance [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3a3fb53f-7b4a-48d3-85ab-418bad435c07 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nmkLiNCj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:44:48 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:44:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:44:48 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:44:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:44:48 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:44:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6641db80-801d-4ceb-83ef-de60450de415]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = nmkLiNCj\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 14 01:44:48 user nova-compute[71498]: node.name = iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79
Apr 14 01:44:48 user nova-compute[71498]: node.tpgt = -1
Apr 14 01:44:48 user nova-compute[71498]: node.startup = automatic
Apr 14 01:44:48 user nova-compute[71498]: node.leading_login = No
Apr 14 01:44:48 user nova-compute[71498]: iface.iscsi_ifacename = default
Apr 14 01:44:48 user nova-compute[71498]: iface.net_ifacename = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.ipaddress = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.prefix_len = 0
Apr 14 01:44:48 user nova-compute[71498]: iface.hwaddress = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.transport_name = tcp
Apr 14 01:44:48 user nova-compute[71498]: iface.initiatorname = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.state = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.vlan_id = 0
Apr 14 01:44:48 user nova-compute[71498]: iface.vlan_priority = 0
Apr 14 01:44:48 user nova-compute[71498]: iface.vlan_state = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.iface_num = 0
Apr 14 01:44:48 user nova-compute[71498]: iface.mtu = 0
Apr 14 01:44:48 user nova-compute[71498]: iface.port = 0
Apr 14 01:44:48 user nova-compute[71498]: iface.bootproto = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.subnet_mask = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.gateway = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.dhcp_alt_client_id_state = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.dhcp_alt_client_id = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.dhcp_dns = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.dhcp_learn_iqn = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.dhcp_req_vendor_id_state = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.dhcp_vendor_id_state = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.dhcp_vendor_id = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.dhcp_slp_da = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.fragmentation = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.gratuitous_arp = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.incoming_forwarding = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.tos_state = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.tos = 0
Apr 14 01:44:48 user nova-compute[71498]: iface.ttl = 0
Apr 14 01:44:48 user nova-compute[71498]: iface.delayed_ack = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.tcp_nagle = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.tcp_wsf_state = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.tcp_wsf = 0
Apr 14 01:44:48 user nova-compute[71498]: iface.tcp_timer_scale = 0
Apr 14 01:44:48 user nova-compute[71498]: iface.tcp_timestamp = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.redirect = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.def_task_mgmt_timeout = 0
Apr 14 01:44:48 user nova-compute[71498]: iface.header_digest = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.data_digest = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.immediate_data = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.initial_r2t = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.data_seq_inorder = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.data_pdu_inorder = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.erl = 0
Apr 14 01:44:48 user nova-compute[71498]: iface.max_receive_data_len = 0
Apr 14 01:44:48 user nova-compute[71498]: iface.first_burst_len = 0
Apr 14 01:44:48 user nova-compute[71498]: iface.max_outstanding_r2t = 0
Apr 14 01:44:48 user nova-compute[71498]: iface.max_burst_len = 0
Apr 14 01:44:48 user nova-compute[71498]: iface.chap_auth = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.bidi_chap = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.strict_login_compliance = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.discovery_auth = <empty>
Apr 14 01:44:48 user nova-compute[71498]: iface.discovery_logout = <empty>
Apr 14 01:44:48 user nova-compute[71498]: node.discovery_address = <empty>
Apr 14 01:44:48 user nova-compute[71498]: node.discovery_port = 0
Apr 14 01:44:48 user nova-compute[71498]: node.discovery_type = static
Apr 14 01:44:48 user nova-compute[71498]: node.session.initial_cmdsn = 0
Apr 14 01:44:48 user nova-compute[71498]: node.session.initial_login_retry_max = 8
Apr 14 01:44:48 user nova-compute[71498]: node.session.xmit_thread_priority = -20
Apr 14 01:44:48 user nova-compute[71498]: node.session.cmds_max = 128
Apr 14 01:44:48 user nova-compute[71498]: node.session.queue_depth = 32
Apr 14 01:44:48 user nova-compute[71498]: node.session.nr_sessions = 1
Apr 14 01:44:48 user nova-compute[71498]: node.session.auth.authmethod = CHAP
Apr 14 01:44:48 user nova-compute[71498]: node.session.auth.username = nmkLiNCj
Apr 14 01:44:48 user nova-compute[71498]: node.session.auth.password = ***
Apr 14 01:44:48 user nova-compute[71498]: node.session.auth.username_in = <empty>
Apr 14 01:44:48 user nova-compute[71498]: node.session.auth.password_in = <empty>
Apr 14 01:44:48 user nova-compute[71498]: node.session.auth.chap_algs = MD5
Apr 14 01:44:48 user nova-compute[71498]: node.session.timeo.replacement_timeout = 120
Apr 14 01:44:48 user nova-compute[71498]: node.session.err_timeo.abort_timeout = 15
Apr 14 01:44:48 user nova-compute[71498]: node.session.err_timeo.lu_reset_timeout = 30
Apr 14 01:44:48 user nova-compute[71498]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 14 01:44:48 user nova-compute[71498]: node.session.err_timeo.host_reset_timeout = 60
Apr 14 01:44:48 user nova-compute[71498]: node.session.iscsi.FastAbort = Yes
Apr 14 01:44:48 user nova-compute[71498]: node.session.iscsi.InitialR2T = No
Apr 14 01:44:48 user nova-compute[71498]: node.session.iscsi.ImmediateData = Yes
Apr 14 01:44:48 user nova-compute[71498]: node.session.iscsi.FirstBurstLength = 262144
Apr 14 01:44:48 user nova-compute[71498]: node.session.iscsi.MaxBurstLength = 16776192
Apr 14 01:44:48 user nova-compute[71498]: node.session.iscsi.DefaultTime2Retain = 0
Apr 14 01:44:48 user nova-compute[71498]: node.session.iscsi.DefaultTime2Wait = 2
Apr 14 01:44:48 user nova-compute[71498]: node.session.iscsi.MaxConnections = 1
Apr 14 01:44:48 user nova-compute[71498]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 14 01:44:48 user nova-compute[71498]: node.session.iscsi.ERL = 0
Apr 14 01:44:48 user nova-compute[71498]: node.session.scan = manual
Apr 14 01:44:48 user nova-compute[71498]: node.session.reopen_max = 0
Apr 14 01:44:48 user nova-compute[71498]: node.conn[0].address = 172.16.0.220
Apr 14 01:44:48 user nova-compute[71498]: node.conn[0].port = 3260
Apr 14 01:44:48 user nova-compute[71498]: node.conn[0].startup = manual
Apr 14 01:44:48 user nova-compute[71498]: node.conn[0].tcp.window_size = 524288
Apr 14 01:44:48 user nova-compute[71498]: node.conn[0].tcp.type_of_service = 0
Apr 14 01:44:48 user nova-compute[71498]: node.conn[0].timeo.logout_timeout = 15
Apr 14 01:44:48 user nova-compute[71498]: node.conn[0].timeo.login_timeout = 15
Apr 14 01:44:48 user nova-compute[71498]: node.conn[0].timeo.auth_timeout = 45
Apr 14 01:44:48 user nova-compute[71498]: node.conn[0].timeo.noop_out_interval = 5
Apr 14 01:44:48 user nova-compute[71498]: node.conn[0].timeo.noop_out_timeout = 5
Apr 14 01:44:48 user nova-compute[71498]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 14 01:44:48 user nova-compute[71498]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 14 01:44:48 user nova-compute[71498]: node.conn[0].iscsi.HeaderDigest = None
Apr 14 01:44:48 user nova-compute[71498]: node.conn[0].iscsi.DataDigest = None
Apr 14 01:44:48 user nova-compute[71498]: node.conn[0].iscsi.IFMarker = No
Apr 14 01:44:48 user nova-compute[71498]: node.conn[0].iscsi.OFMarker = No
Apr 14 01:44:48 user nova-compute[71498]: # END RECORD
Apr 14 01:44:48 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c3c935-b80b-4490-bc70-a35aabc66850]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bac3d72-efad-458c-a3f5-3976cc4a19bd]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nmkLiNCj {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nmkLiNCj" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8830920-346f-4e6a-b599-910345cadbb4]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nmkLiNCj'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d04b4d0-c81c-433f-b9f6-59a01ef96882]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[329fb0a8-fbf0-4794-a40e-de92d297d228]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:44:48 user nova-compute[71498]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)
Apr 14 01:44:48 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:44:48 user nova-compute[71498]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)
Apr 14 01:44:48 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.145s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] HCTL ('34', '0', '0', 0) found on session 14 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[992f8bd8-d3e7-4c61-b8e2-f1c16f2b9c4f]: (4, ('0 0 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Searching for a device in session 14 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nmkLiNCj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.175s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] <== connect_volume: return (178ms) {'type': 'block', 'scsi_wwn': '26461643666363838', 'path': '/dev/sdc'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461643666363838', 'path': '/dev/sdc'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:40:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1267413302',display_name='tempest-ServerStableDeviceRescueTest-server-1267413302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1267413302',id=4,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClEbUZCS4BNpBa3d/c+E5gxA0W0UKOCjR2aXoCFkSjH1TtZ7VyBn5ergCTIl3tkCVYAq22i3BavCcYyS+Tyc9WpPRWr8ud0N+f5IiF1KOJhw1hKiESl8P8LoB9KVFwn9Q==',key_name='tempest-keypair-1599380679',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:41:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4833ddea1fa74866b97ef52a730605aa',ramdisk_id='',reservation_id='r-8cuxpjqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-131403183',owner_user_name='tempest-ServerStableDeviceRescueTest-131403183-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:42:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f09ab986a00f43b384cf5d517857a13d',uuid=3a3fb53f-7b4a-48d3-85ab-418bad435c07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7942720d-0958-4826-bedf-0a7eebfe45b6", "address": "fa:16:3e:0c:0e:df", "network": {"id": "95555a4e-9d95-4509-a683-f61ea2dc38a1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-560359898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-560359898-network", "vif_mac": "fa:16:3e:0c:0e:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4833ddea1fa74866b97ef52a730605aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7942720d-09", "ovs_interfaceid": "7942720d-0958-4826-bedf-0a7eebfe45b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Converting VIF {"id": "7942720d-0958-4826-bedf-0a7eebfe45b6", "address": "fa:16:3e:0c:0e:df", "network": {"id": "95555a4e-9d95-4509-a683-f61ea2dc38a1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-560359898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-560359898-network", "vif_mac": "fa:16:3e:0c:0e:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4833ddea1fa74866b97ef52a730605aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7942720d-09", "ovs_interfaceid": "7942720d-0958-4826-bedf-0a7eebfe45b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:0e:df,bridge_name='br-int',has_traffic_filtering=True,id=7942720d-0958-4826-bedf-0a7eebfe45b6,network=Network(95555a4e-9d95-4509-a683-f61ea2dc38a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7942720d-09') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG nova.objects.instance [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a3fb53f-7b4a-48d3-85ab-418bad435c07 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:44:48 user nova-compute[71498]:   <uuid>3a3fb53f-7b4a-48d3-85ab-418bad435c07</uuid>
Apr 14 01:44:48 user nova-compute[71498]:   <name>instance-00000004</name>
Apr 14 01:44:48 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:44:48 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:44:48 user nova-compute[71498]:   <metadata>
Apr 14 01:44:48 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:44:48 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:44:48 user nova-compute[71498]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1267413302</nova:name>
Apr 14 01:44:48 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:44:48</nova:creationTime>
Apr 14 01:44:48 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:44:48 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:44:48 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:44:48 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:44:48 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:44:48 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:44:48 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:44:48 user nova-compute[71498]:       <nova:owner>
Apr 14 01:44:48 user nova-compute[71498]:         <nova:user uuid="f09ab986a00f43b384cf5d517857a13d">tempest-ServerStableDeviceRescueTest-131403183-project-member</nova:user>
Apr 14 01:44:48 user nova-compute[71498]:         <nova:project uuid="4833ddea1fa74866b97ef52a730605aa">tempest-ServerStableDeviceRescueTest-131403183</nova:project>
Apr 14 01:44:48 user nova-compute[71498]:       </nova:owner>
Apr 14 01:44:48 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:44:48 user nova-compute[71498]:       <nova:ports>
Apr 14 01:44:48 user nova-compute[71498]:         <nova:port uuid="7942720d-0958-4826-bedf-0a7eebfe45b6">
Apr 14 01:44:48 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 01:44:48 user nova-compute[71498]:         </nova:port>
Apr 14 01:44:48 user nova-compute[71498]:       </nova:ports>
Apr 14 01:44:48 user nova-compute[71498]:     </nova:instance>
Apr 14 01:44:48 user nova-compute[71498]:   </metadata>
Apr 14 01:44:48 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:44:48 user nova-compute[71498]:     <system>
Apr 14 01:44:48 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:44:48 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:44:48 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:44:48 user nova-compute[71498]:       <entry name="serial">3a3fb53f-7b4a-48d3-85ab-418bad435c07</entry>
Apr 14 01:44:48 user nova-compute[71498]:       <entry name="uuid">3a3fb53f-7b4a-48d3-85ab-418bad435c07</entry>
Apr 14 01:44:48 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:44:48 user nova-compute[71498]:     </system>
Apr 14 01:44:48 user nova-compute[71498]:   </sysinfo>
Apr 14 01:44:48 user nova-compute[71498]:   <os>
Apr 14 01:44:48 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:44:48 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:44:48 user nova-compute[71498]:   </os>
Apr 14 01:44:48 user nova-compute[71498]:   <features>
Apr 14 01:44:48 user nova-compute[71498]:     <acpi/>
Apr 14 01:44:48 user nova-compute[71498]:     <apic/>
Apr 14 01:44:48 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:44:48 user nova-compute[71498]:   </features>
Apr 14 01:44:48 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:44:48 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:44:48 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:44:48 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:44:48 user nova-compute[71498]:   </clock>
Apr 14 01:44:48 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:44:48 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:44:48 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:44:48 user nova-compute[71498]:   </cpu>
Apr 14 01:44:48 user nova-compute[71498]:   <devices>
Apr 14 01:44:48 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:44:48 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:44:48 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk"/>
Apr 14 01:44:48 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:44:48 user nova-compute[71498]:     </disk>
Apr 14 01:44:48 user nova-compute[71498]:     <disk type="block" device="disk">
Apr 14 01:44:48 user nova-compute[71498]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:44:48 user nova-compute[71498]:       <source dev="/dev/sdc"/>
Apr 14 01:44:48 user nova-compute[71498]:       <target dev="vdb" bus="virtio"/>
Apr 14 01:44:48 user nova-compute[71498]:       <serial>7298e05a-b142-4365-95e1-f8551de0ae79</serial>
Apr 14 01:44:48 user nova-compute[71498]:     </disk>
Apr 14 01:44:48 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:44:48 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:44:48 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk.rescue"/>
Apr 14 01:44:48 user nova-compute[71498]:       <target dev="vdc" bus="virtio"/>
Apr 14 01:44:48 user nova-compute[71498]:       <boot order="1"/>
Apr 14 01:44:48 user nova-compute[71498]:     </disk>
Apr 14 01:44:48 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:44:48 user nova-compute[71498]:       <mac address="fa:16:3e:0c:0e:df"/>
Apr 14 01:44:48 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:44:48 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:44:48 user nova-compute[71498]:       <target dev="tap7942720d-09"/>
Apr 14 01:44:48 user nova-compute[71498]:     </interface>
Apr 14 01:44:48 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:44:48 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/console.log" append="off"/>
Apr 14 01:44:48 user nova-compute[71498]:     </serial>
Apr 14 01:44:48 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:44:48 user nova-compute[71498]:     <video>
Apr 14 01:44:48 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:44:48 user nova-compute[71498]:     </video>
Apr 14 01:44:48 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:44:48 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:44:48 user nova-compute[71498]:     </rng>
Apr 14 01:44:48 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:44:48 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:44:48 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:44:48 user nova-compute[71498]:     </memballoon>
Apr 14 01:44:48 user nova-compute[71498]:   </devices>
Apr 14 01:44:48 user nova-compute[71498]: </domain>
Apr 14 01:44:48 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:44:48 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Instance destroyed successfully.
Apr 14 01:44:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:44:48 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] No VIF found with MAC fa:16:3e:0c:0e:df, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:44:49 user nova-compute[71498]: DEBUG nova.compute.manager [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 01:44:49 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:44:49 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Creating image(s)
Apr 14 01:44:49 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Did not create local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 01:44:49 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Ensure instance console log exists: /opt/stack/data/nova/instances/5803c8ed-f1fe-47ae-aaba-13b7cd8831ae/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:44:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:49 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Start _get_guest_xml network_info=[{"id": "7e60c256-3f3d-4a16-bf10-d7b22347ec4f", "address": "fa:16:3e:6e:a2:56", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e60c256-3f", "ovs_interfaceid": "7e60c256-3f3d-4a16-bf10-d7b22347ec4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'abb9a434-5221-494f-8d94-29fc7a6941ab', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LsEAhbUg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5803c8ed-f1fe-47ae-aaba-13b7cd8831ae', 'attached_at': '', 'detached_at': '', 'volume_id': '4ab38ffd-6daf-4153-b3eb-8817849e499d', 'serial': '4ab38ffd-6daf-4153-b3eb-8817849e499d'}, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:44:49 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:44:49 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:44:49 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:44:49 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:44:49 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:44:49 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:44:49 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:44:49 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:44:49 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:44:49 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:44:49 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:44:49 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:44:49 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:44:49 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:44:49 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:44:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LsEAhbUg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:44:49 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:44:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:44:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:44:49 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:44:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:44:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:44:49 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:44:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:49 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec9103e-d237-43fc-8e14-d11ef566ba89]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:44:49 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:44:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abfc028-0ab3-4714-9d55-a582b5dcd192]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d] added
Apr 14 01:44:50 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbdb9a7-fed5-4c2c-90c9-508e91c854b0]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e94b669-4893-4abd-95b4-5e13bbe67512]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LsEAhbUg {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LsEAhbUg" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3c8ea7-d06c-4a9f-92cf-83d797b4b8d8]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LsEAhbUg'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37ed817-eadb-4c25-8964-7b004aa48875]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf55a79a-2489-4ab0-9b98-1a7624eabbac]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:44:50 user nova-compute[71498]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)
Apr 14 01:44:50 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:44:50 user nova-compute[71498]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)
Apr 14 01:44:50 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[591f3f6c-2622-4832-b7f9-7c6019233273]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d, portal: 172.16.0.220,3260]
Apr 14 01:44:50 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d, portal: 172.16.0.220,3260] successful.
Apr 14 01:44:50 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[577d84a0-4a15-4fa6-bd66-cf82bc1280b3]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[585e5dea-39ae-4454-a197-619b673ace79]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:44:50 user nova-compute[71498]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)
Apr 14 01:44:50 user nova-compute[71498]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d (non-flash)
Apr 14 01:44:50 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:44:50 user nova-compute[71498]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)
Apr 14 01:44:50 user nova-compute[71498]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d (non-flash)
Apr 14 01:44:50 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.033s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d60981-1212-46de-bf3e-abf8efeca2cf]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LsEAhbUg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG nova.compute.manager [req-39384355-32aa-4af8-a610-107c11316225 req-ec795dbc-35a9-4ad3-8c4b-570a693913e7 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Received event network-vif-plugged-7942720d-0958-4826-bedf-0a7eebfe45b6 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-39384355-32aa-4af8-a610-107c11316225 req-ec795dbc-35a9-4ad3-8c4b-570a693913e7 service nova] Acquiring lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-39384355-32aa-4af8-a610-107c11316225 req-ec795dbc-35a9-4ad3-8c4b-570a693913e7 service nova] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-39384355-32aa-4af8-a610-107c11316225 req-ec795dbc-35a9-4ad3-8c4b-570a693913e7 service nova] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:50 user nova-compute[71498]: DEBUG nova.compute.manager [req-39384355-32aa-4af8-a610-107c11316225 req-ec795dbc-35a9-4ad3-8c4b-570a693913e7 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] No waiting events found dispatching network-vif-plugged-7942720d-0958-4826-bedf-0a7eebfe45b6 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:44:50 user nova-compute[71498]: WARNING nova.compute.manager [req-39384355-32aa-4af8-a610-107c11316225 req-ec795dbc-35a9-4ad3-8c4b-570a693913e7 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Received unexpected event network-vif-plugged-7942720d-0958-4826-bedf-0a7eebfe45b6 for instance with vm_state active and task_state rescuing.
Apr 14 01:44:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:51 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:51 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:51 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:44:51 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23837353565306133', 'path': '/dev/sdd'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:44:51 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837353565306133', 'path': '/dev/sdd'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:44:51 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:44:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-551698746',display_name='tempest-TestVolumeBootPattern-server-551698746',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-551698746',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1f4117a4adb4aa3b42951cf1fc84237',ramdisk_id='',reservation_id='r-50vvtev6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-224521177',owner_user_name='tempest-TestVolumeBootPattern-224521177-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:44:37Z,user_data=None,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',uuid=5803c8ed-f1fe-47ae-aaba-13b7cd8831ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e60c256-3f3d-4a16-bf10-d7b22347ec4f", "address": "fa:16:3e:6e:a2:56", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e60c256-3f", "ovs_interfaceid": "7e60c256-3f3d-4a16-bf10-d7b22347ec4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:44:51 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converting VIF {"id": "7e60c256-3f3d-4a16-bf10-d7b22347ec4f", "address": "fa:16:3e:6e:a2:56", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e60c256-3f", "ovs_interfaceid": "7e60c256-3f3d-4a16-bf10-d7b22347ec4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:44:51 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:a2:56,bridge_name='br-int',has_traffic_filtering=True,id=7e60c256-3f3d-4a16-bf10-d7b22347ec4f,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e60c256-3f') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:44:51 user nova-compute[71498]: DEBUG nova.objects.instance [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lazy-loading 'pci_devices' on Instance uuid 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:44:51 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:44:51 user nova-compute[71498]:   <uuid>5803c8ed-f1fe-47ae-aaba-13b7cd8831ae</uuid>
Apr 14 01:44:51 user nova-compute[71498]:   <name>instance-00000011</name>
Apr 14 01:44:51 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:44:51 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:44:51 user nova-compute[71498]:   <metadata>
Apr 14 01:44:51 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:44:51 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:44:51 user nova-compute[71498]:       <nova:name>tempest-TestVolumeBootPattern-server-551698746</nova:name>
Apr 14 01:44:51 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:44:49</nova:creationTime>
Apr 14 01:44:51 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:44:51 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:44:51 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:44:51 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:44:51 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:44:51 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:44:51 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:44:51 user nova-compute[71498]:       <nova:owner>
Apr 14 01:44:51 user nova-compute[71498]:         <nova:user uuid="50e3354ac1a84c59a7dee8e1ae6e771a">tempest-TestVolumeBootPattern-224521177-project-member</nova:user>
Apr 14 01:44:51 user nova-compute[71498]:         <nova:project uuid="c1f4117a4adb4aa3b42951cf1fc84237">tempest-TestVolumeBootPattern-224521177</nova:project>
Apr 14 01:44:51 user nova-compute[71498]:       </nova:owner>
Apr 14 01:44:51 user nova-compute[71498]:       <nova:ports>
Apr 14 01:44:51 user nova-compute[71498]:         <nova:port uuid="7e60c256-3f3d-4a16-bf10-d7b22347ec4f">
Apr 14 01:44:51 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 01:44:51 user nova-compute[71498]:         </nova:port>
Apr 14 01:44:51 user nova-compute[71498]:       </nova:ports>
Apr 14 01:44:51 user nova-compute[71498]:     </nova:instance>
Apr 14 01:44:51 user nova-compute[71498]:   </metadata>
Apr 14 01:44:51 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:44:51 user nova-compute[71498]:     <system>
Apr 14 01:44:51 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:44:51 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:44:51 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:44:51 user nova-compute[71498]:       <entry name="serial">5803c8ed-f1fe-47ae-aaba-13b7cd8831ae</entry>
Apr 14 01:44:51 user nova-compute[71498]:       <entry name="uuid">5803c8ed-f1fe-47ae-aaba-13b7cd8831ae</entry>
Apr 14 01:44:51 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:44:51 user nova-compute[71498]:     </system>
Apr 14 01:44:51 user nova-compute[71498]:   </sysinfo>
Apr 14 01:44:51 user nova-compute[71498]:   <os>
Apr 14 01:44:51 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:44:51 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:44:51 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:44:51 user nova-compute[71498]:   </os>
Apr 14 01:44:51 user nova-compute[71498]:   <features>
Apr 14 01:44:51 user nova-compute[71498]:     <acpi/>
Apr 14 01:44:51 user nova-compute[71498]:     <apic/>
Apr 14 01:44:51 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:44:51 user nova-compute[71498]:   </features>
Apr 14 01:44:51 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:44:51 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:44:51 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:44:51 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:44:51 user nova-compute[71498]:   </clock>
Apr 14 01:44:51 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:44:51 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:44:51 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:44:51 user nova-compute[71498]:   </cpu>
Apr 14 01:44:51 user nova-compute[71498]:   <devices>
Apr 14 01:44:51 user nova-compute[71498]:     <disk type="block" device="disk">
Apr 14 01:44:51 user nova-compute[71498]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:44:51 user nova-compute[71498]:       <source dev="/dev/sdd"/>
Apr 14 01:44:51 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:44:51 user nova-compute[71498]:       <serial>4ab38ffd-6daf-4153-b3eb-8817849e499d</serial>
Apr 14 01:44:51 user nova-compute[71498]:     </disk>
Apr 14 01:44:51 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:44:51 user nova-compute[71498]:       <mac address="fa:16:3e:6e:a2:56"/>
Apr 14 01:44:51 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:44:51 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:44:51 user nova-compute[71498]:       <target dev="tap7e60c256-3f"/>
Apr 14 01:44:51 user nova-compute[71498]:     </interface>
Apr 14 01:44:51 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:44:51 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/5803c8ed-f1fe-47ae-aaba-13b7cd8831ae/console.log" append="off"/>
Apr 14 01:44:51 user nova-compute[71498]:     </serial>
Apr 14 01:44:51 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:44:51 user nova-compute[71498]:     <video>
Apr 14 01:44:51 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:44:51 user nova-compute[71498]:     </video>
Apr 14 01:44:51 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:44:51 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:44:51 user nova-compute[71498]:     </rng>
Apr 14 01:44:51 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:44:51 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:44:51 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:44:51 user nova-compute[71498]:     </memballoon>
Apr 14 01:44:51 user nova-compute[71498]:   </devices>
Apr 14 01:44:51 user nova-compute[71498]: </domain>
Apr 14 01:44:51 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:44:51 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:44:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-551698746',display_name='tempest-TestVolumeBootPattern-server-551698746',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-551698746',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1f4117a4adb4aa3b42951cf1fc84237',ramdisk_id='',reservation_id='r-50vvtev6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-224521177',owner_user_name='tempest-TestVolumeBootPattern-224521177-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:44:37Z,user_data=None,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',uuid=5803c8ed-f1fe-47ae-aaba-13b7cd8831ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e60c256-3f3d-4a16-bf10-d7b22347ec4f", "address": "fa:16:3e:6e:a2:56", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e60c256-3f", "ovs_interfaceid": "7e60c256-3f3d-4a16-bf10-d7b22347ec4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:44:51 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converting VIF {"id": "7e60c256-3f3d-4a16-bf10-d7b22347ec4f", "address": "fa:16:3e:6e:a2:56", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e60c256-3f", "ovs_interfaceid": "7e60c256-3f3d-4a16-bf10-d7b22347ec4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:44:51 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:a2:56,bridge_name='br-int',has_traffic_filtering=True,id=7e60c256-3f3d-4a16-bf10-d7b22347ec4f,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e60c256-3f') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:44:51 user nova-compute[71498]: DEBUG os_vif [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:a2:56,bridge_name='br-int',has_traffic_filtering=True,id=7e60c256-3f3d-4a16-bf10-d7b22347ec4f,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e60c256-3f') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:44:51 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:51 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:44:51 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:44:51 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:51 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e60c256-3f, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:44:51 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7e60c256-3f, col_values=(('external_ids', {'iface-id': '7e60c256-3f3d-4a16-bf10-d7b22347ec4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:a2:56', 'vm-uuid': '5803c8ed-f1fe-47ae-aaba-13b7cd8831ae'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:44:51 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:51 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:44:51 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:51 user nova-compute[71498]: INFO os_vif [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:a2:56,bridge_name='br-int',has_traffic_filtering=True,id=7e60c256-3f3d-4a16-bf10-d7b22347ec4f,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e60c256-3f')
Apr 14 01:44:51 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:44:51 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] No VIF found with MAC fa:16:3e:6e:a2:56, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:44:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:52 user nova-compute[71498]: DEBUG nova.compute.manager [req-bb3ce3b4-3f05-452e-89f6-5bcadea6cc01 req-757ed608-0e15-4433-8f63-dcdc1e346de5 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Received event network-vif-plugged-7942720d-0958-4826-bedf-0a7eebfe45b6 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:44:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-bb3ce3b4-3f05-452e-89f6-5bcadea6cc01 req-757ed608-0e15-4433-8f63-dcdc1e346de5 service nova] Acquiring lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-bb3ce3b4-3f05-452e-89f6-5bcadea6cc01 req-757ed608-0e15-4433-8f63-dcdc1e346de5 service nova] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-bb3ce3b4-3f05-452e-89f6-5bcadea6cc01 req-757ed608-0e15-4433-8f63-dcdc1e346de5 service nova] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:52 user nova-compute[71498]: DEBUG nova.compute.manager [req-bb3ce3b4-3f05-452e-89f6-5bcadea6cc01 req-757ed608-0e15-4433-8f63-dcdc1e346de5 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] No waiting events found dispatching network-vif-plugged-7942720d-0958-4826-bedf-0a7eebfe45b6 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:44:52 user nova-compute[71498]: WARNING nova.compute.manager [req-bb3ce3b4-3f05-452e-89f6-5bcadea6cc01 req-757ed608-0e15-4433-8f63-dcdc1e346de5 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Received unexpected event network-vif-plugged-7942720d-0958-4826-bedf-0a7eebfe45b6 for instance with vm_state active and task_state rescuing.
Apr 14 01:44:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:52 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Removed pending event for 3a3fb53f-7b4a-48d3-85ab-418bad435c07 due to event {{(pid=71498) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 01:44:52 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436692.9088748, 3a3fb53f-7b4a-48d3-85ab-418bad435c07 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:44:52 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] VM Resumed (Lifecycle Event)
Apr 14 01:44:52 user nova-compute[71498]: DEBUG nova.compute.manager [None req-7170fb61-b7e2-459e-8cc7-71b6a2cfe596 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:44:52 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:44:52 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:44:52 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 01:44:52 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436692.9114132, 3a3fb53f-7b4a-48d3-85ab-418bad435c07 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:44:52 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] VM Started (Lifecycle Event)
Apr 14 01:44:52 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:44:52 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:44:53 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 01:44:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:54 user nova-compute[71498]: DEBUG nova.compute.manager [req-aa8131cf-b128-4bfb-9b18-9a6f31fa3a84 req-3aa72fc5-8d4f-4d6e-b828-2325bafee081 service nova] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Received event network-vif-plugged-7e60c256-3f3d-4a16-bf10-d7b22347ec4f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:44:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-aa8131cf-b128-4bfb-9b18-9a6f31fa3a84 req-3aa72fc5-8d4f-4d6e-b828-2325bafee081 service nova] Acquiring lock "5803c8ed-f1fe-47ae-aaba-13b7cd8831ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-aa8131cf-b128-4bfb-9b18-9a6f31fa3a84 req-3aa72fc5-8d4f-4d6e-b828-2325bafee081 service nova] Lock "5803c8ed-f1fe-47ae-aaba-13b7cd8831ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-aa8131cf-b128-4bfb-9b18-9a6f31fa3a84 req-3aa72fc5-8d4f-4d6e-b828-2325bafee081 service nova] Lock "5803c8ed-f1fe-47ae-aaba-13b7cd8831ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:54 user nova-compute[71498]: DEBUG nova.compute.manager [req-aa8131cf-b128-4bfb-9b18-9a6f31fa3a84 req-3aa72fc5-8d4f-4d6e-b828-2325bafee081 service nova] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] No waiting events found dispatching network-vif-plugged-7e60c256-3f3d-4a16-bf10-d7b22347ec4f {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:44:54 user nova-compute[71498]: WARNING nova.compute.manager [req-aa8131cf-b128-4bfb-9b18-9a6f31fa3a84 req-3aa72fc5-8d4f-4d6e-b828-2325bafee081 service nova] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Received unexpected event network-vif-plugged-7e60c256-3f3d-4a16-bf10-d7b22347ec4f for instance with vm_state building and task_state spawning.
Apr 14 01:44:54 user nova-compute[71498]: DEBUG nova.compute.manager [req-aa8131cf-b128-4bfb-9b18-9a6f31fa3a84 req-3aa72fc5-8d4f-4d6e-b828-2325bafee081 service nova] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Received event network-vif-plugged-7e60c256-3f3d-4a16-bf10-d7b22347ec4f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:44:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-aa8131cf-b128-4bfb-9b18-9a6f31fa3a84 req-3aa72fc5-8d4f-4d6e-b828-2325bafee081 service nova] Acquiring lock "5803c8ed-f1fe-47ae-aaba-13b7cd8831ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:44:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-aa8131cf-b128-4bfb-9b18-9a6f31fa3a84 req-3aa72fc5-8d4f-4d6e-b828-2325bafee081 service nova] Lock "5803c8ed-f1fe-47ae-aaba-13b7cd8831ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:44:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-aa8131cf-b128-4bfb-9b18-9a6f31fa3a84 req-3aa72fc5-8d4f-4d6e-b828-2325bafee081 service nova] Lock "5803c8ed-f1fe-47ae-aaba-13b7cd8831ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:54 user nova-compute[71498]: DEBUG nova.compute.manager [req-aa8131cf-b128-4bfb-9b18-9a6f31fa3a84 req-3aa72fc5-8d4f-4d6e-b828-2325bafee081 service nova] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] No waiting events found dispatching network-vif-plugged-7e60c256-3f3d-4a16-bf10-d7b22347ec4f {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:44:54 user nova-compute[71498]: WARNING nova.compute.manager [req-aa8131cf-b128-4bfb-9b18-9a6f31fa3a84 req-3aa72fc5-8d4f-4d6e-b828-2325bafee081 service nova] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Received unexpected event network-vif-plugged-7e60c256-3f3d-4a16-bf10-d7b22347ec4f for instance with vm_state building and task_state spawning.
Apr 14 01:44:55 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436695.1691146, 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:44:55 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] VM Resumed (Lifecycle Event)
Apr 14 01:44:55 user nova-compute[71498]: DEBUG nova.compute.manager [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:44:55 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:44:55 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Instance spawned successfully.
Apr 14 01:44:55 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:44:55 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:44:55 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:44:55 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:44:55 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:44:55 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:44:55 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:44:55 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:44:55 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:44:55 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:44:55 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436695.1713998, 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:44:55 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] VM Started (Lifecycle Event)
Apr 14 01:44:55 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:44:55 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:44:55 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:44:55 user nova-compute[71498]: INFO nova.compute.manager [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Took 5.39 seconds to spawn the instance on the hypervisor.
Apr 14 01:44:55 user nova-compute[71498]: DEBUG nova.compute.manager [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:44:55 user nova-compute[71498]: INFO nova.compute.manager [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Took 19.21 seconds to build instance.
Apr 14 01:44:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c2d6a361-0921-44f9-8ee5-1616db41d24d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "5803c8ed-f1fe-47ae-aaba-13b7cd8831ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.317s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:44:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:44:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:01 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:06 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:06 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "a19a1c08-5454-481b-bb5a-70c39ead9afc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "a19a1c08-5454-481b-bb5a-70c39ead9afc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:07 user nova-compute[71498]: DEBUG nova.compute.manager [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 01:45:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:07 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:45:07 user nova-compute[71498]: INFO nova.compute.claims [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Claim successful on node user
Apr 14 01:45:08 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:45:08 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:45:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:08 user nova-compute[71498]: DEBUG nova.compute.manager [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 01:45:08 user nova-compute[71498]: DEBUG nova.compute.manager [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 01:45:08 user nova-compute[71498]: DEBUG nova.network.neutron [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:45:08 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 01:45:08 user nova-compute[71498]: DEBUG nova.compute.manager [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 01:45:08 user nova-compute[71498]: DEBUG nova.compute.manager [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 01:45:08 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:45:08 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Creating image(s)
Apr 14 01:45:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "/opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "/opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "/opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:08 user nova-compute[71498]: DEBUG nova.policy [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eeb5f26be86e43b3b61fff98fdc83cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3de04739384e3ea3a475fee28be3c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:45:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "fa29c144-0ff9-4efb-a574-f521d18f08fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "fa29c144-0ff9-4efb-a574-f521d18f08fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:08 user nova-compute[71498]: DEBUG nova.compute.manager [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 01:45:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.179s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:09 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:45:09 user nova-compute[71498]: INFO nova.compute.claims [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Claim successful on node user
Apr 14 01:45:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.170s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk 1073741824" returned: 0 in 0.073s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:09 user nova-compute[71498]: DEBUG nova.network.neutron [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Successfully created port: 2b00fd21-ee22-48c1-beb5-66e60de9876a {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:45:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.204s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:09 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 01:45:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:09 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Cannot resize image /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 01:45:09 user nova-compute[71498]: DEBUG nova.objects.instance [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'migration_context' on Instance uuid a19a1c08-5454-481b-bb5a-70c39ead9afc {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:45:09 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 01:45:09 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Ensure instance console log exists: /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:45:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:09 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:45:09 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:45:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.816s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:09 user nova-compute[71498]: DEBUG nova.compute.manager [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 01:45:09 user nova-compute[71498]: DEBUG nova.compute.manager [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 01:45:09 user nova-compute[71498]: DEBUG nova.network.neutron [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:45:09 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 01:45:09 user nova-compute[71498]: DEBUG nova.compute.manager [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.policy [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eeb5f26be86e43b3b61fff98fdc83cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3de04739384e3ea3a475fee28be3c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.compute.manager [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:45:10 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Creating image(s)
Apr 14 01:45:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "/opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "/opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.174s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.network.neutron [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Successfully updated port: 2b00fd21-ee22-48c1-beb5-66e60de9876a {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "refresh_cache-a19a1c08-5454-481b-bb5a-70c39ead9afc" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquired lock "refresh_cache-a19a1c08-5454-481b-bb5a-70c39ead9afc" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.network.neutron [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.network.neutron [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.compute.manager [req-b57f6d09-584b-41c9-850b-8bb4ae6a9431 req-34b8783e-cb13-46ca-8ea2-94f05c566ae1 service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Received event network-changed-2b00fd21-ee22-48c1-beb5-66e60de9876a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.compute.manager [req-b57f6d09-584b-41c9-850b-8bb4ae6a9431 req-34b8783e-cb13-46ca-8ea2-94f05c566ae1 service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Refreshing instance network info cache due to event network-changed-2b00fd21-ee22-48c1-beb5-66e60de9876a. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b57f6d09-584b-41c9-850b-8bb4ae6a9431 req-34b8783e-cb13-46ca-8ea2-94f05c566ae1 service nova] Acquiring lock "refresh_cache-a19a1c08-5454-481b-bb5a-70c39ead9afc" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.194s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk 1073741824" returned: 0 in 0.061s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.167s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.network.neutron [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Updating instance_info_cache with network_info: [{"id": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "address": "fa:16:3e:1f:54:6c", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b00fd21-ee", "ovs_interfaceid": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Releasing lock "refresh_cache-a19a1c08-5454-481b-bb5a-70c39ead9afc" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.compute.manager [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Instance network_info: |[{"id": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "address": "fa:16:3e:1f:54:6c", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b00fd21-ee", "ovs_interfaceid": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b57f6d09-584b-41c9-850b-8bb4ae6a9431 req-34b8783e-cb13-46ca-8ea2-94f05c566ae1 service nova] Acquired lock "refresh_cache-a19a1c08-5454-481b-bb5a-70c39ead9afc" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.network.neutron [req-b57f6d09-584b-41c9-850b-8bb4ae6a9431 req-34b8783e-cb13-46ca-8ea2-94f05c566ae1 service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Refreshing network info cache for port 2b00fd21-ee22-48c1-beb5-66e60de9876a {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Start _get_guest_xml network_info=[{"id": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "address": "fa:16:3e:1f:54:6c", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b00fd21-ee", "ovs_interfaceid": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.network.neutron [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Successfully created port: 6a841349-4e6e-40e1-90f0-998d46c60567 {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:45:10 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:45:10 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-611036692',display_name='tempest-ServerRescueNegativeTestJSON-server-611036692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-611036692',id=18,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d3de04739384e3ea3a475fee28be3c0',ramdisk_id='',reservation_id='r-nnoryzj4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1453869246',owner_user_name='tempest-ServerRescueNegativeTestJSON-1453869246-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:45:09Z,user_data=None,user_id='eeb5f26be86e43b3b61fff98fdc83cf3',uuid=a19a1c08-5454-481b-bb5a-70c39ead9afc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "address": "fa:16:3e:1f:54:6c", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b00fd21-ee", "ovs_interfaceid": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Converting VIF {"id": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "address": "fa:16:3e:1f:54:6c", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b00fd21-ee", "ovs_interfaceid": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:54:6c,bridge_name='br-int',has_traffic_filtering=True,id=2b00fd21-ee22-48c1-beb5-66e60de9876a,network=Network(2c4fba9e-0217-4e37-af1c-065b3f0cd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b00fd21-ee') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.objects.instance [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'pci_devices' on Instance uuid a19a1c08-5454-481b-bb5a-70c39ead9afc {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Cannot resize image /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.objects.instance [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'migration_context' on Instance uuid fa29c144-0ff9-4efb-a574-f521d18f08fa {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:45:10 user nova-compute[71498]:   <uuid>a19a1c08-5454-481b-bb5a-70c39ead9afc</uuid>
Apr 14 01:45:10 user nova-compute[71498]:   <name>instance-00000012</name>
Apr 14 01:45:10 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:45:10 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:45:10 user nova-compute[71498]:   <metadata>
Apr 14 01:45:10 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:45:10 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:45:10 user nova-compute[71498]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-611036692</nova:name>
Apr 14 01:45:10 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:45:10</nova:creationTime>
Apr 14 01:45:10 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:45:10 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:45:10 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:45:10 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:45:10 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:45:10 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:45:10 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:45:10 user nova-compute[71498]:       <nova:owner>
Apr 14 01:45:10 user nova-compute[71498]:         <nova:user uuid="eeb5f26be86e43b3b61fff98fdc83cf3">tempest-ServerRescueNegativeTestJSON-1453869246-project-member</nova:user>
Apr 14 01:45:10 user nova-compute[71498]:         <nova:project uuid="6d3de04739384e3ea3a475fee28be3c0">tempest-ServerRescueNegativeTestJSON-1453869246</nova:project>
Apr 14 01:45:10 user nova-compute[71498]:       </nova:owner>
Apr 14 01:45:10 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:45:10 user nova-compute[71498]:       <nova:ports>
Apr 14 01:45:10 user nova-compute[71498]:         <nova:port uuid="2b00fd21-ee22-48c1-beb5-66e60de9876a">
Apr 14 01:45:10 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 01:45:10 user nova-compute[71498]:         </nova:port>
Apr 14 01:45:10 user nova-compute[71498]:       </nova:ports>
Apr 14 01:45:10 user nova-compute[71498]:     </nova:instance>
Apr 14 01:45:10 user nova-compute[71498]:   </metadata>
Apr 14 01:45:10 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:45:10 user nova-compute[71498]:     <system>
Apr 14 01:45:10 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:45:10 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:45:10 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:45:10 user nova-compute[71498]:       <entry name="serial">a19a1c08-5454-481b-bb5a-70c39ead9afc</entry>
Apr 14 01:45:10 user nova-compute[71498]:       <entry name="uuid">a19a1c08-5454-481b-bb5a-70c39ead9afc</entry>
Apr 14 01:45:10 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:45:10 user nova-compute[71498]:     </system>
Apr 14 01:45:10 user nova-compute[71498]:   </sysinfo>
Apr 14 01:45:10 user nova-compute[71498]:   <os>
Apr 14 01:45:10 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:45:10 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:45:10 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:45:10 user nova-compute[71498]:   </os>
Apr 14 01:45:10 user nova-compute[71498]:   <features>
Apr 14 01:45:10 user nova-compute[71498]:     <acpi/>
Apr 14 01:45:10 user nova-compute[71498]:     <apic/>
Apr 14 01:45:10 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:45:10 user nova-compute[71498]:   </features>
Apr 14 01:45:10 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:45:10 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:45:10 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:45:10 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:45:10 user nova-compute[71498]:   </clock>
Apr 14 01:45:10 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:45:10 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:45:10 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:45:10 user nova-compute[71498]:   </cpu>
Apr 14 01:45:10 user nova-compute[71498]:   <devices>
Apr 14 01:45:10 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:45:10 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:45:10 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk"/>
Apr 14 01:45:10 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:45:10 user nova-compute[71498]:     </disk>
Apr 14 01:45:10 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:45:10 user nova-compute[71498]:       <mac address="fa:16:3e:1f:54:6c"/>
Apr 14 01:45:10 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:45:10 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:45:10 user nova-compute[71498]:       <target dev="tap2b00fd21-ee"/>
Apr 14 01:45:10 user nova-compute[71498]:     </interface>
Apr 14 01:45:10 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:45:10 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/console.log" append="off"/>
Apr 14 01:45:10 user nova-compute[71498]:     </serial>
Apr 14 01:45:10 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:45:10 user nova-compute[71498]:     <video>
Apr 14 01:45:10 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:45:10 user nova-compute[71498]:     </video>
Apr 14 01:45:10 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:45:10 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:45:10 user nova-compute[71498]:     </rng>
Apr 14 01:45:10 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:45:10 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:45:10 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:45:10 user nova-compute[71498]:     </memballoon>
Apr 14 01:45:10 user nova-compute[71498]:   </devices>
Apr 14 01:45:10 user nova-compute[71498]: </domain>
Apr 14 01:45:10 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-611036692',display_name='tempest-ServerRescueNegativeTestJSON-server-611036692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-611036692',id=18,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d3de04739384e3ea3a475fee28be3c0',ramdisk_id='',reservation_id='r-nnoryzj4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1453869246',owner_user_name='tempest-ServerRescueNegativeTestJSON-1453869246-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:45:09Z,user_data=None,user_id='eeb5f26be86e43b3b61fff98fdc83cf3',uuid=a19a1c08-5454-481b-bb5a-70c39ead9afc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "address": "fa:16:3e:1f:54:6c", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b00fd21-ee", "ovs_interfaceid": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Converting VIF {"id": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "address": "fa:16:3e:1f:54:6c", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b00fd21-ee", "ovs_interfaceid": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:54:6c,bridge_name='br-int',has_traffic_filtering=True,id=2b00fd21-ee22-48c1-beb5-66e60de9876a,network=Network(2c4fba9e-0217-4e37-af1c-065b3f0cd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b00fd21-ee') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG os_vif [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:54:6c,bridge_name='br-int',has_traffic_filtering=True,id=2b00fd21-ee22-48c1-beb5-66e60de9876a,network=Network(2c4fba9e-0217-4e37-af1c-065b3f0cd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b00fd21-ee') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Ensure instance console log exists: /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b00fd21-ee, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2b00fd21-ee, col_values=(('external_ids', {'iface-id': '2b00fd21-ee22-48c1-beb5-66e60de9876a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:54:6c', 'vm-uuid': 'a19a1c08-5454-481b-bb5a-70c39ead9afc'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:45:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:10 user nova-compute[71498]: INFO os_vif [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:54:6c,bridge_name='br-int',has_traffic_filtering=True,id=2b00fd21-ee22-48c1-beb5-66e60de9876a,network=Network(2c4fba9e-0217-4e37-af1c-065b3f0cd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b00fd21-ee')
Apr 14 01:45:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:45:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] No VIF found with MAC fa:16:3e:1f:54:6c, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:45:11 user nova-compute[71498]: DEBUG nova.network.neutron [req-b57f6d09-584b-41c9-850b-8bb4ae6a9431 req-34b8783e-cb13-46ca-8ea2-94f05c566ae1 service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Updated VIF entry in instance network info cache for port 2b00fd21-ee22-48c1-beb5-66e60de9876a. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:45:11 user nova-compute[71498]: DEBUG nova.network.neutron [req-b57f6d09-584b-41c9-850b-8bb4ae6a9431 req-34b8783e-cb13-46ca-8ea2-94f05c566ae1 service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Updating instance_info_cache with network_info: [{"id": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "address": "fa:16:3e:1f:54:6c", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b00fd21-ee", "ovs_interfaceid": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:45:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b57f6d09-584b-41c9-850b-8bb4ae6a9431 req-34b8783e-cb13-46ca-8ea2-94f05c566ae1 service nova] Releasing lock "refresh_cache-a19a1c08-5454-481b-bb5a-70c39ead9afc" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:45:11 user nova-compute[71498]: DEBUG nova.network.neutron [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Successfully updated port: 6a841349-4e6e-40e1-90f0-998d46c60567 {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:45:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "refresh_cache-fa29c144-0ff9-4efb-a574-f521d18f08fa" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:45:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquired lock "refresh_cache-fa29c144-0ff9-4efb-a574-f521d18f08fa" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:45:11 user nova-compute[71498]: DEBUG nova.network.neutron [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:45:11 user nova-compute[71498]: DEBUG nova.compute.manager [req-bebafc88-6be4-46f6-9ef6-1ccb7ab292a7 req-468f0b34-8aab-46b3-a67e-607e9d8d930d service nova] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Received event network-changed-6a841349-4e6e-40e1-90f0-998d46c60567 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:45:11 user nova-compute[71498]: DEBUG nova.compute.manager [req-bebafc88-6be4-46f6-9ef6-1ccb7ab292a7 req-468f0b34-8aab-46b3-a67e-607e9d8d930d service nova] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Refreshing instance network info cache due to event network-changed-6a841349-4e6e-40e1-90f0-998d46c60567. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:45:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-bebafc88-6be4-46f6-9ef6-1ccb7ab292a7 req-468f0b34-8aab-46b3-a67e-607e9d8d930d service nova] Acquiring lock "refresh_cache-fa29c144-0ff9-4efb-a574-f521d18f08fa" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:45:11 user nova-compute[71498]: DEBUG nova.network.neutron [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:45:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG nova.network.neutron [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Updating instance_info_cache with network_info: [{"id": "6a841349-4e6e-40e1-90f0-998d46c60567", "address": "fa:16:3e:49:5d:eb", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a841349-4e", "ovs_interfaceid": "6a841349-4e6e-40e1-90f0-998d46c60567", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Releasing lock "refresh_cache-fa29c144-0ff9-4efb-a574-f521d18f08fa" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG nova.compute.manager [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Instance network_info: |[{"id": "6a841349-4e6e-40e1-90f0-998d46c60567", "address": "fa:16:3e:49:5d:eb", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a841349-4e", "ovs_interfaceid": "6a841349-4e6e-40e1-90f0-998d46c60567", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-bebafc88-6be4-46f6-9ef6-1ccb7ab292a7 req-468f0b34-8aab-46b3-a67e-607e9d8d930d service nova] Acquired lock "refresh_cache-fa29c144-0ff9-4efb-a574-f521d18f08fa" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG nova.network.neutron [req-bebafc88-6be4-46f6-9ef6-1ccb7ab292a7 req-468f0b34-8aab-46b3-a67e-607e9d8d930d service nova] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Refreshing network info cache for port 6a841349-4e6e-40e1-90f0-998d46c60567 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Start _get_guest_xml network_info=[{"id": "6a841349-4e6e-40e1-90f0-998d46c60567", "address": "fa:16:3e:49:5d:eb", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a841349-4e", "ovs_interfaceid": "6a841349-4e6e-40e1-90f0-998d46c60567", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:45:12 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:45:12 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:45:12 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:45:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2109836040',display_name='tempest-ServerRescueNegativeTestJSON-server-2109836040',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2109836040',id=19,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d3de04739384e3ea3a475fee28be3c0',ramdisk_id='',reservation_id='r-9ja500p2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1453869246',owner_user_name='tempest-ServerRescueNegativeTestJSON-1453869246-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:45:10Z,user_data=None,user_id='eeb5f26be86e43b3b61fff98fdc83cf3',uuid=fa29c144-0ff9-4efb-a574-f521d18f08fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a841349-4e6e-40e1-90f0-998d46c60567", "address": "fa:16:3e:49:5d:eb", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a841349-4e", "ovs_interfaceid": "6a841349-4e6e-40e1-90f0-998d46c60567", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Converting VIF {"id": "6a841349-4e6e-40e1-90f0-998d46c60567", "address": "fa:16:3e:49:5d:eb", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a841349-4e", "ovs_interfaceid": "6a841349-4e6e-40e1-90f0-998d46c60567", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:5d:eb,bridge_name='br-int',has_traffic_filtering=True,id=6a841349-4e6e-40e1-90f0-998d46c60567,network=Network(2c4fba9e-0217-4e37-af1c-065b3f0cd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a841349-4e') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG nova.objects.instance [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'pci_devices' on Instance uuid fa29c144-0ff9-4efb-a574-f521d18f08fa {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:45:12 user nova-compute[71498]:   <uuid>fa29c144-0ff9-4efb-a574-f521d18f08fa</uuid>
Apr 14 01:45:12 user nova-compute[71498]:   <name>instance-00000013</name>
Apr 14 01:45:12 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:45:12 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:45:12 user nova-compute[71498]:   <metadata>
Apr 14 01:45:12 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:45:12 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:45:12 user nova-compute[71498]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2109836040</nova:name>
Apr 14 01:45:12 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:45:12</nova:creationTime>
Apr 14 01:45:12 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:45:12 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:45:12 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:45:12 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:45:12 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:45:12 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:45:12 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:45:12 user nova-compute[71498]:       <nova:owner>
Apr 14 01:45:12 user nova-compute[71498]:         <nova:user uuid="eeb5f26be86e43b3b61fff98fdc83cf3">tempest-ServerRescueNegativeTestJSON-1453869246-project-member</nova:user>
Apr 14 01:45:12 user nova-compute[71498]:         <nova:project uuid="6d3de04739384e3ea3a475fee28be3c0">tempest-ServerRescueNegativeTestJSON-1453869246</nova:project>
Apr 14 01:45:12 user nova-compute[71498]:       </nova:owner>
Apr 14 01:45:12 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:45:12 user nova-compute[71498]:       <nova:ports>
Apr 14 01:45:12 user nova-compute[71498]:         <nova:port uuid="6a841349-4e6e-40e1-90f0-998d46c60567">
Apr 14 01:45:12 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 01:45:12 user nova-compute[71498]:         </nova:port>
Apr 14 01:45:12 user nova-compute[71498]:       </nova:ports>
Apr 14 01:45:12 user nova-compute[71498]:     </nova:instance>
Apr 14 01:45:12 user nova-compute[71498]:   </metadata>
Apr 14 01:45:12 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:45:12 user nova-compute[71498]:     <system>
Apr 14 01:45:12 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:45:12 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:45:12 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:45:12 user nova-compute[71498]:       <entry name="serial">fa29c144-0ff9-4efb-a574-f521d18f08fa</entry>
Apr 14 01:45:12 user nova-compute[71498]:       <entry name="uuid">fa29c144-0ff9-4efb-a574-f521d18f08fa</entry>
Apr 14 01:45:12 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:45:12 user nova-compute[71498]:     </system>
Apr 14 01:45:12 user nova-compute[71498]:   </sysinfo>
Apr 14 01:45:12 user nova-compute[71498]:   <os>
Apr 14 01:45:12 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:45:12 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:45:12 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:45:12 user nova-compute[71498]:   </os>
Apr 14 01:45:12 user nova-compute[71498]:   <features>
Apr 14 01:45:12 user nova-compute[71498]:     <acpi/>
Apr 14 01:45:12 user nova-compute[71498]:     <apic/>
Apr 14 01:45:12 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:45:12 user nova-compute[71498]:   </features>
Apr 14 01:45:12 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:45:12 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:45:12 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:45:12 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:45:12 user nova-compute[71498]:   </clock>
Apr 14 01:45:12 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:45:12 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:45:12 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:45:12 user nova-compute[71498]:   </cpu>
Apr 14 01:45:12 user nova-compute[71498]:   <devices>
Apr 14 01:45:12 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:45:12 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:45:12 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk"/>
Apr 14 01:45:12 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:45:12 user nova-compute[71498]:     </disk>
Apr 14 01:45:12 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:45:12 user nova-compute[71498]:       <mac address="fa:16:3e:49:5d:eb"/>
Apr 14 01:45:12 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:45:12 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:45:12 user nova-compute[71498]:       <target dev="tap6a841349-4e"/>
Apr 14 01:45:12 user nova-compute[71498]:     </interface>
Apr 14 01:45:12 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:45:12 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/console.log" append="off"/>
Apr 14 01:45:12 user nova-compute[71498]:     </serial>
Apr 14 01:45:12 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:45:12 user nova-compute[71498]:     <video>
Apr 14 01:45:12 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:45:12 user nova-compute[71498]:     </video>
Apr 14 01:45:12 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:45:12 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:45:12 user nova-compute[71498]:     </rng>
Apr 14 01:45:12 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:45:12 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:45:12 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:45:12 user nova-compute[71498]:     </memballoon>
Apr 14 01:45:12 user nova-compute[71498]:   </devices>
Apr 14 01:45:12 user nova-compute[71498]: </domain>
Apr 14 01:45:12 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:45:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2109836040',display_name='tempest-ServerRescueNegativeTestJSON-server-2109836040',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2109836040',id=19,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d3de04739384e3ea3a475fee28be3c0',ramdisk_id='',reservation_id='r-9ja500p2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1453869246',owner_user_name='tempest-ServerRescueNegativeTestJSON-1453869246-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:45:10Z,user_data=None,user_id='eeb5f26be86e43b3b61fff98fdc83cf3',uuid=fa29c144-0ff9-4efb-a574-f521d18f08fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a841349-4e6e-40e1-90f0-998d46c60567", "address": "fa:16:3e:49:5d:eb", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a841349-4e", "ovs_interfaceid": "6a841349-4e6e-40e1-90f0-998d46c60567", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Converting VIF {"id": "6a841349-4e6e-40e1-90f0-998d46c60567", "address": "fa:16:3e:49:5d:eb", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a841349-4e", "ovs_interfaceid": "6a841349-4e6e-40e1-90f0-998d46c60567", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:5d:eb,bridge_name='br-int',has_traffic_filtering=True,id=6a841349-4e6e-40e1-90f0-998d46c60567,network=Network(2c4fba9e-0217-4e37-af1c-065b3f0cd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a841349-4e') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG os_vif [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:5d:eb,bridge_name='br-int',has_traffic_filtering=True,id=6a841349-4e6e-40e1-90f0-998d46c60567,network=Network(2c4fba9e-0217-4e37-af1c-065b3f0cd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a841349-4e') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a841349-4e, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6a841349-4e, col_values=(('external_ids', {'iface-id': '6a841349-4e6e-40e1-90f0-998d46c60567', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:5d:eb', 'vm-uuid': 'fa29c144-0ff9-4efb-a574-f521d18f08fa'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:12 user nova-compute[71498]: INFO os_vif [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:5d:eb,bridge_name='br-int',has_traffic_filtering=True,id=6a841349-4e6e-40e1-90f0-998d46c60567,network=Network(2c4fba9e-0217-4e37-af1c-065b3f0cd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a841349-4e')
Apr 14 01:45:12 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] No VIF found with MAC fa:16:3e:49:5d:eb, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:13 user nova-compute[71498]: DEBUG nova.network.neutron [req-bebafc88-6be4-46f6-9ef6-1ccb7ab292a7 req-468f0b34-8aab-46b3-a67e-607e9d8d930d service nova] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Updated VIF entry in instance network info cache for port 6a841349-4e6e-40e1-90f0-998d46c60567. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:45:13 user nova-compute[71498]: DEBUG nova.network.neutron [req-bebafc88-6be4-46f6-9ef6-1ccb7ab292a7 req-468f0b34-8aab-46b3-a67e-607e9d8d930d service nova] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Updating instance_info_cache with network_info: [{"id": "6a841349-4e6e-40e1-90f0-998d46c60567", "address": "fa:16:3e:49:5d:eb", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a841349-4e", "ovs_interfaceid": "6a841349-4e6e-40e1-90f0-998d46c60567", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:45:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-bebafc88-6be4-46f6-9ef6-1ccb7ab292a7 req-468f0b34-8aab-46b3-a67e-607e9d8d930d service nova] Releasing lock "refresh_cache-fa29c144-0ff9-4efb-a574-f521d18f08fa" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:45:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:13 user nova-compute[71498]: DEBUG nova.compute.manager [req-1c8a2fc4-32b6-4434-938c-5839d897f798 req-eadefffe-e33e-44de-b9ca-2343373ebf8f service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Received event network-vif-plugged-2b00fd21-ee22-48c1-beb5-66e60de9876a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:45:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1c8a2fc4-32b6-4434-938c-5839d897f798 req-eadefffe-e33e-44de-b9ca-2343373ebf8f service nova] Acquiring lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1c8a2fc4-32b6-4434-938c-5839d897f798 req-eadefffe-e33e-44de-b9ca-2343373ebf8f service nova] Lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1c8a2fc4-32b6-4434-938c-5839d897f798 req-eadefffe-e33e-44de-b9ca-2343373ebf8f service nova] Lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:13 user nova-compute[71498]: DEBUG nova.compute.manager [req-1c8a2fc4-32b6-4434-938c-5839d897f798 req-eadefffe-e33e-44de-b9ca-2343373ebf8f service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] No waiting events found dispatching network-vif-plugged-2b00fd21-ee22-48c1-beb5-66e60de9876a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:45:13 user nova-compute[71498]: WARNING nova.compute.manager [req-1c8a2fc4-32b6-4434-938c-5839d897f798 req-eadefffe-e33e-44de-b9ca-2343373ebf8f service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Received unexpected event network-vif-plugged-2b00fd21-ee22-48c1-beb5-66e60de9876a for instance with vm_state building and task_state spawning.
Apr 14 01:45:13 user nova-compute[71498]: DEBUG nova.compute.manager [req-1c8a2fc4-32b6-4434-938c-5839d897f798 req-eadefffe-e33e-44de-b9ca-2343373ebf8f service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Received event network-vif-plugged-2b00fd21-ee22-48c1-beb5-66e60de9876a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:45:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1c8a2fc4-32b6-4434-938c-5839d897f798 req-eadefffe-e33e-44de-b9ca-2343373ebf8f service nova] Acquiring lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1c8a2fc4-32b6-4434-938c-5839d897f798 req-eadefffe-e33e-44de-b9ca-2343373ebf8f service nova] Lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1c8a2fc4-32b6-4434-938c-5839d897f798 req-eadefffe-e33e-44de-b9ca-2343373ebf8f service nova] Lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:13 user nova-compute[71498]: DEBUG nova.compute.manager [req-1c8a2fc4-32b6-4434-938c-5839d897f798 req-eadefffe-e33e-44de-b9ca-2343373ebf8f service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] No waiting events found dispatching network-vif-plugged-2b00fd21-ee22-48c1-beb5-66e60de9876a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:45:13 user nova-compute[71498]: WARNING nova.compute.manager [req-1c8a2fc4-32b6-4434-938c-5839d897f798 req-eadefffe-e33e-44de-b9ca-2343373ebf8f service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Received unexpected event network-vif-plugged-2b00fd21-ee22-48c1-beb5-66e60de9876a for instance with vm_state building and task_state spawning.
Apr 14 01:45:14 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:14 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:14 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:14 user nova-compute[71498]: DEBUG nova.compute.manager [req-1e1d1263-aa91-4a0f-ad9f-065626ca8f4c req-50da5434-99ad-4841-9fbc-cf32c73e2f86 service nova] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Received event network-vif-plugged-6a841349-4e6e-40e1-90f0-998d46c60567 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:45:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1e1d1263-aa91-4a0f-ad9f-065626ca8f4c req-50da5434-99ad-4841-9fbc-cf32c73e2f86 service nova] Acquiring lock "fa29c144-0ff9-4efb-a574-f521d18f08fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1e1d1263-aa91-4a0f-ad9f-065626ca8f4c req-50da5434-99ad-4841-9fbc-cf32c73e2f86 service nova] Lock "fa29c144-0ff9-4efb-a574-f521d18f08fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1e1d1263-aa91-4a0f-ad9f-065626ca8f4c req-50da5434-99ad-4841-9fbc-cf32c73e2f86 service nova] Lock "fa29c144-0ff9-4efb-a574-f521d18f08fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:14 user nova-compute[71498]: DEBUG nova.compute.manager [req-1e1d1263-aa91-4a0f-ad9f-065626ca8f4c req-50da5434-99ad-4841-9fbc-cf32c73e2f86 service nova] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] No waiting events found dispatching network-vif-plugged-6a841349-4e6e-40e1-90f0-998d46c60567 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:45:14 user nova-compute[71498]: WARNING nova.compute.manager [req-1e1d1263-aa91-4a0f-ad9f-065626ca8f4c req-50da5434-99ad-4841-9fbc-cf32c73e2f86 service nova] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Received unexpected event network-vif-plugged-6a841349-4e6e-40e1-90f0-998d46c60567 for instance with vm_state building and task_state spawning.
Apr 14 01:45:14 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:16 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436716.5791106, a19a1c08-5454-481b-bb5a-70c39ead9afc => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:45:16 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] VM Resumed (Lifecycle Event)
Apr 14 01:45:16 user nova-compute[71498]: DEBUG nova.compute.manager [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:45:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:45:16 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Instance spawned successfully.
Apr 14 01:45:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:45:16 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:45:16 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:45:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:45:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:45:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:45:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:45:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:45:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:45:16 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:45:16 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436716.5811307, a19a1c08-5454-481b-bb5a-70c39ead9afc => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:45:16 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] VM Started (Lifecycle Event)
Apr 14 01:45:16 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:45:16 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:45:16 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:45:16 user nova-compute[71498]: INFO nova.compute.manager [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Took 8.05 seconds to spawn the instance on the hypervisor.
Apr 14 01:45:16 user nova-compute[71498]: DEBUG nova.compute.manager [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:45:16 user nova-compute[71498]: INFO nova.compute.manager [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Took 8.92 seconds to build instance.
Apr 14 01:45:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-67d49491-1b80-4323-b2e0-5b31113f381c tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "a19a1c08-5454-481b-bb5a-70c39ead9afc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.027s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:16 user nova-compute[71498]: DEBUG nova.compute.manager [req-e2f17e3b-4912-4eb1-a895-a798c5daad20 req-93560328-a2bc-4f39-8026-025f0ad562e1 service nova] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Received event network-vif-plugged-6a841349-4e6e-40e1-90f0-998d46c60567 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:45:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e2f17e3b-4912-4eb1-a895-a798c5daad20 req-93560328-a2bc-4f39-8026-025f0ad562e1 service nova] Acquiring lock "fa29c144-0ff9-4efb-a574-f521d18f08fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e2f17e3b-4912-4eb1-a895-a798c5daad20 req-93560328-a2bc-4f39-8026-025f0ad562e1 service nova] Lock "fa29c144-0ff9-4efb-a574-f521d18f08fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e2f17e3b-4912-4eb1-a895-a798c5daad20 req-93560328-a2bc-4f39-8026-025f0ad562e1 service nova] Lock "fa29c144-0ff9-4efb-a574-f521d18f08fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:16 user nova-compute[71498]: DEBUG nova.compute.manager [req-e2f17e3b-4912-4eb1-a895-a798c5daad20 req-93560328-a2bc-4f39-8026-025f0ad562e1 service nova] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] No waiting events found dispatching network-vif-plugged-6a841349-4e6e-40e1-90f0-998d46c60567 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:45:16 user nova-compute[71498]: WARNING nova.compute.manager [req-e2f17e3b-4912-4eb1-a895-a798c5daad20 req-93560328-a2bc-4f39-8026-025f0ad562e1 service nova] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Received unexpected event network-vif-plugged-6a841349-4e6e-40e1-90f0-998d46c60567 for instance with vm_state building and task_state spawning.
Apr 14 01:45:16 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436716.920611, fa29c144-0ff9-4efb-a574-f521d18f08fa => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:45:16 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] VM Resumed (Lifecycle Event)
Apr 14 01:45:16 user nova-compute[71498]: DEBUG nova.compute.manager [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:45:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:45:16 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Instance spawned successfully.
Apr 14 01:45:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:45:16 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:45:16 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:45:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:45:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:45:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:45:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:45:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:45:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:45:16 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:45:16 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436716.9221106, fa29c144-0ff9-4efb-a574-f521d18f08fa => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:45:16 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] VM Started (Lifecycle Event)
Apr 14 01:45:17 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:45:17 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:45:17 user nova-compute[71498]: INFO nova.compute.manager [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Took 7.00 seconds to spawn the instance on the hypervisor.
Apr 14 01:45:17 user nova-compute[71498]: DEBUG nova.compute.manager [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:45:17 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:45:17 user nova-compute[71498]: INFO nova.compute.manager [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Took 8.21 seconds to build instance.
Apr 14 01:45:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-53769ed0-fc5b-4039-b8f1-ba88c81e948e tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "fa29c144-0ff9-4efb-a574-f521d18f08fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.340s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:19 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 01:45:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:26 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:45:26 user nova-compute[71498]: INFO nova.compute.claims [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Claim successful on node user
Apr 14 01:45:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:27 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:45:27 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:45:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.626s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 01:45:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 01:45:27 user nova-compute[71498]: DEBUG nova.network.neutron [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:45:27 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 01:45:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 01:45:27 user nova-compute[71498]: DEBUG nova.policy [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:45:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 01:45:27 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:45:27 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Creating image(s)
Apr 14 01:45:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "/opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "/opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "/opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.236s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.179s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:28 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:45:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk 1073741824" returned: 0 in 0.081s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:28 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 01:45:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.160s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:28 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Checking if we can resize image /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 01:45:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:28 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Cannot resize image /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 01:45:28 user nova-compute[71498]: DEBUG nova.objects.instance [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lazy-loading 'migration_context' on Instance uuid 73cc8ede-babd-4281-bf1d-c5a3f8bad440 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:45:28 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 01:45:28 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Ensure instance console log exists: /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:45:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:28 user nova-compute[71498]: DEBUG nova.network.neutron [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Successfully created port: 84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:45:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:29 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:45:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:29 user nova-compute[71498]: DEBUG nova.network.neutron [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Successfully updated port: 84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:45:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "refresh_cache-73cc8ede-babd-4281-bf1d-c5a3f8bad440" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:45:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquired lock "refresh_cache-73cc8ede-babd-4281-bf1d-c5a3f8bad440" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:45:29 user nova-compute[71498]: DEBUG nova.network.neutron [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:45:29 user nova-compute[71498]: DEBUG nova.compute.manager [req-4807c82c-26f3-40cc-87f8-8615af06e68b req-3a11a25b-b59d-4b47-9310-19d34cd7b5c7 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Received event network-changed-84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:45:29 user nova-compute[71498]: DEBUG nova.compute.manager [req-4807c82c-26f3-40cc-87f8-8615af06e68b req-3a11a25b-b59d-4b47-9310-19d34cd7b5c7 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Refreshing instance network info cache due to event network-changed-84d281bf-164e-48f3-a3ee-ca796d9a48e7. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:45:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4807c82c-26f3-40cc-87f8-8615af06e68b req-3a11a25b-b59d-4b47-9310-19d34cd7b5c7 service nova] Acquiring lock "refresh_cache-73cc8ede-babd-4281-bf1d-c5a3f8bad440" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:45:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:29 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:45:29 user nova-compute[71498]: DEBUG nova.network.neutron [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:45:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG nova.network.neutron [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Updating instance_info_cache with network_info: [{"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Releasing lock "refresh_cache-73cc8ede-babd-4281-bf1d-c5a3f8bad440" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG nova.compute.manager [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Instance network_info: |[{"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4807c82c-26f3-40cc-87f8-8615af06e68b req-3a11a25b-b59d-4b47-9310-19d34cd7b5c7 service nova] Acquired lock "refresh_cache-73cc8ede-babd-4281-bf1d-c5a3f8bad440" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG nova.network.neutron [req-4807c82c-26f3-40cc-87f8-8615af06e68b req-3a11a25b-b59d-4b47-9310-19d34cd7b5c7 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Refreshing network info cache for port 84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Start _get_guest_xml network_info=[{"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:30 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:45:30 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:45:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:45:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-889087873',display_name='tempest-ServerActionsTestJSON-server-889087873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-889087873',id=20,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7iIvlhM+wCditCRaonOriLx8WWyehY8kYxTUZ36Z1Q4VGm2JnuefQ18D+1ncnGXJXgbpg/EWHmDPRQFx9TQ2PBQ5aNgSGRUcq/Ovi+zGjOYQDNVYkQyEvsulSNtijWoQ==',key_name='tempest-keypair-165395776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ed4ed4ab2fd4c14b3e2afe343fd7256',ramdisk_id='',reservation_id='r-1656hccc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-2035821517',owner_user_name='tempest-ServerActionsTestJSON-2035821517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:45:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78ccd1a1ec1b486981d850881734fe02',uuid=73cc8ede-babd-4281-bf1d-c5a3f8bad440,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converting VIF {"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d1:94,bridge_name='br-int',has_traffic_filtering=True,id=84d281bf-164e-48f3-a3ee-ca796d9a48e7,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d281bf-16') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG nova.objects.instance [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lazy-loading 'pci_devices' on Instance uuid 73cc8ede-babd-4281-bf1d-c5a3f8bad440 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:45:30 user nova-compute[71498]:   <uuid>73cc8ede-babd-4281-bf1d-c5a3f8bad440</uuid>
Apr 14 01:45:30 user nova-compute[71498]:   <name>instance-00000014</name>
Apr 14 01:45:30 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:45:30 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:45:30 user nova-compute[71498]:   <metadata>
Apr 14 01:45:30 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:45:30 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:45:30 user nova-compute[71498]:       <nova:name>tempest-ServerActionsTestJSON-server-889087873</nova:name>
Apr 14 01:45:30 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:45:30</nova:creationTime>
Apr 14 01:45:30 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:45:30 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:45:30 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:45:30 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:45:30 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:45:30 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:45:30 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:45:30 user nova-compute[71498]:       <nova:owner>
Apr 14 01:45:30 user nova-compute[71498]:         <nova:user uuid="78ccd1a1ec1b486981d850881734fe02">tempest-ServerActionsTestJSON-2035821517-project-member</nova:user>
Apr 14 01:45:30 user nova-compute[71498]:         <nova:project uuid="2ed4ed4ab2fd4c14b3e2afe343fd7256">tempest-ServerActionsTestJSON-2035821517</nova:project>
Apr 14 01:45:30 user nova-compute[71498]:       </nova:owner>
Apr 14 01:45:30 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:45:30 user nova-compute[71498]:       <nova:ports>
Apr 14 01:45:30 user nova-compute[71498]:         <nova:port uuid="84d281bf-164e-48f3-a3ee-ca796d9a48e7">
Apr 14 01:45:30 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 01:45:30 user nova-compute[71498]:         </nova:port>
Apr 14 01:45:30 user nova-compute[71498]:       </nova:ports>
Apr 14 01:45:30 user nova-compute[71498]:     </nova:instance>
Apr 14 01:45:30 user nova-compute[71498]:   </metadata>
Apr 14 01:45:30 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:45:30 user nova-compute[71498]:     <system>
Apr 14 01:45:30 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:45:30 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:45:30 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:45:30 user nova-compute[71498]:       <entry name="serial">73cc8ede-babd-4281-bf1d-c5a3f8bad440</entry>
Apr 14 01:45:30 user nova-compute[71498]:       <entry name="uuid">73cc8ede-babd-4281-bf1d-c5a3f8bad440</entry>
Apr 14 01:45:30 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:45:30 user nova-compute[71498]:     </system>
Apr 14 01:45:30 user nova-compute[71498]:   </sysinfo>
Apr 14 01:45:30 user nova-compute[71498]:   <os>
Apr 14 01:45:30 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:45:30 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:45:30 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:45:30 user nova-compute[71498]:   </os>
Apr 14 01:45:30 user nova-compute[71498]:   <features>
Apr 14 01:45:30 user nova-compute[71498]:     <acpi/>
Apr 14 01:45:30 user nova-compute[71498]:     <apic/>
Apr 14 01:45:30 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:45:30 user nova-compute[71498]:   </features>
Apr 14 01:45:30 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:45:30 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:45:30 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:45:30 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:45:30 user nova-compute[71498]:   </clock>
Apr 14 01:45:30 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:45:30 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:45:30 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:45:30 user nova-compute[71498]:   </cpu>
Apr 14 01:45:30 user nova-compute[71498]:   <devices>
Apr 14 01:45:30 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:45:30 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:45:30 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk"/>
Apr 14 01:45:30 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:45:30 user nova-compute[71498]:     </disk>
Apr 14 01:45:30 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:45:30 user nova-compute[71498]:       <mac address="fa:16:3e:b2:d1:94"/>
Apr 14 01:45:30 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:45:30 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:45:30 user nova-compute[71498]:       <target dev="tap84d281bf-16"/>
Apr 14 01:45:30 user nova-compute[71498]:     </interface>
Apr 14 01:45:30 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:45:30 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/console.log" append="off"/>
Apr 14 01:45:30 user nova-compute[71498]:     </serial>
Apr 14 01:45:30 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:45:30 user nova-compute[71498]:     <video>
Apr 14 01:45:30 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:45:30 user nova-compute[71498]:     </video>
Apr 14 01:45:30 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:45:30 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:45:30 user nova-compute[71498]:     </rng>
Apr 14 01:45:30 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:45:30 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:45:30 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:45:30 user nova-compute[71498]:     </memballoon>
Apr 14 01:45:30 user nova-compute[71498]:   </devices>
Apr 14 01:45:30 user nova-compute[71498]: </domain>
Apr 14 01:45:30 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:45:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-889087873',display_name='tempest-ServerActionsTestJSON-server-889087873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-889087873',id=20,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7iIvlhM+wCditCRaonOriLx8WWyehY8kYxTUZ36Z1Q4VGm2JnuefQ18D+1ncnGXJXgbpg/EWHmDPRQFx9TQ2PBQ5aNgSGRUcq/Ovi+zGjOYQDNVYkQyEvsulSNtijWoQ==',key_name='tempest-keypair-165395776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ed4ed4ab2fd4c14b3e2afe343fd7256',ramdisk_id='',reservation_id='r-1656hccc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-2035821517',owner_user_name='tempest-ServerActionsTestJSON-2035821517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:45:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78ccd1a1ec1b486981d850881734fe02',uuid=73cc8ede-babd-4281-bf1d-c5a3f8bad440,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converting VIF {"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d1:94,bridge_name='br-int',has_traffic_filtering=True,id=84d281bf-164e-48f3-a3ee-ca796d9a48e7,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d281bf-16') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG os_vif [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d1:94,bridge_name='br-int',has_traffic_filtering=True,id=84d281bf-164e-48f3-a3ee-ca796d9a48e7,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d281bf-16') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84d281bf-16, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap84d281bf-16, col_values=(('external_ids', {'iface-id': '84d281bf-164e-48f3-a3ee-ca796d9a48e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:d1:94', 'vm-uuid': '73cc8ede-babd-4281-bf1d-c5a3f8bad440'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:45:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:30 user nova-compute[71498]: INFO os_vif [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d1:94,bridge_name='br-int',has_traffic_filtering=True,id=84d281bf-164e-48f3-a3ee-ca796d9a48e7,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d281bf-16')
Apr 14 01:45:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:45:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] No VIF found with MAC fa:16:3e:b2:d1:94, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:45:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:31 user nova-compute[71498]: DEBUG nova.network.neutron [req-4807c82c-26f3-40cc-87f8-8615af06e68b req-3a11a25b-b59d-4b47-9310-19d34cd7b5c7 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Updated VIF entry in instance network info cache for port 84d281bf-164e-48f3-a3ee-ca796d9a48e7. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:45:31 user nova-compute[71498]: DEBUG nova.network.neutron [req-4807c82c-26f3-40cc-87f8-8615af06e68b req-3a11a25b-b59d-4b47-9310-19d34cd7b5c7 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Updating instance_info_cache with network_info: [{"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:45:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4807c82c-26f3-40cc-87f8-8615af06e68b req-3a11a25b-b59d-4b47-9310-19d34cd7b5c7 service nova] Releasing lock "refresh_cache-73cc8ede-babd-4281-bf1d-c5a3f8bad440" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:45:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f045ae6d-889e-40c0-bd71-9b107dba9a70/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f045ae6d-889e-40c0-bd71-9b107dba9a70/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f045ae6d-889e-40c0-bd71-9b107dba9a70/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f045ae6d-889e-40c0-bd71-9b107dba9a70/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:33 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:45:33 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:45:33 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=7563MB free_disk=26.44976806640625GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 01:45:33 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:33 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:33 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance da60f4f1-2474-453f-8f84-c95daf02431a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:45:33 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:45:33 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:45:33 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance f68784e7-578c-4a12-87d4-f35fbc5a1d59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:45:33 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:45:33 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance f045ae6d-889e-40c0-bd71-9b107dba9a70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:45:33 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:45:33 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:45:33 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance a19a1c08-5454-481b-bb5a-70c39ead9afc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:45:33 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance fa29c144-0ff9-4efb-a574-f521d18f08fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:45:33 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:45:33 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 01:45:33 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 01:45:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:33 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:45:33 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:45:33 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 01:45:33 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.706s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:33 user nova-compute[71498]: DEBUG nova.compute.manager [req-c7ac8e05-a479-491f-83fd-cb4588e533bc req-27a882b5-98c2-441d-a31d-ffa40134f4e3 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Received event network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:45:33 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c7ac8e05-a479-491f-83fd-cb4588e533bc req-27a882b5-98c2-441d-a31d-ffa40134f4e3 service nova] Acquiring lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:33 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c7ac8e05-a479-491f-83fd-cb4588e533bc req-27a882b5-98c2-441d-a31d-ffa40134f4e3 service nova] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:33 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c7ac8e05-a479-491f-83fd-cb4588e533bc req-27a882b5-98c2-441d-a31d-ffa40134f4e3 service nova] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:33 user nova-compute[71498]: DEBUG nova.compute.manager [req-c7ac8e05-a479-491f-83fd-cb4588e533bc req-27a882b5-98c2-441d-a31d-ffa40134f4e3 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] No waiting events found dispatching network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:45:33 user nova-compute[71498]: WARNING nova.compute.manager [req-c7ac8e05-a479-491f-83fd-cb4588e533bc req-27a882b5-98c2-441d-a31d-ffa40134f4e3 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Received unexpected event network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 for instance with vm_state building and task_state spawning.
Apr 14 01:45:34 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:35 user nova-compute[71498]: INFO nova.compute.manager [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Rescuing
Apr 14 01:45:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "refresh_cache-73fd9bc1-af0f-41e9-adea-d73323b4a76c" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:45:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquired lock "refresh_cache-73fd9bc1-af0f-41e9-adea-d73323b4a76c" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:45:35 user nova-compute[71498]: DEBUG nova.network.neutron [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:45:35 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436735.4100049, 73cc8ede-babd-4281-bf1d-c5a3f8bad440 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:45:35 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] VM Resumed (Lifecycle Event)
Apr 14 01:45:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:45:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:45:35 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Instance spawned successfully.
Apr 14 01:45:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:45:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:45:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:45:35 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:45:35 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436735.4133692, 73cc8ede-babd-4281-bf1d-c5a3f8bad440 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:45:35 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] VM Started (Lifecycle Event)
Apr 14 01:45:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:45:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:45:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:45:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:45:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:45:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:45:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:45:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:45:35 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:45:35 user nova-compute[71498]: INFO nova.compute.manager [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Took 7.72 seconds to spawn the instance on the hypervisor.
Apr 14 01:45:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:45:35 user nova-compute[71498]: INFO nova.compute.manager [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Took 8.75 seconds to build instance.
Apr 14 01:45:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9178923a-1f4c-43a3-b2d7-ac8eb078d74a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.849s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:35 user nova-compute[71498]: DEBUG nova.network.neutron [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Updating instance_info_cache with network_info: [{"id": "4146457e-4b16-4c22-afd2-ffae8a58c0c5", "address": "fa:16:3e:4c:4f:e1", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4146457e-4b", "ovs_interfaceid": "4146457e-4b16-4c22-afd2-ffae8a58c0c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:45:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Releasing lock "refresh_cache-73fd9bc1-af0f-41e9-adea-d73323b4a76c" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:45:36 user nova-compute[71498]: DEBUG nova.compute.manager [req-e6f827db-7c4b-4b36-b445-2a7f8e4fcf9d req-c3437e7b-44c1-46f2-aaa5-411999e3efc4 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Received event network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:45:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e6f827db-7c4b-4b36-b445-2a7f8e4fcf9d req-c3437e7b-44c1-46f2-aaa5-411999e3efc4 service nova] Acquiring lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e6f827db-7c4b-4b36-b445-2a7f8e4fcf9d req-c3437e7b-44c1-46f2-aaa5-411999e3efc4 service nova] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e6f827db-7c4b-4b36-b445-2a7f8e4fcf9d req-c3437e7b-44c1-46f2-aaa5-411999e3efc4 service nova] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:36 user nova-compute[71498]: DEBUG nova.compute.manager [req-e6f827db-7c4b-4b36-b445-2a7f8e4fcf9d req-c3437e7b-44c1-46f2-aaa5-411999e3efc4 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] No waiting events found dispatching network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:45:36 user nova-compute[71498]: WARNING nova.compute.manager [req-e6f827db-7c4b-4b36-b445-2a7f8e4fcf9d req-c3437e7b-44c1-46f2-aaa5-411999e3efc4 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Received unexpected event network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 for instance with vm_state active and task_state None.
Apr 14 01:45:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:36 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Instance destroyed successfully.
Apr 14 01:45:36 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Attempting a stable device rescue
Apr 14 01:45:36 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:45:36 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:45:36 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 01:45:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71498) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 01:45:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Instance directory exists: not creating {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 01:45:36 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Creating image(s)
Apr 14 01:45:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "/opt/stack/data/nova/instances/73fd9bc1-af0f-41e9-adea-d73323b4a76c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "/opt/stack/data/nova/instances/73fd9bc1-af0f-41e9-adea-d73323b4a76c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "/opt/stack/data/nova/instances/73fd9bc1-af0f-41e9-adea-d73323b4a76c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:36 user nova-compute[71498]: DEBUG nova.objects.instance [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lazy-loading 'trusted_certs' on Instance uuid 73fd9bc1-af0f-41e9-adea-d73323b4a76c {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:45:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "185d0af0a4fc3ecdcd6252deaf13b6b7d8f5eb85" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "185d0af0a4fc3ecdcd6252deaf13b6b7d8f5eb85" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:36 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Didn't find any instances for network info cache update. {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 01:45:36 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:45:36 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:45:36 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:45:36 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:45:36 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:45:36 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 01:45:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/185d0af0a4fc3ecdcd6252deaf13b6b7d8f5eb85.part --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:37 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:45:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/185d0af0a4fc3ecdcd6252deaf13b6b7d8f5eb85.part --force-share --output=json" returned: 0 in 0.153s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:37 user nova-compute[71498]: DEBUG nova.virt.images [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] a22ab818-1e7f-46f7-9e78-f64813b0fbd6 was qcow2, converting to raw {{(pid=71498) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 01:45:37 user nova-compute[71498]: DEBUG nova.privsep.utils [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71498) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 01:45:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/185d0af0a4fc3ecdcd6252deaf13b6b7d8f5eb85.part /opt/stack/data/nova/instances/_base/185d0af0a4fc3ecdcd6252deaf13b6b7d8f5eb85.converted {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/185d0af0a4fc3ecdcd6252deaf13b6b7d8f5eb85.part /opt/stack/data/nova/instances/_base/185d0af0a4fc3ecdcd6252deaf13b6b7d8f5eb85.converted" returned: 0 in 0.133s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/185d0af0a4fc3ecdcd6252deaf13b6b7d8f5eb85.converted --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/185d0af0a4fc3ecdcd6252deaf13b6b7d8f5eb85.converted --force-share --output=json" returned: 0 in 0.137s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "185d0af0a4fc3ecdcd6252deaf13b6b7d8f5eb85" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.156s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "185d0af0a4fc3ecdcd6252deaf13b6b7d8f5eb85" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "185d0af0a4fc3ecdcd6252deaf13b6b7d8f5eb85" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/185d0af0a4fc3ecdcd6252deaf13b6b7d8f5eb85 --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG nova.compute.manager [req-8904927c-74f2-4878-be16-72f9e9702405 req-541dc4b1-7b7c-48e8-8b6e-495a971e4271 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Received event network-vif-unplugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8904927c-74f2-4878-be16-72f9e9702405 req-541dc4b1-7b7c-48e8-8b6e-495a971e4271 service nova] Acquiring lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8904927c-74f2-4878-be16-72f9e9702405 req-541dc4b1-7b7c-48e8-8b6e-495a971e4271 service nova] Lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8904927c-74f2-4878-be16-72f9e9702405 req-541dc4b1-7b7c-48e8-8b6e-495a971e4271 service nova] Lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG nova.compute.manager [req-8904927c-74f2-4878-be16-72f9e9702405 req-541dc4b1-7b7c-48e8-8b6e-495a971e4271 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] No waiting events found dispatching network-vif-unplugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:45:38 user nova-compute[71498]: WARNING nova.compute.manager [req-8904927c-74f2-4878-be16-72f9e9702405 req-541dc4b1-7b7c-48e8-8b6e-495a971e4271 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Received unexpected event network-vif-unplugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 for instance with vm_state active and task_state rescuing.
Apr 14 01:45:38 user nova-compute[71498]: DEBUG nova.compute.manager [req-8904927c-74f2-4878-be16-72f9e9702405 req-541dc4b1-7b7c-48e8-8b6e-495a971e4271 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Received event network-vif-plugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8904927c-74f2-4878-be16-72f9e9702405 req-541dc4b1-7b7c-48e8-8b6e-495a971e4271 service nova] Acquiring lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8904927c-74f2-4878-be16-72f9e9702405 req-541dc4b1-7b7c-48e8-8b6e-495a971e4271 service nova] Lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8904927c-74f2-4878-be16-72f9e9702405 req-541dc4b1-7b7c-48e8-8b6e-495a971e4271 service nova] Lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG nova.compute.manager [req-8904927c-74f2-4878-be16-72f9e9702405 req-541dc4b1-7b7c-48e8-8b6e-495a971e4271 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] No waiting events found dispatching network-vif-plugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:45:38 user nova-compute[71498]: WARNING nova.compute.manager [req-8904927c-74f2-4878-be16-72f9e9702405 req-541dc4b1-7b7c-48e8-8b6e-495a971e4271 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Received unexpected event network-vif-plugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 for instance with vm_state active and task_state rescuing.
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/185d0af0a4fc3ecdcd6252deaf13b6b7d8f5eb85 --force-share --output=json" returned: 0 in 0.141s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/185d0af0a4fc3ecdcd6252deaf13b6b7d8f5eb85,backing_fmt=raw /opt/stack/data/nova/instances/73fd9bc1-af0f-41e9-adea-d73323b4a76c/disk.rescue {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/185d0af0a4fc3ecdcd6252deaf13b6b7d8f5eb85,backing_fmt=raw /opt/stack/data/nova/instances/73fd9bc1-af0f-41e9-adea-d73323b4a76c/disk.rescue" returned: 0 in 0.049s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "185d0af0a4fc3ecdcd6252deaf13b6b7d8f5eb85" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG nova.objects.instance [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lazy-loading 'migration_context' on Instance uuid 73fd9bc1-af0f-41e9-adea-d73323b4a76c {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Start _get_guest_xml network_info=[{"id": "4146457e-4b16-4c22-afd2-ffae8a58c0c5", "address": "fa:16:3e:4c:4f:e1", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "vif_mac": "fa:16:3e:4c:4f:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4146457e-4b", "ovs_interfaceid": "4146457e-4b16-4c22-afd2-ffae8a58c0c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a22ab818-1e7f-46f7-9e78-f64813b0fbd6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ae1038cb-9890-4797-aade-3705c75e2976', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hCwSrpEd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '73fd9bc1-af0f-41e9-adea-d73323b4a76c', 'attached_at': '', 'detached_at': '', 'volume_id': '0856ebd5-320b-4f5a-b305-4b1a0be6fb22', 'serial': '0856ebd5-320b-4f5a-b305-4b1a0be6fb22'}, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG nova.objects.instance [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lazy-loading 'resources' on Instance uuid 73fd9bc1-af0f-41e9-adea-d73323b4a76c {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG nova.objects.instance [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lazy-loading 'numa_topology' on Instance uuid 73fd9bc1-af0f-41e9-adea-d73323b4a76c {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:45:38 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:45:38 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:45:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG nova.objects.instance [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lazy-loading 'vcpu_model' on Instance uuid 73fd9bc1-af0f-41e9-adea-d73323b4a76c {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hCwSrpEd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:45:38 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:45:38 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:45:38 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:45:38 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:45:38 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b20495e-ffbd-4678-b070-901a89ebc35f]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = hCwSrpEd\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 14 01:45:38 user nova-compute[71498]: node.name = iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22
Apr 14 01:45:38 user nova-compute[71498]: node.tpgt = -1
Apr 14 01:45:38 user nova-compute[71498]: node.startup = automatic
Apr 14 01:45:38 user nova-compute[71498]: node.leading_login = No
Apr 14 01:45:38 user nova-compute[71498]: iface.iscsi_ifacename = default
Apr 14 01:45:38 user nova-compute[71498]: iface.net_ifacename = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.ipaddress = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.prefix_len = 0
Apr 14 01:45:38 user nova-compute[71498]: iface.hwaddress = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.transport_name = tcp
Apr 14 01:45:38 user nova-compute[71498]: iface.initiatorname = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.state = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.vlan_id = 0
Apr 14 01:45:38 user nova-compute[71498]: iface.vlan_priority = 0
Apr 14 01:45:38 user nova-compute[71498]: iface.vlan_state = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.iface_num = 0
Apr 14 01:45:38 user nova-compute[71498]: iface.mtu = 0
Apr 14 01:45:38 user nova-compute[71498]: iface.port = 0
Apr 14 01:45:38 user nova-compute[71498]: iface.bootproto = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.subnet_mask = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.gateway = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.dhcp_alt_client_id_state = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.dhcp_alt_client_id = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.dhcp_dns = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.dhcp_learn_iqn = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.dhcp_req_vendor_id_state = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.dhcp_vendor_id_state = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.dhcp_vendor_id = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.dhcp_slp_da = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.fragmentation = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.gratuitous_arp = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.incoming_forwarding = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.tos_state = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.tos = 0
Apr 14 01:45:38 user nova-compute[71498]: iface.ttl = 0
Apr 14 01:45:38 user nova-compute[71498]: iface.delayed_ack = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.tcp_nagle = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.tcp_wsf_state = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.tcp_wsf = 0
Apr 14 01:45:38 user nova-compute[71498]: iface.tcp_timer_scale = 0
Apr 14 01:45:38 user nova-compute[71498]: iface.tcp_timestamp = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.redirect = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.def_task_mgmt_timeout = 0
Apr 14 01:45:38 user nova-compute[71498]: iface.header_digest = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.data_digest = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.immediate_data = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.initial_r2t = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.data_seq_inorder = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.data_pdu_inorder = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.erl = 0
Apr 14 01:45:38 user nova-compute[71498]: iface.max_receive_data_len = 0
Apr 14 01:45:38 user nova-compute[71498]: iface.first_burst_len = 0
Apr 14 01:45:38 user nova-compute[71498]: iface.max_outstanding_r2t = 0
Apr 14 01:45:38 user nova-compute[71498]: iface.max_burst_len = 0
Apr 14 01:45:38 user nova-compute[71498]: iface.chap_auth = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.bidi_chap = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.strict_login_compliance = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.discovery_auth = <empty>
Apr 14 01:45:38 user nova-compute[71498]: iface.discovery_logout = <empty>
Apr 14 01:45:38 user nova-compute[71498]: node.discovery_address = <empty>
Apr 14 01:45:38 user nova-compute[71498]: node.discovery_port = 0
Apr 14 01:45:38 user nova-compute[71498]: node.discovery_type = static
Apr 14 01:45:38 user nova-compute[71498]: node.session.initial_cmdsn = 0
Apr 14 01:45:38 user nova-compute[71498]: node.session.initial_login_retry_max = 8
Apr 14 01:45:38 user nova-compute[71498]: node.session.xmit_thread_priority = -20
Apr 14 01:45:38 user nova-compute[71498]: node.session.cmds_max = 128
Apr 14 01:45:38 user nova-compute[71498]: node.session.queue_depth = 32
Apr 14 01:45:38 user nova-compute[71498]: node.session.nr_sessions = 1
Apr 14 01:45:38 user nova-compute[71498]: node.session.auth.authmethod = CHAP
Apr 14 01:45:38 user nova-compute[71498]: node.session.auth.username = hCwSrpEd
Apr 14 01:45:38 user nova-compute[71498]: node.session.auth.password = ***
Apr 14 01:45:38 user nova-compute[71498]: node.session.auth.username_in = <empty>
Apr 14 01:45:38 user nova-compute[71498]: node.session.auth.password_in = <empty>
Apr 14 01:45:38 user nova-compute[71498]: node.session.auth.chap_algs = MD5
Apr 14 01:45:38 user nova-compute[71498]: node.session.timeo.replacement_timeout = 120
Apr 14 01:45:38 user nova-compute[71498]: node.session.err_timeo.abort_timeout = 15
Apr 14 01:45:38 user nova-compute[71498]: node.session.err_timeo.lu_reset_timeout = 30
Apr 14 01:45:38 user nova-compute[71498]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 14 01:45:38 user nova-compute[71498]: node.session.err_timeo.host_reset_timeout = 60
Apr 14 01:45:38 user nova-compute[71498]: node.session.iscsi.FastAbort = Yes
Apr 14 01:45:38 user nova-compute[71498]: node.session.iscsi.InitialR2T = No
Apr 14 01:45:38 user nova-compute[71498]: node.session.iscsi.ImmediateData = Yes
Apr 14 01:45:38 user nova-compute[71498]: node.session.iscsi.FirstBurstLength = 262144
Apr 14 01:45:38 user nova-compute[71498]: node.session.iscsi.MaxBurstLength = 16776192
Apr 14 01:45:38 user nova-compute[71498]: node.session.iscsi.DefaultTime2Retain = 0
Apr 14 01:45:38 user nova-compute[71498]: node.session.iscsi.DefaultTime2Wait = 2
Apr 14 01:45:38 user nova-compute[71498]: node.session.iscsi.MaxConnections = 1
Apr 14 01:45:38 user nova-compute[71498]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 14 01:45:38 user nova-compute[71498]: node.session.iscsi.ERL = 0
Apr 14 01:45:38 user nova-compute[71498]: node.session.scan = manual
Apr 14 01:45:38 user nova-compute[71498]: node.session.reopen_max = 0
Apr 14 01:45:38 user nova-compute[71498]: node.conn[0].address = 172.16.0.220
Apr 14 01:45:38 user nova-compute[71498]: node.conn[0].port = 3260
Apr 14 01:45:38 user nova-compute[71498]: node.conn[0].startup = manual
Apr 14 01:45:38 user nova-compute[71498]: node.conn[0].tcp.window_size = 524288
Apr 14 01:45:38 user nova-compute[71498]: node.conn[0].tcp.type_of_service = 0
Apr 14 01:45:38 user nova-compute[71498]: node.conn[0].timeo.logout_timeout = 15
Apr 14 01:45:38 user nova-compute[71498]: node.conn[0].timeo.login_timeout = 15
Apr 14 01:45:38 user nova-compute[71498]: node.conn[0].timeo.auth_timeout = 45
Apr 14 01:45:38 user nova-compute[71498]: node.conn[0].timeo.noop_out_interval = 5
Apr 14 01:45:38 user nova-compute[71498]: node.conn[0].timeo.noop_out_timeout = 5
Apr 14 01:45:38 user nova-compute[71498]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 14 01:45:38 user nova-compute[71498]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 14 01:45:38 user nova-compute[71498]: node.conn[0].iscsi.HeaderDigest = None
Apr 14 01:45:38 user nova-compute[71498]: node.conn[0].iscsi.DataDigest = None
Apr 14 01:45:38 user nova-compute[71498]: node.conn[0].iscsi.IFMarker = No
Apr 14 01:45:38 user nova-compute[71498]: node.conn[0].iscsi.OFMarker = No
Apr 14 01:45:38 user nova-compute[71498]: # END RECORD
Apr 14 01:45:38 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.105s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e020a27-598a-493d-9664-1a9ca2167961]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df104c5-9d3f-4378-8871-7db454e4e634]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hCwSrpEd {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hCwSrpEd" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4882df8c-5e0c-4a5b-91d8-71317281cd86]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hCwSrpEd'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc40b31a-85e8-47b1-b047-f20117d69767]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5dcf622-ed30-4705-89e4-0afb90981da9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:45:38 user nova-compute[71498]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)
Apr 14 01:45:38 user nova-compute[71498]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d (non-flash)
Apr 14 01:45:38 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:45:38 user nova-compute[71498]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)
Apr 14 01:45:38 user nova-compute[71498]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d (non-flash)
Apr 14 01:45:38 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] HCTL ('33', '0', '0', 0) found on session 13 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3771e4ca-255e-458f-a2fe-02a21c23b22d]: (4, ('0 0 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Searching for a device in session 13 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hCwSrpEd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.271s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] <== connect_volume: return (274ms) {'type': 'block', 'scsi_wwn': '23539636265343736', 'path': '/dev/sdb'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539636265343736', 'path': '/dev/sdb'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:43:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2126586208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2126586208',id=14,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:44:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='219c39c8299e46368012a947fdfbe5fd',ramdisk_id='',reservation_id='r-vg1kmosh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-85797606',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:44:00Z,user_data=None,user_id='7ed01a83531f4c6bb18a4593284baf05',uuid=73fd9bc1-af0f-41e9-adea-d73323b4a76c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4146457e-4b16-4c22-afd2-ffae8a58c0c5", "address": "fa:16:3e:4c:4f:e1", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "vif_mac": "fa:16:3e:4c:4f:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4146457e-4b", "ovs_interfaceid": "4146457e-4b16-4c22-afd2-ffae8a58c0c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Converting VIF {"id": "4146457e-4b16-4c22-afd2-ffae8a58c0c5", "address": "fa:16:3e:4c:4f:e1", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "vif_mac": "fa:16:3e:4c:4f:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4146457e-4b", "ovs_interfaceid": "4146457e-4b16-4c22-afd2-ffae8a58c0c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:4f:e1,bridge_name='br-int',has_traffic_filtering=True,id=4146457e-4b16-4c22-afd2-ffae8a58c0c5,network=Network(365cbeec-3756-4258-a135-04112bdda4b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4146457e-4b') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG nova.objects.instance [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lazy-loading 'pci_devices' on Instance uuid 73fd9bc1-af0f-41e9-adea-d73323b4a76c {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:45:38 user nova-compute[71498]:   <uuid>73fd9bc1-af0f-41e9-adea-d73323b4a76c</uuid>
Apr 14 01:45:38 user nova-compute[71498]:   <name>instance-0000000e</name>
Apr 14 01:45:38 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:45:38 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:45:38 user nova-compute[71498]:   <metadata>
Apr 14 01:45:38 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:45:38 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:45:38 user nova-compute[71498]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2126586208</nova:name>
Apr 14 01:45:38 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:45:38</nova:creationTime>
Apr 14 01:45:38 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:45:38 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:45:38 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:45:38 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:45:38 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:45:38 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:45:38 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:45:38 user nova-compute[71498]:       <nova:owner>
Apr 14 01:45:38 user nova-compute[71498]:         <nova:user uuid="7ed01a83531f4c6bb18a4593284baf05">tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member</nova:user>
Apr 14 01:45:38 user nova-compute[71498]:         <nova:project uuid="219c39c8299e46368012a947fdfbe5fd">tempest-ServerBootFromVolumeStableRescueTest-85797606</nova:project>
Apr 14 01:45:38 user nova-compute[71498]:       </nova:owner>
Apr 14 01:45:38 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:45:38 user nova-compute[71498]:       <nova:ports>
Apr 14 01:45:38 user nova-compute[71498]:         <nova:port uuid="4146457e-4b16-4c22-afd2-ffae8a58c0c5">
Apr 14 01:45:38 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 01:45:38 user nova-compute[71498]:         </nova:port>
Apr 14 01:45:38 user nova-compute[71498]:       </nova:ports>
Apr 14 01:45:38 user nova-compute[71498]:     </nova:instance>
Apr 14 01:45:38 user nova-compute[71498]:   </metadata>
Apr 14 01:45:38 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:45:38 user nova-compute[71498]:     <system>
Apr 14 01:45:38 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:45:38 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:45:38 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:45:38 user nova-compute[71498]:       <entry name="serial">73fd9bc1-af0f-41e9-adea-d73323b4a76c</entry>
Apr 14 01:45:38 user nova-compute[71498]:       <entry name="uuid">73fd9bc1-af0f-41e9-adea-d73323b4a76c</entry>
Apr 14 01:45:38 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:45:38 user nova-compute[71498]:     </system>
Apr 14 01:45:38 user nova-compute[71498]:   </sysinfo>
Apr 14 01:45:38 user nova-compute[71498]:   <os>
Apr 14 01:45:38 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:45:38 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:45:38 user nova-compute[71498]:   </os>
Apr 14 01:45:38 user nova-compute[71498]:   <features>
Apr 14 01:45:38 user nova-compute[71498]:     <acpi/>
Apr 14 01:45:38 user nova-compute[71498]:     <apic/>
Apr 14 01:45:38 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:45:38 user nova-compute[71498]:   </features>
Apr 14 01:45:38 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:45:38 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:45:38 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:45:38 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:45:38 user nova-compute[71498]:   </clock>
Apr 14 01:45:38 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:45:38 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:45:38 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:45:38 user nova-compute[71498]:   </cpu>
Apr 14 01:45:38 user nova-compute[71498]:   <devices>
Apr 14 01:45:38 user nova-compute[71498]:     <disk type="block" device="disk">
Apr 14 01:45:38 user nova-compute[71498]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:45:38 user nova-compute[71498]:       <source dev="/dev/sdb"/>
Apr 14 01:45:38 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:45:38 user nova-compute[71498]:       <serial>0856ebd5-320b-4f5a-b305-4b1a0be6fb22</serial>
Apr 14 01:45:38 user nova-compute[71498]:     </disk>
Apr 14 01:45:38 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:45:38 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:45:38 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/73fd9bc1-af0f-41e9-adea-d73323b4a76c/disk.rescue"/>
Apr 14 01:45:38 user nova-compute[71498]:       <target dev="vdb" bus="virtio"/>
Apr 14 01:45:38 user nova-compute[71498]:       <boot order="1"/>
Apr 14 01:45:38 user nova-compute[71498]:     </disk>
Apr 14 01:45:38 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:45:38 user nova-compute[71498]:       <mac address="fa:16:3e:4c:4f:e1"/>
Apr 14 01:45:38 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:45:38 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:45:38 user nova-compute[71498]:       <target dev="tap4146457e-4b"/>
Apr 14 01:45:38 user nova-compute[71498]:     </interface>
Apr 14 01:45:38 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:45:38 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/73fd9bc1-af0f-41e9-adea-d73323b4a76c/console.log" append="off"/>
Apr 14 01:45:38 user nova-compute[71498]:     </serial>
Apr 14 01:45:38 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:45:38 user nova-compute[71498]:     <video>
Apr 14 01:45:38 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:45:38 user nova-compute[71498]:     </video>
Apr 14 01:45:38 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:45:38 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:45:38 user nova-compute[71498]:     </rng>
Apr 14 01:45:38 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:45:38 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:45:38 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:45:38 user nova-compute[71498]:     </memballoon>
Apr 14 01:45:38 user nova-compute[71498]:   </devices>
Apr 14 01:45:38 user nova-compute[71498]: </domain>
Apr 14 01:45:38 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:45:38 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Instance destroyed successfully.
Apr 14 01:45:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:45:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] No VIF found with MAC fa:16:3e:4c:4f:e1, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:45:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-93241f2b-8ca7-480a-935f-b7941f7f8909 req-02fb7cea-dd34-4cc9-823c-5ef756297ae9 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Received event network-vif-plugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:45:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-93241f2b-8ca7-480a-935f-b7941f7f8909 req-02fb7cea-dd34-4cc9-823c-5ef756297ae9 service nova] Acquiring lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-93241f2b-8ca7-480a-935f-b7941f7f8909 req-02fb7cea-dd34-4cc9-823c-5ef756297ae9 service nova] Lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-93241f2b-8ca7-480a-935f-b7941f7f8909 req-02fb7cea-dd34-4cc9-823c-5ef756297ae9 service nova] Lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-93241f2b-8ca7-480a-935f-b7941f7f8909 req-02fb7cea-dd34-4cc9-823c-5ef756297ae9 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] No waiting events found dispatching network-vif-plugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:45:40 user nova-compute[71498]: WARNING nova.compute.manager [req-93241f2b-8ca7-480a-935f-b7941f7f8909 req-02fb7cea-dd34-4cc9-823c-5ef756297ae9 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Received unexpected event network-vif-plugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 for instance with vm_state active and task_state rescuing.
Apr 14 01:45:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Removed pending event for 73fd9bc1-af0f-41e9-adea-d73323b4a76c due to event {{(pid=71498) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 01:45:42 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436742.5108063, 73fd9bc1-af0f-41e9-adea-d73323b4a76c => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:45:42 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] VM Resumed (Lifecycle Event)
Apr 14 01:45:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-5e541bd4-8bde-4e20-8f43-1b8c60f08908 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:45:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:45:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:45:42 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 01:45:42 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436742.515396, 73fd9bc1-af0f-41e9-adea-d73323b4a76c => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:45:42 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] VM Started (Lifecycle Event)
Apr 14 01:45:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:45:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:45:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-a06d68bc-ee4d-4fd9-a1b7-b430171e120e req-9a9ebd68-bf47-438b-838a-082820d64455 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Received event network-vif-plugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:45:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a06d68bc-ee4d-4fd9-a1b7-b430171e120e req-9a9ebd68-bf47-438b-838a-082820d64455 service nova] Acquiring lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a06d68bc-ee4d-4fd9-a1b7-b430171e120e req-9a9ebd68-bf47-438b-838a-082820d64455 service nova] Lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a06d68bc-ee4d-4fd9-a1b7-b430171e120e req-9a9ebd68-bf47-438b-838a-082820d64455 service nova] Lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-a06d68bc-ee4d-4fd9-a1b7-b430171e120e req-9a9ebd68-bf47-438b-838a-082820d64455 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] No waiting events found dispatching network-vif-plugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:45:42 user nova-compute[71498]: WARNING nova.compute.manager [req-a06d68bc-ee4d-4fd9-a1b7-b430171e120e req-9a9ebd68-bf47-438b-838a-082820d64455 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Received unexpected event network-vif-plugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 for instance with vm_state rescued and task_state None.
Apr 14 01:45:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:45 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:46 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "74311da6-d6b8-4aea-b6ce-97db8da53800" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:46 user nova-compute[71498]: DEBUG nova.compute.manager [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 01:45:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:46 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:45:46 user nova-compute[71498]: INFO nova.compute.claims [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Claim successful on node user
Apr 14 01:45:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:47 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:45:47 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:45:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.564s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:47 user nova-compute[71498]: DEBUG nova.compute.manager [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 01:45:47 user nova-compute[71498]: DEBUG nova.compute.manager [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 01:45:47 user nova-compute[71498]: DEBUG nova.network.neutron [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:45:47 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 01:45:47 user nova-compute[71498]: DEBUG nova.compute.manager [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 01:45:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:47 user nova-compute[71498]: DEBUG nova.compute.manager [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 01:45:47 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:45:47 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Creating image(s)
Apr 14 01:45:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "/opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "/opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "/opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:47 user nova-compute[71498]: DEBUG nova.policy [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '34e25e45353e40b9a8bb14736c03fdeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740488dbb5114fb2b38be20f8ce4adb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:45:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.219s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.173s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/disk 1073741824" returned: 0 in 0.050s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.147s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:48 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Checking if we can resize image /opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 01:45:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:48 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Cannot resize image /opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 01:45:48 user nova-compute[71498]: DEBUG nova.objects.instance [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lazy-loading 'migration_context' on Instance uuid 74311da6-d6b8-4aea-b6ce-97db8da53800 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:45:48 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 01:45:48 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Ensure instance console log exists: /opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:45:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:48 user nova-compute[71498]: DEBUG nova.network.neutron [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Successfully created port: 20a227b0-3b4d-4df0-b583-071771a0ae44 {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:45:49 user nova-compute[71498]: DEBUG nova.network.neutron [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Successfully updated port: 20a227b0-3b4d-4df0-b583-071771a0ae44 {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:45:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "refresh_cache-74311da6-d6b8-4aea-b6ce-97db8da53800" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:45:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquired lock "refresh_cache-74311da6-d6b8-4aea-b6ce-97db8da53800" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:45:49 user nova-compute[71498]: DEBUG nova.network.neutron [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:45:49 user nova-compute[71498]: DEBUG nova.compute.manager [req-491eeb17-8481-4847-9b2b-0b3f94d15289 req-b30265b0-bb4c-4e55-9d52-c9049d723f5f service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Received event network-changed-20a227b0-3b4d-4df0-b583-071771a0ae44 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:45:49 user nova-compute[71498]: DEBUG nova.compute.manager [req-491eeb17-8481-4847-9b2b-0b3f94d15289 req-b30265b0-bb4c-4e55-9d52-c9049d723f5f service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Refreshing instance network info cache due to event network-changed-20a227b0-3b4d-4df0-b583-071771a0ae44. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:45:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-491eeb17-8481-4847-9b2b-0b3f94d15289 req-b30265b0-bb4c-4e55-9d52-c9049d723f5f service nova] Acquiring lock "refresh_cache-74311da6-d6b8-4aea-b6ce-97db8da53800" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:45:49 user nova-compute[71498]: DEBUG nova.network.neutron [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG nova.network.neutron [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Updating instance_info_cache with network_info: [{"id": "20a227b0-3b4d-4df0-b583-071771a0ae44", "address": "fa:16:3e:c7:d7:5e", "network": {"id": "31f4b7e9-13bd-4aca-b6c3-a283c637ed63", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-802021657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "740488dbb5114fb2b38be20f8ce4adb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a227b0-3b", "ovs_interfaceid": "20a227b0-3b4d-4df0-b583-071771a0ae44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Releasing lock "refresh_cache-74311da6-d6b8-4aea-b6ce-97db8da53800" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG nova.compute.manager [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Instance network_info: |[{"id": "20a227b0-3b4d-4df0-b583-071771a0ae44", "address": "fa:16:3e:c7:d7:5e", "network": {"id": "31f4b7e9-13bd-4aca-b6c3-a283c637ed63", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-802021657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "740488dbb5114fb2b38be20f8ce4adb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a227b0-3b", "ovs_interfaceid": "20a227b0-3b4d-4df0-b583-071771a0ae44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-491eeb17-8481-4847-9b2b-0b3f94d15289 req-b30265b0-bb4c-4e55-9d52-c9049d723f5f service nova] Acquired lock "refresh_cache-74311da6-d6b8-4aea-b6ce-97db8da53800" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG nova.network.neutron [req-491eeb17-8481-4847-9b2b-0b3f94d15289 req-b30265b0-bb4c-4e55-9d52-c9049d723f5f service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Refreshing network info cache for port 20a227b0-3b4d-4df0-b583-071771a0ae44 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Start _get_guest_xml network_info=[{"id": "20a227b0-3b4d-4df0-b583-071771a0ae44", "address": "fa:16:3e:c7:d7:5e", "network": {"id": "31f4b7e9-13bd-4aca-b6c3-a283c637ed63", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-802021657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "740488dbb5114fb2b38be20f8ce4adb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a227b0-3b", "ovs_interfaceid": "20a227b0-3b4d-4df0-b583-071771a0ae44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:45:50 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:45:50 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:45:50 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:45:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-155633687',display_name='tempest-SnapshotDataIntegrityTests-server-155633687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-155633687',id=21,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFi1cj7WQkCRTINMDBTK4eWsn4iPECgZryQ4AqN8ZjRlsgtGzjrzAzp3MVZJ+8jfj3WNZWSvuGDFxF6nqqS8dsafPBU9+OLArIsc7EEDH73hlPbPglpvFtiACHZGMdbsdA==',key_name='tempest-SnapshotDataIntegrityTests-465819654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='740488dbb5114fb2b38be20f8ce4adb0',ramdisk_id='',reservation_id='r-vzv7i33g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-919714320',owner_user_name='tempest-SnapshotDataIntegrityTests-919714320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:45:48Z,user_data=None,user_id='34e25e45353e40b9a8bb14736c03fdeb',uuid=74311da6-d6b8-4aea-b6ce-97db8da53800,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20a227b0-3b4d-4df0-b583-071771a0ae44", "address": "fa:16:3e:c7:d7:5e", "network": {"id": "31f4b7e9-13bd-4aca-b6c3-a283c637ed63", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-802021657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "740488dbb5114fb2b38be20f8ce4adb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a227b0-3b", "ovs_interfaceid": "20a227b0-3b4d-4df0-b583-071771a0ae44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Converting VIF {"id": "20a227b0-3b4d-4df0-b583-071771a0ae44", "address": "fa:16:3e:c7:d7:5e", "network": {"id": "31f4b7e9-13bd-4aca-b6c3-a283c637ed63", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-802021657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "740488dbb5114fb2b38be20f8ce4adb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a227b0-3b", "ovs_interfaceid": "20a227b0-3b4d-4df0-b583-071771a0ae44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:d7:5e,bridge_name='br-int',has_traffic_filtering=True,id=20a227b0-3b4d-4df0-b583-071771a0ae44,network=Network(31f4b7e9-13bd-4aca-b6c3-a283c637ed63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20a227b0-3b') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG nova.objects.instance [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lazy-loading 'pci_devices' on Instance uuid 74311da6-d6b8-4aea-b6ce-97db8da53800 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:45:50 user nova-compute[71498]:   <uuid>74311da6-d6b8-4aea-b6ce-97db8da53800</uuid>
Apr 14 01:45:50 user nova-compute[71498]:   <name>instance-00000015</name>
Apr 14 01:45:50 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:45:50 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:45:50 user nova-compute[71498]:   <metadata>
Apr 14 01:45:50 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:45:50 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:45:50 user nova-compute[71498]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-155633687</nova:name>
Apr 14 01:45:50 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:45:50</nova:creationTime>
Apr 14 01:45:50 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:45:50 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:45:50 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:45:50 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:45:50 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:45:50 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:45:50 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:45:50 user nova-compute[71498]:       <nova:owner>
Apr 14 01:45:50 user nova-compute[71498]:         <nova:user uuid="34e25e45353e40b9a8bb14736c03fdeb">tempest-SnapshotDataIntegrityTests-919714320-project-member</nova:user>
Apr 14 01:45:50 user nova-compute[71498]:         <nova:project uuid="740488dbb5114fb2b38be20f8ce4adb0">tempest-SnapshotDataIntegrityTests-919714320</nova:project>
Apr 14 01:45:50 user nova-compute[71498]:       </nova:owner>
Apr 14 01:45:50 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:45:50 user nova-compute[71498]:       <nova:ports>
Apr 14 01:45:50 user nova-compute[71498]:         <nova:port uuid="20a227b0-3b4d-4df0-b583-071771a0ae44">
Apr 14 01:45:50 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 01:45:50 user nova-compute[71498]:         </nova:port>
Apr 14 01:45:50 user nova-compute[71498]:       </nova:ports>
Apr 14 01:45:50 user nova-compute[71498]:     </nova:instance>
Apr 14 01:45:50 user nova-compute[71498]:   </metadata>
Apr 14 01:45:50 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:45:50 user nova-compute[71498]:     <system>
Apr 14 01:45:50 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:45:50 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:45:50 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:45:50 user nova-compute[71498]:       <entry name="serial">74311da6-d6b8-4aea-b6ce-97db8da53800</entry>
Apr 14 01:45:50 user nova-compute[71498]:       <entry name="uuid">74311da6-d6b8-4aea-b6ce-97db8da53800</entry>
Apr 14 01:45:50 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:45:50 user nova-compute[71498]:     </system>
Apr 14 01:45:50 user nova-compute[71498]:   </sysinfo>
Apr 14 01:45:50 user nova-compute[71498]:   <os>
Apr 14 01:45:50 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:45:50 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:45:50 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:45:50 user nova-compute[71498]:   </os>
Apr 14 01:45:50 user nova-compute[71498]:   <features>
Apr 14 01:45:50 user nova-compute[71498]:     <acpi/>
Apr 14 01:45:50 user nova-compute[71498]:     <apic/>
Apr 14 01:45:50 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:45:50 user nova-compute[71498]:   </features>
Apr 14 01:45:50 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:45:50 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:45:50 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:45:50 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:45:50 user nova-compute[71498]:   </clock>
Apr 14 01:45:50 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:45:50 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:45:50 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:45:50 user nova-compute[71498]:   </cpu>
Apr 14 01:45:50 user nova-compute[71498]:   <devices>
Apr 14 01:45:50 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:45:50 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:45:50 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/disk"/>
Apr 14 01:45:50 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:45:50 user nova-compute[71498]:     </disk>
Apr 14 01:45:50 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:45:50 user nova-compute[71498]:       <mac address="fa:16:3e:c7:d7:5e"/>
Apr 14 01:45:50 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:45:50 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:45:50 user nova-compute[71498]:       <target dev="tap20a227b0-3b"/>
Apr 14 01:45:50 user nova-compute[71498]:     </interface>
Apr 14 01:45:50 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:45:50 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/console.log" append="off"/>
Apr 14 01:45:50 user nova-compute[71498]:     </serial>
Apr 14 01:45:50 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:45:50 user nova-compute[71498]:     <video>
Apr 14 01:45:50 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:45:50 user nova-compute[71498]:     </video>
Apr 14 01:45:50 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:45:50 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:45:50 user nova-compute[71498]:     </rng>
Apr 14 01:45:50 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:45:50 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:45:50 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:45:50 user nova-compute[71498]:     </memballoon>
Apr 14 01:45:50 user nova-compute[71498]:   </devices>
Apr 14 01:45:50 user nova-compute[71498]: </domain>
Apr 14 01:45:50 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:45:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-155633687',display_name='tempest-SnapshotDataIntegrityTests-server-155633687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-155633687',id=21,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFi1cj7WQkCRTINMDBTK4eWsn4iPECgZryQ4AqN8ZjRlsgtGzjrzAzp3MVZJ+8jfj3WNZWSvuGDFxF6nqqS8dsafPBU9+OLArIsc7EEDH73hlPbPglpvFtiACHZGMdbsdA==',key_name='tempest-SnapshotDataIntegrityTests-465819654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='740488dbb5114fb2b38be20f8ce4adb0',ramdisk_id='',reservation_id='r-vzv7i33g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-919714320',owner_user_name='tempest-SnapshotDataIntegrityTests-919714320-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:45:48Z,user_data=None,user_id='34e25e45353e40b9a8bb14736c03fdeb',uuid=74311da6-d6b8-4aea-b6ce-97db8da53800,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20a227b0-3b4d-4df0-b583-071771a0ae44", "address": "fa:16:3e:c7:d7:5e", "network": {"id": "31f4b7e9-13bd-4aca-b6c3-a283c637ed63", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-802021657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "740488dbb5114fb2b38be20f8ce4adb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a227b0-3b", "ovs_interfaceid": "20a227b0-3b4d-4df0-b583-071771a0ae44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Converting VIF {"id": "20a227b0-3b4d-4df0-b583-071771a0ae44", "address": "fa:16:3e:c7:d7:5e", "network": {"id": "31f4b7e9-13bd-4aca-b6c3-a283c637ed63", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-802021657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "740488dbb5114fb2b38be20f8ce4adb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a227b0-3b", "ovs_interfaceid": "20a227b0-3b4d-4df0-b583-071771a0ae44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:d7:5e,bridge_name='br-int',has_traffic_filtering=True,id=20a227b0-3b4d-4df0-b583-071771a0ae44,network=Network(31f4b7e9-13bd-4aca-b6c3-a283c637ed63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20a227b0-3b') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG os_vif [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:d7:5e,bridge_name='br-int',has_traffic_filtering=True,id=20a227b0-3b4d-4df0-b583-071771a0ae44,network=Network(31f4b7e9-13bd-4aca-b6c3-a283c637ed63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20a227b0-3b') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20a227b0-3b, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap20a227b0-3b, col_values=(('external_ids', {'iface-id': '20a227b0-3b4d-4df0-b583-071771a0ae44', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:d7:5e', 'vm-uuid': '74311da6-d6b8-4aea-b6ce-97db8da53800'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:50 user nova-compute[71498]: INFO os_vif [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:d7:5e,bridge_name='br-int',has_traffic_filtering=True,id=20a227b0-3b4d-4df0-b583-071771a0ae44,network=Network(31f4b7e9-13bd-4aca-b6c3-a283c637ed63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20a227b0-3b')
Apr 14 01:45:50 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] No VIF found with MAC fa:16:3e:c7:d7:5e, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG nova.network.neutron [req-491eeb17-8481-4847-9b2b-0b3f94d15289 req-b30265b0-bb4c-4e55-9d52-c9049d723f5f service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Updated VIF entry in instance network info cache for port 20a227b0-3b4d-4df0-b583-071771a0ae44. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG nova.network.neutron [req-491eeb17-8481-4847-9b2b-0b3f94d15289 req-b30265b0-bb4c-4e55-9d52-c9049d723f5f service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Updating instance_info_cache with network_info: [{"id": "20a227b0-3b4d-4df0-b583-071771a0ae44", "address": "fa:16:3e:c7:d7:5e", "network": {"id": "31f4b7e9-13bd-4aca-b6c3-a283c637ed63", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-802021657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "740488dbb5114fb2b38be20f8ce4adb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a227b0-3b", "ovs_interfaceid": "20a227b0-3b4d-4df0-b583-071771a0ae44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:45:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-491eeb17-8481-4847-9b2b-0b3f94d15289 req-b30265b0-bb4c-4e55-9d52-c9049d723f5f service nova] Releasing lock "refresh_cache-74311da6-d6b8-4aea-b6ce-97db8da53800" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:45:51 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:51 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:52 user nova-compute[71498]: DEBUG nova.compute.manager [req-c2589dcc-5a0b-4661-80a4-fd5475d0aa09 req-3f7541ce-e6bb-40d9-a59f-be6c9bbd0b20 service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Received event network-vif-plugged-20a227b0-3b4d-4df0-b583-071771a0ae44 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:45:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c2589dcc-5a0b-4661-80a4-fd5475d0aa09 req-3f7541ce-e6bb-40d9-a59f-be6c9bbd0b20 service nova] Acquiring lock "74311da6-d6b8-4aea-b6ce-97db8da53800-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c2589dcc-5a0b-4661-80a4-fd5475d0aa09 req-3f7541ce-e6bb-40d9-a59f-be6c9bbd0b20 service nova] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c2589dcc-5a0b-4661-80a4-fd5475d0aa09 req-3f7541ce-e6bb-40d9-a59f-be6c9bbd0b20 service nova] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:52 user nova-compute[71498]: DEBUG nova.compute.manager [req-c2589dcc-5a0b-4661-80a4-fd5475d0aa09 req-3f7541ce-e6bb-40d9-a59f-be6c9bbd0b20 service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] No waiting events found dispatching network-vif-plugged-20a227b0-3b4d-4df0-b583-071771a0ae44 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:45:52 user nova-compute[71498]: WARNING nova.compute.manager [req-c2589dcc-5a0b-4661-80a4-fd5475d0aa09 req-3f7541ce-e6bb-40d9-a59f-be6c9bbd0b20 service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Received unexpected event network-vif-plugged-20a227b0-3b4d-4df0-b583-071771a0ae44 for instance with vm_state building and task_state spawning.
Apr 14 01:45:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d52d38d4-f81e-4a0d-8e17-7ac6e6c7c5aa tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "f045ae6d-889e-40c0-bd71-9b107dba9a70" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d52d38d4-f81e-4a0d-8e17-7ac6e6c7c5aa tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "f045ae6d-889e-40c0-bd71-9b107dba9a70" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d52d38d4-f81e-4a0d-8e17-7ac6e6c7c5aa tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "f045ae6d-889e-40c0-bd71-9b107dba9a70-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d52d38d4-f81e-4a0d-8e17-7ac6e6c7c5aa tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "f045ae6d-889e-40c0-bd71-9b107dba9a70-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d52d38d4-f81e-4a0d-8e17-7ac6e6c7c5aa tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "f045ae6d-889e-40c0-bd71-9b107dba9a70-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:52 user nova-compute[71498]: INFO nova.compute.manager [None req-d52d38d4-f81e-4a0d-8e17-7ac6e6c7c5aa tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Terminating instance
Apr 14 01:45:52 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d52d38d4-f81e-4a0d-8e17-7ac6e6c7c5aa tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 01:45:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:53 user nova-compute[71498]: DEBUG nova.compute.manager [req-50364ea7-4164-4a7c-8561-1b61700f5793 req-e7db0bfb-f388-4de9-8363-8dd6ca054a36 service nova] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Received event network-vif-unplugged-100274c1-800c-4d7f-a6b2-f3f74ec1d682 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:45:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-50364ea7-4164-4a7c-8561-1b61700f5793 req-e7db0bfb-f388-4de9-8363-8dd6ca054a36 service nova] Acquiring lock "f045ae6d-889e-40c0-bd71-9b107dba9a70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-50364ea7-4164-4a7c-8561-1b61700f5793 req-e7db0bfb-f388-4de9-8363-8dd6ca054a36 service nova] Lock "f045ae6d-889e-40c0-bd71-9b107dba9a70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-50364ea7-4164-4a7c-8561-1b61700f5793 req-e7db0bfb-f388-4de9-8363-8dd6ca054a36 service nova] Lock "f045ae6d-889e-40c0-bd71-9b107dba9a70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.009s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:53 user nova-compute[71498]: DEBUG nova.compute.manager [req-50364ea7-4164-4a7c-8561-1b61700f5793 req-e7db0bfb-f388-4de9-8363-8dd6ca054a36 service nova] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] No waiting events found dispatching network-vif-unplugged-100274c1-800c-4d7f-a6b2-f3f74ec1d682 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:45:53 user nova-compute[71498]: DEBUG nova.compute.manager [req-50364ea7-4164-4a7c-8561-1b61700f5793 req-e7db0bfb-f388-4de9-8363-8dd6ca054a36 service nova] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Received event network-vif-unplugged-100274c1-800c-4d7f-a6b2-f3f74ec1d682 for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:45:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:53 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Instance destroyed successfully.
Apr 14 01:45:53 user nova-compute[71498]: DEBUG nova.objects.instance [None req-d52d38d4-f81e-4a0d-8e17-7ac6e6c7c5aa tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lazy-loading 'resources' on Instance uuid f045ae6d-889e-40c0-bd71-9b107dba9a70 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:45:53 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-d52d38d4-f81e-4a0d-8e17-7ac6e6c7c5aa tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:43:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2127231950',display_name='tempest-VolumesAdminNegativeTest-server-2127231950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2127231950',id=15,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:44:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0a409270d6d4d408de33c5e71a56da9',ramdisk_id='',reservation_id='r-yhgdf38j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1981219566',owner_user_name='tempest-VolumesAdminNegativeTest-1981219566-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:44:03Z,user_data=None,user_id='bbaf843e44ff4359a15ab6d625134b07',uuid=f045ae6d-889e-40c0-bd71-9b107dba9a70,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "100274c1-800c-4d7f-a6b2-f3f74ec1d682", "address": "fa:16:3e:d7:62:7d", "network": {"id": "6569db42-40ba-4426-a76b-b3e64ecae5b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1148770119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a409270d6d4d408de33c5e71a56da9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap100274c1-80", "ovs_interfaceid": "100274c1-800c-4d7f-a6b2-f3f74ec1d682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:45:53 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-d52d38d4-f81e-4a0d-8e17-7ac6e6c7c5aa tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Converting VIF {"id": "100274c1-800c-4d7f-a6b2-f3f74ec1d682", "address": "fa:16:3e:d7:62:7d", "network": {"id": "6569db42-40ba-4426-a76b-b3e64ecae5b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1148770119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a409270d6d4d408de33c5e71a56da9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap100274c1-80", "ovs_interfaceid": "100274c1-800c-4d7f-a6b2-f3f74ec1d682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:45:53 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-d52d38d4-f81e-4a0d-8e17-7ac6e6c7c5aa tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:62:7d,bridge_name='br-int',has_traffic_filtering=True,id=100274c1-800c-4d7f-a6b2-f3f74ec1d682,network=Network(6569db42-40ba-4426-a76b-b3e64ecae5b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap100274c1-80') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:45:53 user nova-compute[71498]: DEBUG os_vif [None req-d52d38d4-f81e-4a0d-8e17-7ac6e6c7c5aa tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:62:7d,bridge_name='br-int',has_traffic_filtering=True,id=100274c1-800c-4d7f-a6b2-f3f74ec1d682,network=Network(6569db42-40ba-4426-a76b-b3e64ecae5b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap100274c1-80') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:45:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap100274c1-80, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:45:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:45:53 user nova-compute[71498]: INFO os_vif [None req-d52d38d4-f81e-4a0d-8e17-7ac6e6c7c5aa tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:62:7d,bridge_name='br-int',has_traffic_filtering=True,id=100274c1-800c-4d7f-a6b2-f3f74ec1d682,network=Network(6569db42-40ba-4426-a76b-b3e64ecae5b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap100274c1-80')
Apr 14 01:45:53 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-d52d38d4-f81e-4a0d-8e17-7ac6e6c7c5aa tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Deleting instance files /opt/stack/data/nova/instances/f045ae6d-889e-40c0-bd71-9b107dba9a70_del
Apr 14 01:45:53 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-d52d38d4-f81e-4a0d-8e17-7ac6e6c7c5aa tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Deletion of /opt/stack/data/nova/instances/f045ae6d-889e-40c0-bd71-9b107dba9a70_del complete
Apr 14 01:45:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:53 user nova-compute[71498]: INFO nova.compute.manager [None req-d52d38d4-f81e-4a0d-8e17-7ac6e6c7c5aa tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Took 1.02 seconds to destroy the instance on the hypervisor.
Apr 14 01:45:53 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-d52d38d4-f81e-4a0d-8e17-7ac6e6c7c5aa tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 01:45:53 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 01:45:53 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 01:45:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG nova.compute.manager [req-3bcd43ee-badd-481d-850f-3461e7abc391 req-600191a5-9b11-4eba-85ca-93367d28b221 service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Received event network-vif-plugged-20a227b0-3b4d-4df0-b583-071771a0ae44 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3bcd43ee-badd-481d-850f-3461e7abc391 req-600191a5-9b11-4eba-85ca-93367d28b221 service nova] Acquiring lock "74311da6-d6b8-4aea-b6ce-97db8da53800-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3bcd43ee-badd-481d-850f-3461e7abc391 req-600191a5-9b11-4eba-85ca-93367d28b221 service nova] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3bcd43ee-badd-481d-850f-3461e7abc391 req-600191a5-9b11-4eba-85ca-93367d28b221 service nova] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG nova.compute.manager [req-3bcd43ee-badd-481d-850f-3461e7abc391 req-600191a5-9b11-4eba-85ca-93367d28b221 service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] No waiting events found dispatching network-vif-plugged-20a227b0-3b4d-4df0-b583-071771a0ae44 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:45:54 user nova-compute[71498]: WARNING nova.compute.manager [req-3bcd43ee-badd-481d-850f-3461e7abc391 req-600191a5-9b11-4eba-85ca-93367d28b221 service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Received unexpected event network-vif-plugged-20a227b0-3b4d-4df0-b583-071771a0ae44 for instance with vm_state building and task_state spawning.
Apr 14 01:45:54 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:45:54 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Took 0.53 seconds to deallocate network for instance.
Apr 14 01:45:54 user nova-compute[71498]: DEBUG nova.compute.manager [req-350e21df-0a3c-499b-8276-3319c86f7bfd req-ecbdb932-057c-447d-9a13-1c4d027284a4 service nova] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Received event network-vif-deleted-100274c1-800c-4d7f-a6b2-f3f74ec1d682 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:45:54 user nova-compute[71498]: INFO nova.compute.manager [req-350e21df-0a3c-499b-8276-3319c86f7bfd req-ecbdb932-057c-447d-9a13-1c4d027284a4 service nova] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Neutron deleted interface 100274c1-800c-4d7f-a6b2-f3f74ec1d682; detaching it from the instance and deleting it from the info cache
Apr 14 01:45:54 user nova-compute[71498]: DEBUG nova.network.neutron [req-350e21df-0a3c-499b-8276-3319c86f7bfd req-ecbdb932-057c-447d-9a13-1c4d027284a4 service nova] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436754.265995, 74311da6-d6b8-4aea-b6ce-97db8da53800 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:45:54 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] VM Resumed (Lifecycle Event)
Apr 14 01:45:54 user nova-compute[71498]: DEBUG nova.compute.manager [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG nova.compute.manager [req-350e21df-0a3c-499b-8276-3319c86f7bfd req-ecbdb932-057c-447d-9a13-1c4d027284a4 service nova] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Detach interface failed, port_id=100274c1-800c-4d7f-a6b2-f3f74ec1d682, reason: Instance f045ae6d-889e-40c0-bd71-9b107dba9a70 could not be found. {{(pid=71498) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 01:45:54 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Instance spawned successfully.
Apr 14 01:45:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:45:54 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:45:54 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436754.2713666, 74311da6-d6b8-4aea-b6ce-97db8da53800 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:45:54 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] VM Started (Lifecycle Event)
Apr 14 01:45:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d52d38d4-f81e-4a0d-8e17-7ac6e6c7c5aa tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d52d38d4-f81e-4a0d-8e17-7ac6e6c7c5aa tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:45:54 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:45:54 user nova-compute[71498]: INFO nova.compute.manager [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Took 6.67 seconds to spawn the instance on the hypervisor.
Apr 14 01:45:54 user nova-compute[71498]: DEBUG nova.compute.manager [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:54 user nova-compute[71498]: INFO nova.compute.manager [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Unshelving
Apr 14 01:45:54 user nova-compute[71498]: INFO nova.compute.manager [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Took 7.78 seconds to build instance.
Apr 14 01:45:54 user nova-compute[71498]: INFO nova.virt.block_device [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Booting with volume f78596d7-c339-491a-a0d2-470a1c158a53 at /dev/vda
Apr 14 01:45:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-edea6275-2299-483a-b62a-f7ebe60c8290 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.914s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG os_brick.utils [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfcbf5e-037d-4569-9e83-a71a2c4a0e01]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c031444d-f656-4b31-b7bb-186219098288]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[758c3ee0-aa77-45d1-9536-7aea2bbb5a4a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[877fa6d4-91d1-4bde-bfd4-94bc51ca1c8f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:45:54 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:45:54 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef2f023-e0bd-4b74-aec5-52cda19c4434]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG os_brick.utils [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Updating existing volume attachment record: 926cdbb1-12b5-4a56-ac64-b6d6ee0a829c {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d52d38d4-f81e-4a0d-8e17-7ac6e6c7c5aa tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d52d38d4-f81e-4a0d-8e17-7ac6e6c7c5aa tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:45:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d52d38d4-f81e-4a0d-8e17-7ac6e6c7c5aa tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.580s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:54 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-d52d38d4-f81e-4a0d-8e17-7ac6e6c7c5aa tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Deleted allocations for instance f045ae6d-889e-40c0-bd71-9b107dba9a70
Apr 14 01:45:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d52d38d4-f81e-4a0d-8e17-7ac6e6c7c5aa tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "f045ae6d-889e-40c0-bd71-9b107dba9a70" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.432s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:55 user nova-compute[71498]: DEBUG nova.compute.manager [req-ff7058de-35c8-4dcf-b7c6-25b90760a30c req-ff277810-786f-40b1-adbd-b29271af567f service nova] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Received event network-vif-plugged-100274c1-800c-4d7f-a6b2-f3f74ec1d682 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:45:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ff7058de-35c8-4dcf-b7c6-25b90760a30c req-ff277810-786f-40b1-adbd-b29271af567f service nova] Acquiring lock "f045ae6d-889e-40c0-bd71-9b107dba9a70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ff7058de-35c8-4dcf-b7c6-25b90760a30c req-ff277810-786f-40b1-adbd-b29271af567f service nova] Lock "f045ae6d-889e-40c0-bd71-9b107dba9a70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ff7058de-35c8-4dcf-b7c6-25b90760a30c req-ff277810-786f-40b1-adbd-b29271af567f service nova] Lock "f045ae6d-889e-40c0-bd71-9b107dba9a70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:45:55 user nova-compute[71498]: DEBUG nova.compute.manager [req-ff7058de-35c8-4dcf-b7c6-25b90760a30c req-ff277810-786f-40b1-adbd-b29271af567f service nova] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] No waiting events found dispatching network-vif-plugged-100274c1-800c-4d7f-a6b2-f3f74ec1d682 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:45:55 user nova-compute[71498]: WARNING nova.compute.manager [req-ff7058de-35c8-4dcf-b7c6-25b90760a30c req-ff277810-786f-40b1-adbd-b29271af567f service nova] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Received unexpected event network-vif-plugged-100274c1-800c-4d7f-a6b2-f3f74ec1d682 for instance with vm_state deleted and task_state None.
Apr 14 01:45:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:45:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:45:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:45:59 user nova-compute[71498]: DEBUG nova.objects.instance [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lazy-loading 'pci_requests' on Instance uuid ee4cf01f-8d33-4696-b6ec-7f188ee18026 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:45:59 user nova-compute[71498]: DEBUG nova.objects.instance [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lazy-loading 'numa_topology' on Instance uuid ee4cf01f-8d33-4696-b6ec-7f188ee18026 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:45:59 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:45:59 user nova-compute[71498]: INFO nova.compute.claims [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Claim successful on node user
Apr 14 01:45:59 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:45:59 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:46:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.459s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:00 user nova-compute[71498]: INFO nova.network.neutron [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Updating port 9b10b56a-df5a-429e-a551-db729007648a with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "refresh_cache-ee4cf01f-8d33-4696-b6ec-7f188ee18026" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquired lock "refresh_cache-ee4cf01f-8d33-4696-b6ec-7f188ee18026" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG nova.network.neutron [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG nova.compute.manager [req-9c140332-7f33-47fa-a369-5104c020b8a4 req-47388002-a4cb-474d-96e4-994bd98f1957 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Received event network-changed-9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG nova.compute.manager [req-9c140332-7f33-47fa-a369-5104c020b8a4 req-47388002-a4cb-474d-96e4-994bd98f1957 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Refreshing instance network info cache due to event network-changed-9b10b56a-df5a-429e-a551-db729007648a. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-9c140332-7f33-47fa-a369-5104c020b8a4 req-47388002-a4cb-474d-96e4-994bd98f1957 service nova] Acquiring lock "refresh_cache-ee4cf01f-8d33-4696-b6ec-7f188ee18026" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG nova.network.neutron [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Updating instance_info_cache with network_info: [{"id": "9b10b56a-df5a-429e-a551-db729007648a", "address": "fa:16:3e:89:b1:39", "network": {"id": "4f7f7e24-860c-47ce-b635-be72e8fe2913", "bridge": "br-int", "label": "tempest-TestShelveInstance-1817709221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef081a56d11d4b4d82ba5fe6572f3b95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b10b56a-df", "ovs_interfaceid": "9b10b56a-df5a-429e-a551-db729007648a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Releasing lock "refresh_cache-ee4cf01f-8d33-4696-b6ec-7f188ee18026" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:46:01 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Creating image(s)
Apr 14 01:46:01 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Did not create local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Ensure instance console log exists: /opt/stack/data/nova/instances/ee4cf01f-8d33-4696-b6ec-7f188ee18026/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Start _get_guest_xml network_info=[{"id": "9b10b56a-df5a-429e-a551-db729007648a", "address": "fa:16:3e:89:b1:39", "network": {"id": "4f7f7e24-860c-47ce-b635-be72e8fe2913", "bridge": "br-int", "label": "tempest-TestShelveInstance-1817709221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef081a56d11d4b4d82ba5fe6572f3b95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b10b56a-df", "ovs_interfaceid": "9b10b56a-df5a-429e-a551-db729007648a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '926cdbb1-12b5-4a56-ac64-b6d6ee0a829c', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eLIEctAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ee4cf01f-8d33-4696-b6ec-7f188ee18026', 'attached_at': '', 'detached_at': '', 'volume_id': 'f78596d7-c339-491a-a0d2-470a1c158a53', 'serial': 'f78596d7-c339-491a-a0d2-470a1c158a53'}, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-9c140332-7f33-47fa-a369-5104c020b8a4 req-47388002-a4cb-474d-96e4-994bd98f1957 service nova] Acquired lock "refresh_cache-ee4cf01f-8d33-4696-b6ec-7f188ee18026" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG nova.network.neutron [req-9c140332-7f33-47fa-a369-5104c020b8a4 req-47388002-a4cb-474d-96e4-994bd98f1957 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Refreshing network info cache for port 9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:46:01 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:46:01 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:46:01 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG nova.objects.instance [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lazy-loading 'vcpu_model' on Instance uuid ee4cf01f-8d33-4696-b6ec-7f188ee18026 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eLIEctAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:46:01 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:46:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:46:01 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:46:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:46:01 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:46:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d64006-3e18-4555-b964-0d0e711e1d50]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:46:01 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5139eca-774c-4438-807b-0e677819ac78]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53] added
Apr 14 01:46:01 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa7676a-58df-413e-bf74-11c07aab8e95]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09d9629-d646-4a3f-9286-1ecabba31bf9]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eLIEctAV {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eLIEctAV" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fe366e-7e08-432b-8c1f-9f0b685eedce]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eLIEctAV'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea83693-962e-4373-8dd3-abfb3a792e35]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f98e70-9d98-42c2-a217-e657fd85b1aa]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:46:01 user nova-compute[71498]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)
Apr 14 01:46:01 user nova-compute[71498]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d (non-flash)
Apr 14 01:46:01 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:46:01 user nova-compute[71498]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)
Apr 14 01:46:01 user nova-compute[71498]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d (non-flash)
Apr 14 01:46:01 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:46:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:02 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[be546042-824f-4a41-b1ea-e83076188edb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:02 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53, portal: 172.16.0.220,3260]
Apr 14 01:46:02 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53, portal: 172.16.0.220,3260] successful.
Apr 14 01:46:02 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:46:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:02 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2858ce3-659f-4115-a7d7-d62c61f618bb]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:02 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:46:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:02 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[68674206-3a72-4d5c-a25b-63069f79dc57]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:02 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:46:02 user nova-compute[71498]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)
Apr 14 01:46:02 user nova-compute[71498]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d (non-flash)
Apr 14 01:46:02 user nova-compute[71498]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:46:02 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:46:02 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:46:02 user nova-compute[71498]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)
Apr 14 01:46:02 user nova-compute[71498]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d (non-flash)
Apr 14 01:46:02 user nova-compute[71498]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:46:02 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:46:02 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:46:02 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:46:02 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:46:02 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:46:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:02 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c162c444-5eab-4181-80ff-d6d2957e2a3b]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:02 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:46:02 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eLIEctAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:46:02 user nova-compute[71498]: DEBUG nova.network.neutron [req-9c140332-7f33-47fa-a369-5104c020b8a4 req-47388002-a4cb-474d-96e4-994bd98f1957 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Updated VIF entry in instance network info cache for port 9b10b56a-df5a-429e-a551-db729007648a. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:46:02 user nova-compute[71498]: DEBUG nova.network.neutron [req-9c140332-7f33-47fa-a369-5104c020b8a4 req-47388002-a4cb-474d-96e4-994bd98f1957 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Updating instance_info_cache with network_info: [{"id": "9b10b56a-df5a-429e-a551-db729007648a", "address": "fa:16:3e:89:b1:39", "network": {"id": "4f7f7e24-860c-47ce-b635-be72e8fe2913", "bridge": "br-int", "label": "tempest-TestShelveInstance-1817709221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef081a56d11d4b4d82ba5fe6572f3b95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b10b56a-df", "ovs_interfaceid": "9b10b56a-df5a-429e-a551-db729007648a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:46:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-9c140332-7f33-47fa-a369-5104c020b8a4 req-47388002-a4cb-474d-96e4-994bd98f1957 service nova] Releasing lock "refresh_cache-ee4cf01f-8d33-4696-b6ec-7f188ee18026" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:46:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:03 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:46:03 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26134336433353036', 'path': '/dev/sde'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:46:03 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134336433353036', 'path': '/dev/sde'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:46:03 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T01:42:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1018221636',display_name='tempest-TestShelveInstance-server-1018221636',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1018221636',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-711764184',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:42:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ef081a56d11d4b4d82ba5fe6572f3b95',ramdisk_id='',reservation_id='r-fjanozaf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-437254779',owner_user_name='tempest-TestShelveInstance-437254779-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:45:55Z,user_data=None,user_id='447da297b18f4e7f86fa94cd4d5d7918',uuid=ee4cf01f-8d33-4696-b6ec-7f188ee18026,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9b10b56a-df5a-429e-a551-db729007648a", "address": "fa:16:3e:89:b1:39", "network": {"id": "4f7f7e24-860c-47ce-b635-be72e8fe2913", "bridge": "br-int", "label": "tempest-TestShelveInstance-1817709221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef081a56d11d4b4d82ba5fe6572f3b95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b10b56a-df", "ovs_interfaceid": "9b10b56a-df5a-429e-a551-db729007648a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:46:03 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Converting VIF {"id": "9b10b56a-df5a-429e-a551-db729007648a", "address": "fa:16:3e:89:b1:39", "network": {"id": "4f7f7e24-860c-47ce-b635-be72e8fe2913", "bridge": "br-int", "label": "tempest-TestShelveInstance-1817709221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef081a56d11d4b4d82ba5fe6572f3b95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b10b56a-df", "ovs_interfaceid": "9b10b56a-df5a-429e-a551-db729007648a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:46:03 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:b1:39,bridge_name='br-int',has_traffic_filtering=True,id=9b10b56a-df5a-429e-a551-db729007648a,network=Network(4f7f7e24-860c-47ce-b635-be72e8fe2913),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b10b56a-df') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:46:03 user nova-compute[71498]: DEBUG nova.objects.instance [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lazy-loading 'pci_devices' on Instance uuid ee4cf01f-8d33-4696-b6ec-7f188ee18026 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:46:03 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:46:03 user nova-compute[71498]:   <uuid>ee4cf01f-8d33-4696-b6ec-7f188ee18026</uuid>
Apr 14 01:46:03 user nova-compute[71498]:   <name>instance-0000000b</name>
Apr 14 01:46:03 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:46:03 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:46:03 user nova-compute[71498]:   <metadata>
Apr 14 01:46:03 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:46:03 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:46:03 user nova-compute[71498]:       <nova:name>tempest-TestShelveInstance-server-1018221636</nova:name>
Apr 14 01:46:03 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:46:01</nova:creationTime>
Apr 14 01:46:03 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:46:03 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:46:03 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:46:03 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:46:03 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:46:03 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:46:03 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:46:03 user nova-compute[71498]:       <nova:owner>
Apr 14 01:46:03 user nova-compute[71498]:         <nova:user uuid="447da297b18f4e7f86fa94cd4d5d7918">tempest-TestShelveInstance-437254779-project-member</nova:user>
Apr 14 01:46:03 user nova-compute[71498]:         <nova:project uuid="ef081a56d11d4b4d82ba5fe6572f3b95">tempest-TestShelveInstance-437254779</nova:project>
Apr 14 01:46:03 user nova-compute[71498]:       </nova:owner>
Apr 14 01:46:03 user nova-compute[71498]:       <nova:ports>
Apr 14 01:46:03 user nova-compute[71498]:         <nova:port uuid="9b10b56a-df5a-429e-a551-db729007648a">
Apr 14 01:46:03 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 01:46:03 user nova-compute[71498]:         </nova:port>
Apr 14 01:46:03 user nova-compute[71498]:       </nova:ports>
Apr 14 01:46:03 user nova-compute[71498]:     </nova:instance>
Apr 14 01:46:03 user nova-compute[71498]:   </metadata>
Apr 14 01:46:03 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:46:03 user nova-compute[71498]:     <system>
Apr 14 01:46:03 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:46:03 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:46:03 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:46:03 user nova-compute[71498]:       <entry name="serial">ee4cf01f-8d33-4696-b6ec-7f188ee18026</entry>
Apr 14 01:46:03 user nova-compute[71498]:       <entry name="uuid">ee4cf01f-8d33-4696-b6ec-7f188ee18026</entry>
Apr 14 01:46:03 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:46:03 user nova-compute[71498]:     </system>
Apr 14 01:46:03 user nova-compute[71498]:   </sysinfo>
Apr 14 01:46:03 user nova-compute[71498]:   <os>
Apr 14 01:46:03 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:46:03 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:46:03 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:46:03 user nova-compute[71498]:   </os>
Apr 14 01:46:03 user nova-compute[71498]:   <features>
Apr 14 01:46:03 user nova-compute[71498]:     <acpi/>
Apr 14 01:46:03 user nova-compute[71498]:     <apic/>
Apr 14 01:46:03 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:46:03 user nova-compute[71498]:   </features>
Apr 14 01:46:03 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:46:03 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:46:03 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:46:03 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:46:03 user nova-compute[71498]:   </clock>
Apr 14 01:46:03 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:46:03 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:46:03 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:46:03 user nova-compute[71498]:   </cpu>
Apr 14 01:46:03 user nova-compute[71498]:   <devices>
Apr 14 01:46:03 user nova-compute[71498]:     <disk type="block" device="disk">
Apr 14 01:46:03 user nova-compute[71498]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:46:03 user nova-compute[71498]:       <source dev="/dev/sde"/>
Apr 14 01:46:03 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:46:03 user nova-compute[71498]:       <serial>f78596d7-c339-491a-a0d2-470a1c158a53</serial>
Apr 14 01:46:03 user nova-compute[71498]:     </disk>
Apr 14 01:46:03 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:46:03 user nova-compute[71498]:       <mac address="fa:16:3e:89:b1:39"/>
Apr 14 01:46:03 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:46:03 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:46:03 user nova-compute[71498]:       <target dev="tap9b10b56a-df"/>
Apr 14 01:46:03 user nova-compute[71498]:     </interface>
Apr 14 01:46:03 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:46:03 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/ee4cf01f-8d33-4696-b6ec-7f188ee18026/console.log" append="off"/>
Apr 14 01:46:03 user nova-compute[71498]:     </serial>
Apr 14 01:46:03 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:46:03 user nova-compute[71498]:     <video>
Apr 14 01:46:03 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:46:03 user nova-compute[71498]:     </video>
Apr 14 01:46:03 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:46:03 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:46:03 user nova-compute[71498]:     </rng>
Apr 14 01:46:03 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:46:03 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:46:03 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:46:03 user nova-compute[71498]:     </memballoon>
Apr 14 01:46:03 user nova-compute[71498]:   </devices>
Apr 14 01:46:03 user nova-compute[71498]: </domain>
Apr 14 01:46:03 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:46:03 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T01:42:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1018221636',display_name='tempest-TestShelveInstance-server-1018221636',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1018221636',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-711764184',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:42:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ef081a56d11d4b4d82ba5fe6572f3b95',ramdisk_id='',reservation_id='r-fjanozaf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-437254779',owner_user_name='tempest-TestShelveInstance-437254779-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:45:55Z,user_data=None,user_id='447da297b18f4e7f86fa94cd4d5d7918',uuid=ee4cf01f-8d33-4696-b6ec-7f188ee18026,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9b10b56a-df5a-429e-a551-db729007648a", "address": "fa:16:3e:89:b1:39", "network": {"id": "4f7f7e24-860c-47ce-b635-be72e8fe2913", "bridge": "br-int", "label": "tempest-TestShelveInstance-1817709221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef081a56d11d4b4d82ba5fe6572f3b95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b10b56a-df", "ovs_interfaceid": "9b10b56a-df5a-429e-a551-db729007648a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:46:03 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Converting VIF {"id": "9b10b56a-df5a-429e-a551-db729007648a", "address": "fa:16:3e:89:b1:39", "network": {"id": "4f7f7e24-860c-47ce-b635-be72e8fe2913", "bridge": "br-int", "label": "tempest-TestShelveInstance-1817709221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef081a56d11d4b4d82ba5fe6572f3b95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b10b56a-df", "ovs_interfaceid": "9b10b56a-df5a-429e-a551-db729007648a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:46:03 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:b1:39,bridge_name='br-int',has_traffic_filtering=True,id=9b10b56a-df5a-429e-a551-db729007648a,network=Network(4f7f7e24-860c-47ce-b635-be72e8fe2913),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b10b56a-df') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:46:03 user nova-compute[71498]: DEBUG os_vif [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:b1:39,bridge_name='br-int',has_traffic_filtering=True,id=9b10b56a-df5a-429e-a551-db729007648a,network=Network(4f7f7e24-860c-47ce-b635-be72e8fe2913),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b10b56a-df') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:46:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:46:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:46:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b10b56a-df, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:46:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9b10b56a-df, col_values=(('external_ids', {'iface-id': '9b10b56a-df5a-429e-a551-db729007648a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:b1:39', 'vm-uuid': 'ee4cf01f-8d33-4696-b6ec-7f188ee18026'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:46:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:46:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:03 user nova-compute[71498]: INFO os_vif [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:b1:39,bridge_name='br-int',has_traffic_filtering=True,id=9b10b56a-df5a-429e-a551-db729007648a,network=Network(4f7f7e24-860c-47ce-b635-be72e8fe2913),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b10b56a-df')
Apr 14 01:46:03 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:46:03 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] No VIF found with MAC fa:16:3e:89:b1:39, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:46:04 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:04 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:04 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:04 user nova-compute[71498]: DEBUG nova.compute.manager [req-cafa0f05-18b5-4bcf-89eb-f6a66cfe5dcc req-71e3802e-6791-4918-84e5-94b34f4bb7c0 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Received event network-vif-plugged-9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-cafa0f05-18b5-4bcf-89eb-f6a66cfe5dcc req-71e3802e-6791-4918-84e5-94b34f4bb7c0 service nova] Acquiring lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-cafa0f05-18b5-4bcf-89eb-f6a66cfe5dcc req-71e3802e-6791-4918-84e5-94b34f4bb7c0 service nova] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-cafa0f05-18b5-4bcf-89eb-f6a66cfe5dcc req-71e3802e-6791-4918-84e5-94b34f4bb7c0 service nova] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:04 user nova-compute[71498]: DEBUG nova.compute.manager [req-cafa0f05-18b5-4bcf-89eb-f6a66cfe5dcc req-71e3802e-6791-4918-84e5-94b34f4bb7c0 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] No waiting events found dispatching network-vif-plugged-9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:46:04 user nova-compute[71498]: WARNING nova.compute.manager [req-cafa0f05-18b5-4bcf-89eb-f6a66cfe5dcc req-71e3802e-6791-4918-84e5-94b34f4bb7c0 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Received unexpected event network-vif-plugged-9b10b56a-df5a-429e-a551-db729007648a for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 01:46:05 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:05 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:05 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:06 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436766.7854571, ee4cf01f-8d33-4696-b6ec-7f188ee18026 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:46:06 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] VM Resumed (Lifecycle Event)
Apr 14 01:46:06 user nova-compute[71498]: DEBUG nova.compute.manager [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:46:06 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:46:06 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Instance spawned successfully.
Apr 14 01:46:06 user nova-compute[71498]: DEBUG nova.compute.manager [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:46:06 user nova-compute[71498]: DEBUG nova.compute.manager [req-d5fa53b2-a3b0-454c-ac3d-6a2cc30d1998 req-0c2c87dd-46d5-4796-817d-ccfd0b404eb7 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Received event network-vif-plugged-9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d5fa53b2-a3b0-454c-ac3d-6a2cc30d1998 req-0c2c87dd-46d5-4796-817d-ccfd0b404eb7 service nova] Acquiring lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d5fa53b2-a3b0-454c-ac3d-6a2cc30d1998 req-0c2c87dd-46d5-4796-817d-ccfd0b404eb7 service nova] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d5fa53b2-a3b0-454c-ac3d-6a2cc30d1998 req-0c2c87dd-46d5-4796-817d-ccfd0b404eb7 service nova] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:06 user nova-compute[71498]: DEBUG nova.compute.manager [req-d5fa53b2-a3b0-454c-ac3d-6a2cc30d1998 req-0c2c87dd-46d5-4796-817d-ccfd0b404eb7 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] No waiting events found dispatching network-vif-plugged-9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:46:06 user nova-compute[71498]: WARNING nova.compute.manager [req-d5fa53b2-a3b0-454c-ac3d-6a2cc30d1998 req-0c2c87dd-46d5-4796-817d-ccfd0b404eb7 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Received unexpected event network-vif-plugged-9b10b56a-df5a-429e-a551-db729007648a for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 01:46:06 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:46:06 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:46:06 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:46:06 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436766.789242, ee4cf01f-8d33-4696-b6ec-7f188ee18026 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:46:06 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] VM Started (Lifecycle Event)
Apr 14 01:46:06 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:46:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3a955418-ace4-443d-a210-fcedb09b5fb5 tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.384s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:06 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:46:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:08 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681436753.5172334, f045ae6d-889e-40c0-bd71-9b107dba9a70 => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:46:08 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] VM Stopped (Lifecycle Event)
Apr 14 01:46:08 user nova-compute[71498]: DEBUG nova.compute.manager [None req-882dc9a9-0510-43b4-a78c-59968aa83b04 None None] [instance: f045ae6d-889e-40c0-bd71-9b107dba9a70] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:46:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "4f8101aa-2078-4f0e-becb-62636c747c60" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "4f8101aa-2078-4f0e-becb-62636c747c60" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:15 user nova-compute[71498]: DEBUG nova.compute.manager [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 01:46:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:16 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:46:16 user nova-compute[71498]: INFO nova.compute.claims [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Claim successful on node user
Apr 14 01:46:16 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:46:16 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:46:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:16 user nova-compute[71498]: DEBUG nova.compute.manager [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 01:46:16 user nova-compute[71498]: DEBUG nova.compute.manager [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 01:46:16 user nova-compute[71498]: DEBUG nova.network.neutron [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:46:16 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 01:46:16 user nova-compute[71498]: DEBUG nova.compute.manager [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 01:46:16 user nova-compute[71498]: INFO nova.virt.block_device [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Booting with volume dccc3a21-0674-4347-842b-3d0354dfdfa8 at /dev/vda
Apr 14 01:46:16 user nova-compute[71498]: DEBUG nova.policy [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4e5234d2ffe4dc898d22be4bd648c47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7782019f67b04982a58ed5272dc4cbb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:46:16 user nova-compute[71498]: DEBUG os_brick.utils [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:46:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:16 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfbf28c-61d7-4599-bc4b-2faf492bd4a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:16 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb821cb-3f69-4c71-bb06-3bdc320880de]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:16 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b992ba-e0b5-4db3-ade4-0b59156acd38]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:16 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d133d8-5736-4128-9218-965e29844237]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:46:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:46:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:46:17 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:46:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c4b17b-c04a-4ce6-b4ef-608313a4a491]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:46:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:46:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:46:17 user nova-compute[71498]: DEBUG os_brick.utils [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:46:17 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Updating existing volume attachment record: 39b50bc8-687b-4ade-ba07-779569acf68f {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:46:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:17 user nova-compute[71498]: DEBUG nova.network.neutron [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Successfully created port: 0912c834-ed73-4f3a-9419-2c08d6094b93 {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:46:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:18 user nova-compute[71498]: DEBUG nova.network.neutron [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Successfully created port: 6532dff7-2168-407f-be9b-bdbea1b6edd4 {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:46:19 user nova-compute[71498]: DEBUG nova.network.neutron [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Successfully created port: f12d4d92-cf6a-4908-a203-d32ad80cb617 {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:46:19 user nova-compute[71498]: DEBUG nova.network.neutron [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Successfully created port: 6517ba71-e7ec-4e68-8860-714bb4711368 {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:46:20 user nova-compute[71498]: DEBUG nova.network.neutron [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Successfully created port: 9894ad9b-db8c-4729-bd7b-ebb28b91af2b {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:46:21 user nova-compute[71498]: DEBUG nova.network.neutron [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Successfully updated port: 0912c834-ed73-4f3a-9419-2c08d6094b93 {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:46:21 user nova-compute[71498]: DEBUG nova.compute.manager [req-3b021a69-e162-4d4e-9f82-a62efa4bf21c req-1e804941-5bf4-4254-9891-0d16cf3e3ac5 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-changed-0912c834-ed73-4f3a-9419-2c08d6094b93 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:21 user nova-compute[71498]: DEBUG nova.compute.manager [req-3b021a69-e162-4d4e-9f82-a62efa4bf21c req-1e804941-5bf4-4254-9891-0d16cf3e3ac5 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Refreshing instance network info cache due to event network-changed-0912c834-ed73-4f3a-9419-2c08d6094b93. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:46:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3b021a69-e162-4d4e-9f82-a62efa4bf21c req-1e804941-5bf4-4254-9891-0d16cf3e3ac5 service nova] Acquiring lock "refresh_cache-4f8101aa-2078-4f0e-becb-62636c747c60" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:46:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3b021a69-e162-4d4e-9f82-a62efa4bf21c req-1e804941-5bf4-4254-9891-0d16cf3e3ac5 service nova] Acquired lock "refresh_cache-4f8101aa-2078-4f0e-becb-62636c747c60" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:46:21 user nova-compute[71498]: DEBUG nova.network.neutron [req-3b021a69-e162-4d4e-9f82-a62efa4bf21c req-1e804941-5bf4-4254-9891-0d16cf3e3ac5 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Refreshing network info cache for port 0912c834-ed73-4f3a-9419-2c08d6094b93 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:46:21 user nova-compute[71498]: DEBUG nova.network.neutron [req-3b021a69-e162-4d4e-9f82-a62efa4bf21c req-1e804941-5bf4-4254-9891-0d16cf3e3ac5 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:46:21 user nova-compute[71498]: DEBUG nova.network.neutron [req-3b021a69-e162-4d4e-9f82-a62efa4bf21c req-1e804941-5bf4-4254-9891-0d16cf3e3ac5 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:46:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3b021a69-e162-4d4e-9f82-a62efa4bf21c req-1e804941-5bf4-4254-9891-0d16cf3e3ac5 service nova] Releasing lock "refresh_cache-4f8101aa-2078-4f0e-becb-62636c747c60" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:46:21 user nova-compute[71498]: INFO nova.virt.block_device [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Booting with volume f01988fc-537f-4359-9b58-2a3f4752251b at /dev/vdb
Apr 14 01:46:21 user nova-compute[71498]: DEBUG os_brick.utils [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:46:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:21 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[39981c57-8e1f-4e5f-9001-371939ed4af2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:21 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3af143-f44c-4fb2-bb9a-00c716b842a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:21 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a6a030-13a4-4265-aead-56a28ab2c117]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:21 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0031d2-1fec-43ab-b1d5-addb7d52454a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:46:21 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:46:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:46:21 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:46:21 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ef5a4e-c4ff-45c8-9642-e61c877c4332]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:21 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:46:21 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:46:21 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:46:21 user nova-compute[71498]: DEBUG os_brick.utils [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:46:21 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Updating existing volume attachment record: 28e490a1-0ef3-4608-89a5-7f290c91b23b {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:46:22 user nova-compute[71498]: DEBUG nova.network.neutron [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Successfully updated port: 4e9a3669-2ccb-49fc-a153-dfcee715ad41 {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:46:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:22 user nova-compute[71498]: DEBUG nova.network.neutron [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Successfully updated port: b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:46:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:23 user nova-compute[71498]: DEBUG nova.compute.manager [req-2d440b06-adea-4155-9639-c49b7e655fac req-69df683e-3694-4e28-b1df-ec267b2987b2 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-changed-4e9a3669-2ccb-49fc-a153-dfcee715ad41 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:23 user nova-compute[71498]: DEBUG nova.compute.manager [req-2d440b06-adea-4155-9639-c49b7e655fac req-69df683e-3694-4e28-b1df-ec267b2987b2 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Refreshing instance network info cache due to event network-changed-4e9a3669-2ccb-49fc-a153-dfcee715ad41. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:46:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-2d440b06-adea-4155-9639-c49b7e655fac req-69df683e-3694-4e28-b1df-ec267b2987b2 service nova] Acquiring lock "refresh_cache-4f8101aa-2078-4f0e-becb-62636c747c60" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:46:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-2d440b06-adea-4155-9639-c49b7e655fac req-69df683e-3694-4e28-b1df-ec267b2987b2 service nova] Acquired lock "refresh_cache-4f8101aa-2078-4f0e-becb-62636c747c60" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:46:23 user nova-compute[71498]: DEBUG nova.network.neutron [req-2d440b06-adea-4155-9639-c49b7e655fac req-69df683e-3694-4e28-b1df-ec267b2987b2 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Refreshing network info cache for port 4e9a3669-2ccb-49fc-a153-dfcee715ad41 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:46:23 user nova-compute[71498]: DEBUG nova.network.neutron [req-2d440b06-adea-4155-9639-c49b7e655fac req-69df683e-3694-4e28-b1df-ec267b2987b2 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:46:23 user nova-compute[71498]: DEBUG nova.network.neutron [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Successfully updated port: 6532dff7-2168-407f-be9b-bdbea1b6edd4 {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:46:23 user nova-compute[71498]: DEBUG nova.network.neutron [req-2d440b06-adea-4155-9639-c49b7e655fac req-69df683e-3694-4e28-b1df-ec267b2987b2 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:46:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-2d440b06-adea-4155-9639-c49b7e655fac req-69df683e-3694-4e28-b1df-ec267b2987b2 service nova] Releasing lock "refresh_cache-4f8101aa-2078-4f0e-becb-62636c747c60" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:46:23 user nova-compute[71498]: DEBUG nova.compute.manager [req-2d440b06-adea-4155-9639-c49b7e655fac req-69df683e-3694-4e28-b1df-ec267b2987b2 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-changed-b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:23 user nova-compute[71498]: DEBUG nova.compute.manager [req-2d440b06-adea-4155-9639-c49b7e655fac req-69df683e-3694-4e28-b1df-ec267b2987b2 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Refreshing instance network info cache due to event network-changed-b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:46:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-2d440b06-adea-4155-9639-c49b7e655fac req-69df683e-3694-4e28-b1df-ec267b2987b2 service nova] Acquiring lock "refresh_cache-4f8101aa-2078-4f0e-becb-62636c747c60" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:46:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-2d440b06-adea-4155-9639-c49b7e655fac req-69df683e-3694-4e28-b1df-ec267b2987b2 service nova] Acquired lock "refresh_cache-4f8101aa-2078-4f0e-becb-62636c747c60" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:46:23 user nova-compute[71498]: DEBUG nova.network.neutron [req-2d440b06-adea-4155-9639-c49b7e655fac req-69df683e-3694-4e28-b1df-ec267b2987b2 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Refreshing network info cache for port b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:46:23 user nova-compute[71498]: DEBUG nova.network.neutron [req-2d440b06-adea-4155-9639-c49b7e655fac req-69df683e-3694-4e28-b1df-ec267b2987b2 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:46:23 user nova-compute[71498]: DEBUG nova.network.neutron [req-2d440b06-adea-4155-9639-c49b7e655fac req-69df683e-3694-4e28-b1df-ec267b2987b2 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:46:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-2d440b06-adea-4155-9639-c49b7e655fac req-69df683e-3694-4e28-b1df-ec267b2987b2 service nova] Releasing lock "refresh_cache-4f8101aa-2078-4f0e-becb-62636c747c60" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:46:24 user nova-compute[71498]: DEBUG nova.network.neutron [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Successfully updated port: f12d4d92-cf6a-4908-a203-d32ad80cb617 {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:46:24 user nova-compute[71498]: DEBUG nova.network.neutron [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Successfully updated port: 6517ba71-e7ec-4e68-8860-714bb4711368 {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:46:25 user nova-compute[71498]: DEBUG nova.compute.manager [req-b1e24ec5-f47c-4d97-affe-060f8436963d req-dcecd686-67ea-4a2a-8f36-1eae061a7000 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-changed-6532dff7-2168-407f-be9b-bdbea1b6edd4 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:25 user nova-compute[71498]: DEBUG nova.compute.manager [req-b1e24ec5-f47c-4d97-affe-060f8436963d req-dcecd686-67ea-4a2a-8f36-1eae061a7000 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Refreshing instance network info cache due to event network-changed-6532dff7-2168-407f-be9b-bdbea1b6edd4. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:46:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b1e24ec5-f47c-4d97-affe-060f8436963d req-dcecd686-67ea-4a2a-8f36-1eae061a7000 service nova] Acquiring lock "refresh_cache-4f8101aa-2078-4f0e-becb-62636c747c60" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:46:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b1e24ec5-f47c-4d97-affe-060f8436963d req-dcecd686-67ea-4a2a-8f36-1eae061a7000 service nova] Acquired lock "refresh_cache-4f8101aa-2078-4f0e-becb-62636c747c60" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:46:25 user nova-compute[71498]: DEBUG nova.network.neutron [req-b1e24ec5-f47c-4d97-affe-060f8436963d req-dcecd686-67ea-4a2a-8f36-1eae061a7000 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Refreshing network info cache for port 6532dff7-2168-407f-be9b-bdbea1b6edd4 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:46:25 user nova-compute[71498]: DEBUG nova.network.neutron [req-b1e24ec5-f47c-4d97-affe-060f8436963d req-dcecd686-67ea-4a2a-8f36-1eae061a7000 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:46:25 user nova-compute[71498]: DEBUG nova.network.neutron [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Successfully updated port: 9894ad9b-db8c-4729-bd7b-ebb28b91af2b {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:46:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "refresh_cache-4f8101aa-2078-4f0e-becb-62636c747c60" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:46:25 user nova-compute[71498]: DEBUG nova.network.neutron [req-b1e24ec5-f47c-4d97-affe-060f8436963d req-dcecd686-67ea-4a2a-8f36-1eae061a7000 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:46:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b1e24ec5-f47c-4d97-affe-060f8436963d req-dcecd686-67ea-4a2a-8f36-1eae061a7000 service nova] Releasing lock "refresh_cache-4f8101aa-2078-4f0e-becb-62636c747c60" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:46:25 user nova-compute[71498]: DEBUG nova.compute.manager [req-b1e24ec5-f47c-4d97-affe-060f8436963d req-dcecd686-67ea-4a2a-8f36-1eae061a7000 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-changed-f12d4d92-cf6a-4908-a203-d32ad80cb617 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:25 user nova-compute[71498]: DEBUG nova.compute.manager [req-b1e24ec5-f47c-4d97-affe-060f8436963d req-dcecd686-67ea-4a2a-8f36-1eae061a7000 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Refreshing instance network info cache due to event network-changed-f12d4d92-cf6a-4908-a203-d32ad80cb617. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:46:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b1e24ec5-f47c-4d97-affe-060f8436963d req-dcecd686-67ea-4a2a-8f36-1eae061a7000 service nova] Acquiring lock "refresh_cache-4f8101aa-2078-4f0e-becb-62636c747c60" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:46:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b1e24ec5-f47c-4d97-affe-060f8436963d req-dcecd686-67ea-4a2a-8f36-1eae061a7000 service nova] Acquired lock "refresh_cache-4f8101aa-2078-4f0e-becb-62636c747c60" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:46:25 user nova-compute[71498]: DEBUG nova.network.neutron [req-b1e24ec5-f47c-4d97-affe-060f8436963d req-dcecd686-67ea-4a2a-8f36-1eae061a7000 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Refreshing network info cache for port f12d4d92-cf6a-4908-a203-d32ad80cb617 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:46:26 user nova-compute[71498]: DEBUG nova.network.neutron [req-b1e24ec5-f47c-4d97-affe-060f8436963d req-dcecd686-67ea-4a2a-8f36-1eae061a7000 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:46:26 user nova-compute[71498]: DEBUG nova.network.neutron [req-b1e24ec5-f47c-4d97-affe-060f8436963d req-dcecd686-67ea-4a2a-8f36-1eae061a7000 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:46:26 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:46:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b1e24ec5-f47c-4d97-affe-060f8436963d req-dcecd686-67ea-4a2a-8f36-1eae061a7000 service nova] Releasing lock "refresh_cache-4f8101aa-2078-4f0e-becb-62636c747c60" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:46:26 user nova-compute[71498]: DEBUG nova.compute.manager [req-b1e24ec5-f47c-4d97-affe-060f8436963d req-dcecd686-67ea-4a2a-8f36-1eae061a7000 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-changed-6517ba71-e7ec-4e68-8860-714bb4711368 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:26 user nova-compute[71498]: DEBUG nova.compute.manager [req-b1e24ec5-f47c-4d97-affe-060f8436963d req-dcecd686-67ea-4a2a-8f36-1eae061a7000 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Refreshing instance network info cache due to event network-changed-6517ba71-e7ec-4e68-8860-714bb4711368. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:46:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b1e24ec5-f47c-4d97-affe-060f8436963d req-dcecd686-67ea-4a2a-8f36-1eae061a7000 service nova] Acquiring lock "refresh_cache-4f8101aa-2078-4f0e-becb-62636c747c60" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:46:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b1e24ec5-f47c-4d97-affe-060f8436963d req-dcecd686-67ea-4a2a-8f36-1eae061a7000 service nova] Acquired lock "refresh_cache-4f8101aa-2078-4f0e-becb-62636c747c60" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:46:26 user nova-compute[71498]: DEBUG nova.network.neutron [req-b1e24ec5-f47c-4d97-affe-060f8436963d req-dcecd686-67ea-4a2a-8f36-1eae061a7000 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Refreshing network info cache for port 6517ba71-e7ec-4e68-8860-714bb4711368 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:46:26 user nova-compute[71498]: INFO nova.virt.block_device [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Booting with volume ae6f77e9-ea6d-4653-9cd8-5944d88d743d at /dev/vdc
Apr 14 01:46:26 user nova-compute[71498]: DEBUG nova.network.neutron [req-b1e24ec5-f47c-4d97-affe-060f8436963d req-dcecd686-67ea-4a2a-8f36-1eae061a7000 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:46:26 user nova-compute[71498]: DEBUG os_brick.utils [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:46:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:26 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e560e6b3-5a0b-45de-a4e7-d85335f5297b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:26 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f82d5b-a1e2-4a79-b6cb-7f275b8744e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:26 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f38819-cf80-4f40-b9ba-5a205bcebeb2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:26 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec30cc7-632c-44de-998a-95630dec4329]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:46:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:46:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:46:26 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:46:26 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4a10dc-73d0-4171-a556-4e15b9da8f2c]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:46:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:46:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:46:26 user nova-compute[71498]: DEBUG os_brick.utils [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:46:26 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Updating existing volume attachment record: 4cee129c-6fa5-4659-99e5-1312f60e47ad {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:46:26 user nova-compute[71498]: DEBUG nova.network.neutron [req-b1e24ec5-f47c-4d97-affe-060f8436963d req-dcecd686-67ea-4a2a-8f36-1eae061a7000 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:46:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b1e24ec5-f47c-4d97-affe-060f8436963d req-dcecd686-67ea-4a2a-8f36-1eae061a7000 service nova] Releasing lock "refresh_cache-4f8101aa-2078-4f0e-becb-62636c747c60" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:46:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquired lock "refresh_cache-4f8101aa-2078-4f0e-becb-62636c747c60" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:46:26 user nova-compute[71498]: DEBUG nova.network.neutron [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:46:26 user nova-compute[71498]: DEBUG nova.network.neutron [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:46:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a873dec1-6168-43a5-86d8-3128b88a6241 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a873dec1-6168-43a5-86d8-3128b88a6241 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a873dec1-6168-43a5-86d8-3128b88a6241 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a873dec1-6168-43a5-86d8-3128b88a6241 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a873dec1-6168-43a5-86d8-3128b88a6241 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:27 user nova-compute[71498]: INFO nova.compute.manager [None req-a873dec1-6168-43a5-86d8-3128b88a6241 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Terminating instance
Apr 14 01:46:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-a873dec1-6168-43a5-86d8-3128b88a6241 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 01:46:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "5803c8ed-f1fe-47ae-aaba-13b7cd8831ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "5803c8ed-f1fe-47ae-aaba-13b7cd8831ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "5803c8ed-f1fe-47ae-aaba-13b7cd8831ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "5803c8ed-f1fe-47ae-aaba-13b7cd8831ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "5803c8ed-f1fe-47ae-aaba-13b7cd8831ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:27 user nova-compute[71498]: INFO nova.compute.manager [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Terminating instance
Apr 14 01:46:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 01:46:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:27 user nova-compute[71498]: DEBUG nova.compute.manager [req-f646d81b-eb72-440a-ad5a-c66c1ec4df2f req-b5447874-abff-4cee-8f8d-5575762c6b6c service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-changed-9894ad9b-db8c-4729-bd7b-ebb28b91af2b {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:27 user nova-compute[71498]: DEBUG nova.compute.manager [req-f646d81b-eb72-440a-ad5a-c66c1ec4df2f req-b5447874-abff-4cee-8f8d-5575762c6b6c service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Refreshing instance network info cache due to event network-changed-9894ad9b-db8c-4729-bd7b-ebb28b91af2b. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:46:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f646d81b-eb72-440a-ad5a-c66c1ec4df2f req-b5447874-abff-4cee-8f8d-5575762c6b6c service nova] Acquiring lock "refresh_cache-4f8101aa-2078-4f0e-becb-62636c747c60" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:46:27 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:46:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Cleaning up deleted instances with incomplete migration  {{(pid=71498) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 01:46:27 user nova-compute[71498]: DEBUG nova.compute.manager [req-14d64de7-7d6b-4ebc-b510-28aab6a93a0c req-edddc064-cbe9-4017-b2a4-bfcd1172743b service nova] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Received event network-vif-unplugged-4a26ba3d-6834-41d3-a4a5-e72c2126b739 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-14d64de7-7d6b-4ebc-b510-28aab6a93a0c req-edddc064-cbe9-4017-b2a4-bfcd1172743b service nova] Acquiring lock "d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-14d64de7-7d6b-4ebc-b510-28aab6a93a0c req-edddc064-cbe9-4017-b2a4-bfcd1172743b service nova] Lock "d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-14d64de7-7d6b-4ebc-b510-28aab6a93a0c req-edddc064-cbe9-4017-b2a4-bfcd1172743b service nova] Lock "d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:27 user nova-compute[71498]: DEBUG nova.compute.manager [req-14d64de7-7d6b-4ebc-b510-28aab6a93a0c req-edddc064-cbe9-4017-b2a4-bfcd1172743b service nova] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] No waiting events found dispatching network-vif-unplugged-4a26ba3d-6834-41d3-a4a5-e72c2126b739 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:46:27 user nova-compute[71498]: DEBUG nova.compute.manager [req-14d64de7-7d6b-4ebc-b510-28aab6a93a0c req-edddc064-cbe9-4017-b2a4-bfcd1172743b service nova] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Received event network-vif-unplugged-4a26ba3d-6834-41d3-a4a5-e72c2126b739 for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:46:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:28 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Instance destroyed successfully.
Apr 14 01:46:28 user nova-compute[71498]: DEBUG nova.objects.instance [None req-a873dec1-6168-43a5-86d8-3128b88a6241 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lazy-loading 'resources' on Instance uuid d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:46:28 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Instance destroyed successfully.
Apr 14 01:46:28 user nova-compute[71498]: DEBUG nova.objects.instance [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lazy-loading 'resources' on Instance uuid 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-a873dec1-6168-43a5-86d8-3128b88a6241 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:44:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1283417063',display_name='tempest-VolumesActionsTest-instance-1283417063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1283417063',id=16,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:44:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cdb176ac656c47b38e736fc629fc46e0',ramdisk_id='',reservation_id='r-psck70kq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-193871514',owner_user_name='tempest-VolumesActionsTest-193871514-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:44:43Z,user_data=None,user_id='8b18b911fcf847efbf4f814f3b687279',uuid=d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a26ba3d-6834-41d3-a4a5-e72c2126b739", "address": "fa:16:3e:08:10:c2", "network": {"id": "d2f0bf5d-7422-436e-82b2-95cfe8eb77bd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1126078103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cdb176ac656c47b38e736fc629fc46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a26ba3d-68", "ovs_interfaceid": "4a26ba3d-6834-41d3-a4a5-e72c2126b739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-a873dec1-6168-43a5-86d8-3128b88a6241 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Converting VIF {"id": "4a26ba3d-6834-41d3-a4a5-e72c2126b739", "address": "fa:16:3e:08:10:c2", "network": {"id": "d2f0bf5d-7422-436e-82b2-95cfe8eb77bd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1126078103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cdb176ac656c47b38e736fc629fc46e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a26ba3d-68", "ovs_interfaceid": "4a26ba3d-6834-41d3-a4a5-e72c2126b739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-a873dec1-6168-43a5-86d8-3128b88a6241 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:10:c2,bridge_name='br-int',has_traffic_filtering=True,id=4a26ba3d-6834-41d3-a4a5-e72c2126b739,network=Network(d2f0bf5d-7422-436e-82b2-95cfe8eb77bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a26ba3d-68') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG os_vif [None req-a873dec1-6168-43a5-86d8-3128b88a6241 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:10:c2,bridge_name='br-int',has_traffic_filtering=True,id=4a26ba3d-6834-41d3-a4a5-e72c2126b739,network=Network(d2f0bf5d-7422-436e-82b2-95cfe8eb77bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a26ba3d-68') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:44:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-551698746',display_name='tempest-TestVolumeBootPattern-server-551698746',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-551698746',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:44:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1f4117a4adb4aa3b42951cf1fc84237',ramdisk_id='',reservation_id='r-50vvtev6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-224521177',owner_user_name='tempest-TestVolumeBootPattern-224521177-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:44:55Z,user_data=None,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',uuid=5803c8ed-f1fe-47ae-aaba-13b7cd8831ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e60c256-3f3d-4a16-bf10-d7b22347ec4f", "address": "fa:16:3e:6e:a2:56", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e60c256-3f", "ovs_interfaceid": "7e60c256-3f3d-4a16-bf10-d7b22347ec4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converting VIF {"id": "7e60c256-3f3d-4a16-bf10-d7b22347ec4f", "address": "fa:16:3e:6e:a2:56", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e60c256-3f", "ovs_interfaceid": "7e60c256-3f3d-4a16-bf10-d7b22347ec4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:a2:56,bridge_name='br-int',has_traffic_filtering=True,id=7e60c256-3f3d-4a16-bf10-d7b22347ec4f,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e60c256-3f') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG os_vif [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:a2:56,bridge_name='br-int',has_traffic_filtering=True,id=7e60c256-3f3d-4a16-bf10-d7b22347ec4f,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e60c256-3f') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a26ba3d-68, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e60c256-3f, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:28 user nova-compute[71498]: INFO os_vif [None req-a873dec1-6168-43a5-86d8-3128b88a6241 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:10:c2,bridge_name='br-int',has_traffic_filtering=True,id=4a26ba3d-6834-41d3-a4a5-e72c2126b739,network=Network(d2f0bf5d-7422-436e-82b2-95cfe8eb77bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a26ba3d-68')
Apr 14 01:46:28 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-a873dec1-6168-43a5-86d8-3128b88a6241 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Deleting instance files /opt/stack/data/nova/instances/d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb_del
Apr 14 01:46:28 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-a873dec1-6168-43a5-86d8-3128b88a6241 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Deletion of /opt/stack/data/nova/instances/d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb_del complete
Apr 14 01:46:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:46:28 user nova-compute[71498]: INFO os_vif [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:a2:56,bridge_name='br-int',has_traffic_filtering=True,id=7e60c256-3f3d-4a16-bf10-d7b22347ec4f,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e60c256-3f')
Apr 14 01:46:28 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LsEAhbUg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:46:28 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:46:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[107edfd4-1db8-4686-adfc-968089fc1697]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:46:28 user nova-compute[71498]: No targets found.
Apr 14 01:46:28 user nova-compute[71498]: iSNS:
Apr 14 01:46:28 user nova-compute[71498]: No targets found.
Apr 14 01:46:28 user nova-compute[71498]: STATIC:
Apr 14 01:46:28 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53
Apr 14 01:46:28 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:46:28 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:46:28 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d
Apr 14 01:46:28 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:46:28 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:46:28 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22
Apr 14 01:46:28 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:46:28 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:46:28 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79
Apr 14 01:46:28 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:46:28 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:46:28 user nova-compute[71498]: FIRMWARE:
Apr 14 01:46:28 user nova-compute[71498]: No targets found.
Apr 14 01:46:28 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:46:28 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:46:28 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:28 user nova-compute[71498]: INFO nova.compute.manager [None req-a873dec1-6168-43a5-86d8-3128b88a6241 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Took 1.08 seconds to destroy the instance on the hypervisor.
Apr 14 01:46:28 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-a873dec1-6168-43a5-86d8-3128b88a6241 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.037s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ccd18c-b7cc-46dc-837a-86e7365e060f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d7481b-0381-4314-9f66-fcb95a9a16dc]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:46:28 user nova-compute[71498]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)
Apr 14 01:46:28 user nova-compute[71498]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d (non-flash)
Apr 14 01:46:28 user nova-compute[71498]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:46:28 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:46:28 user nova-compute[71498]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)
Apr 14 01:46:28 user nova-compute[71498]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d (non-flash)
Apr 14 01:46:28 user nova-compute[71498]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:46:28 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51f44f65f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d'): ({'sdd'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Removing single pathed devices sdd {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a38034-d10c-4664-b44b-4fb60c501d6c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[280845b8-cf33-4e1a-9c2c-bf48cb1a570e]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Flushing IO for device /dev/sdd {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1178064-8b59-49ee-a079-a4a10199ebad]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e962f284-ab59-4484-8afb-73a6faa09955]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] SCSI volumes sdd have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO63d21d99-8755e0a3c59290ab', '/dev/disk/by-id/scsi-23837353565306133', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_63d21d99') {{(pid=81721) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[efff381f-181a-4d06-8d75-96cbde2e1e35]: (4, None) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7f2837-ca81-4d7d-a2fc-efe35c6d65e5]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7f951f-adae-47d6-a678-5885eda469c0]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d, portal: 172.16.0.220,3260]
Apr 14 01:46:28 user nova-compute[71498]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d, portal: 172.16.0.220,3260] successful.
Apr 14 01:46:28 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ab38ffd-6daf-4153-b3eb-8817849e499d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[68438b5f-ea89-4b02-9330-4249433ea112]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] <== disconnect_volume: return (413ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:46:28 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Deleting instance files /opt/stack/data/nova/instances/5803c8ed-f1fe-47ae-aaba-13b7cd8831ae_del
Apr 14 01:46:28 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Deletion of /opt/stack/data/nova/instances/5803c8ed-f1fe-47ae-aaba-13b7cd8831ae_del complete
Apr 14 01:46:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:28 user nova-compute[71498]: INFO nova.compute.manager [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Took 1.58 seconds to destroy the instance on the hypervisor.
Apr 14 01:46:28 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:46:28 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Took 0.53 seconds to deallocate network for instance.
Apr 14 01:46:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a873dec1-6168-43a5-86d8-3128b88a6241 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a873dec1-6168-43a5-86d8-3128b88a6241 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:29 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:46:29 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Took 0.45 seconds to deallocate network for instance.
Apr 14 01:46:29 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-a873dec1-6168-43a5-86d8-3128b88a6241 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:46:29 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-a873dec1-6168-43a5-86d8-3128b88a6241 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:46:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a873dec1-6168-43a5-86d8-3128b88a6241 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.426s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:29 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-a873dec1-6168-43a5-86d8-3128b88a6241 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Deleted allocations for instance d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb
Apr 14 01:46:29 user nova-compute[71498]: DEBUG nova.network.neutron [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Updating instance_info_cache with network_info: [{"id": "0912c834-ed73-4f3a-9419-2c08d6094b93", "address": "fa:16:3e:6f:18:a2", "network": {"id": "92cd3f98-b66a-42aa-a5fa-47916885d4d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1332848290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912c834-ed", "ovs_interfaceid": "0912c834-ed73-4f3a-9419-2c08d6094b93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e9a3669-2ccb-49fc-a153-dfcee715ad41", "address": "fa:16:3e:c6:76:24", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e9a3669-2c", "ovs_interfaceid": "4e9a3669-2ccb-49fc-a153-dfcee715ad41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a", "address": "fa:16:3e:b5:e1:f6", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c1d9b5-b9", "ovs_interfaceid": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6532dff7-2168-407f-be9b-bdbea1b6edd4", "address": "fa:16:3e:03:01:eb", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6532dff7-21", "ovs_interfaceid": "6532dff7-2168-407f-be9b-bdbea1b6edd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f12d4d92-cf6a-4908-a203-d32ad80cb617", "address": "fa:16:3e:45:3e:13", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12d4d92-cf", "ovs_interfaceid": "f12d4d92-cf6a-4908-a203-d32ad80cb617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6517ba71-e7ec-4e68-8860-714bb4711368", "address": "fa:16:3e:f2:29:a3", "network": {"id": "7b28d758-6a84-4044-814b-714f0f210494", "bridge": "br-int", "label": "tempest-device-tagging-net2-2125292444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6517ba71-e7", "ovs_interfaceid": "6517ba71-e7ec-4e68-8860-714bb4711368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9894ad9b-db8c-4729-bd7b-ebb28b91af2b", "address": "fa:16:3e:e0:e1:5b", "network": {"id": "7b28d758-6a84-4044-814b-714f0f210494", "bridge": "br-int", "label": "tempest-device-tagging-net2-2125292444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9894ad9b-db", "ovs_interfaceid": "9894ad9b-db8c-4729-bd7b-ebb28b91af2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:46:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a873dec1-6168-43a5-86d8-3128b88a6241 tempest-VolumesActionsTest-193871514 tempest-VolumesActionsTest-193871514-project-member] Lock "d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.238s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:29 user nova-compute[71498]: DEBUG nova.compute.manager [req-4469d4bf-773c-41de-804c-c31adcb655ba req-ef3a227c-8d9f-487c-b77d-09dc37df8076 service nova] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Received event network-vif-deleted-4a26ba3d-6834-41d3-a4a5-e72c2126b739 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:29 user nova-compute[71498]: DEBUG nova.compute.manager [req-4469d4bf-773c-41de-804c-c31adcb655ba req-ef3a227c-8d9f-487c-b77d-09dc37df8076 service nova] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Received event network-vif-deleted-7e60c256-3f3d-4a16-bf10-d7b22347ec4f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Releasing lock "refresh_cache-4f8101aa-2078-4f0e-becb-62636c747c60" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:46:29 user nova-compute[71498]: DEBUG nova.compute.manager [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Instance network_info: |[{"id": "0912c834-ed73-4f3a-9419-2c08d6094b93", "address": "fa:16:3e:6f:18:a2", "network": {"id": "92cd3f98-b66a-42aa-a5fa-47916885d4d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1332848290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912c834-ed", "ovs_interfaceid": "0912c834-ed73-4f3a-9419-2c08d6094b93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e9a3669-2ccb-49fc-a153-dfcee715ad41", "address": "fa:16:3e:c6:76:24", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e9a3669-2c", "ovs_interfaceid": "4e9a3669-2ccb-49fc-a153-dfcee715ad41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a", "address": "fa:16:3e:b5:e1:f6", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c1d9b5-b9", "ovs_interfaceid": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6532dff7-2168-407f-be9b-bdbea1b6edd4", "address": "fa:16:3e:03:01:eb", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6532dff7-21", "ovs_interfaceid": "6532dff7-2168-407f-be9b-bdbea1b6edd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f12d4d92-cf6a-4908-a203-d32ad80cb617", "address": "fa:16:3e:45:3e:13", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12d4d92-cf", "ovs_interfaceid": "f12d4d92-cf6a-4908-a203-d32ad80cb617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6517ba71-e7ec-4e68-8860-714bb4711368", "address": "fa:16:3e:f2:29:a3", "network": {"id": "7b28d758-6a84-4044-814b-714f0f210494", "bridge": "br-int", "label": "tempest-device-tagging-net2-2125292444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6517ba71-e7", "ovs_interfaceid": "6517ba71-e7ec-4e68-8860-714bb4711368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9894ad9b-db8c-4729-bd7b-ebb28b91af2b", "address": "fa:16:3e:e0:e1:5b", "network": {"id": "7b28d758-6a84-4044-814b-714f0f210494", "bridge": "br-int", "label": "tempest-device-tagging-net2-2125292444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9894ad9b-db", "ovs_interfaceid": "9894ad9b-db8c-4729-bd7b-ebb28b91af2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 01:46:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f646d81b-eb72-440a-ad5a-c66c1ec4df2f req-b5447874-abff-4cee-8f8d-5575762c6b6c service nova] Acquired lock "refresh_cache-4f8101aa-2078-4f0e-becb-62636c747c60" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:46:29 user nova-compute[71498]: DEBUG nova.network.neutron [req-f646d81b-eb72-440a-ad5a-c66c1ec4df2f req-b5447874-abff-4cee-8f8d-5575762c6b6c service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Refreshing network info cache for port 9894ad9b-db8c-4729-bd7b-ebb28b91af2b {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:46:29 user nova-compute[71498]: DEBUG nova.compute.manager [req-1476e6a1-f271-491d-b662-5c29c97a4af6 req-9869fb30-ceae-49ed-b50a-f10611cdf64b service nova] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Received event network-vif-plugged-4a26ba3d-6834-41d3-a4a5-e72c2126b739 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1476e6a1-f271-491d-b662-5c29c97a4af6 req-9869fb30-ceae-49ed-b50a-f10611cdf64b service nova] Acquiring lock "d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1476e6a1-f271-491d-b662-5c29c97a4af6 req-9869fb30-ceae-49ed-b50a-f10611cdf64b service nova] Lock "d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1476e6a1-f271-491d-b662-5c29c97a4af6 req-9869fb30-ceae-49ed-b50a-f10611cdf64b service nova] Lock "d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:29 user nova-compute[71498]: DEBUG nova.compute.manager [req-1476e6a1-f271-491d-b662-5c29c97a4af6 req-9869fb30-ceae-49ed-b50a-f10611cdf64b service nova] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] No waiting events found dispatching network-vif-plugged-4a26ba3d-6834-41d3-a4a5-e72c2126b739 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:46:29 user nova-compute[71498]: WARNING nova.compute.manager [req-1476e6a1-f271-491d-b662-5c29c97a4af6 req-9869fb30-ceae-49ed-b50a-f10611cdf64b service nova] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Received unexpected event network-vif-plugged-4a26ba3d-6834-41d3-a4a5-e72c2126b739 for instance with vm_state deleted and task_state None.
Apr 14 01:46:29 user nova-compute[71498]: DEBUG nova.compute.manager [req-1476e6a1-f271-491d-b662-5c29c97a4af6 req-9869fb30-ceae-49ed-b50a-f10611cdf64b service nova] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Received event network-vif-unplugged-7e60c256-3f3d-4a16-bf10-d7b22347ec4f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1476e6a1-f271-491d-b662-5c29c97a4af6 req-9869fb30-ceae-49ed-b50a-f10611cdf64b service nova] Acquiring lock "5803c8ed-f1fe-47ae-aaba-13b7cd8831ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1476e6a1-f271-491d-b662-5c29c97a4af6 req-9869fb30-ceae-49ed-b50a-f10611cdf64b service nova] Lock "5803c8ed-f1fe-47ae-aaba-13b7cd8831ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1476e6a1-f271-491d-b662-5c29c97a4af6 req-9869fb30-ceae-49ed-b50a-f10611cdf64b service nova] Lock "5803c8ed-f1fe-47ae-aaba-13b7cd8831ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:29 user nova-compute[71498]: DEBUG nova.compute.manager [req-1476e6a1-f271-491d-b662-5c29c97a4af6 req-9869fb30-ceae-49ed-b50a-f10611cdf64b service nova] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] No waiting events found dispatching network-vif-unplugged-7e60c256-3f3d-4a16-bf10-d7b22347ec4f {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:46:29 user nova-compute[71498]: DEBUG nova.compute.manager [req-1476e6a1-f271-491d-b662-5c29c97a4af6 req-9869fb30-ceae-49ed-b50a-f10611cdf64b service nova] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Received event network-vif-unplugged-7e60c256-3f3d-4a16-bf10-d7b22347ec4f for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:46:29 user nova-compute[71498]: DEBUG nova.compute.manager [req-1476e6a1-f271-491d-b662-5c29c97a4af6 req-9869fb30-ceae-49ed-b50a-f10611cdf64b service nova] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Received event network-vif-plugged-7e60c256-3f3d-4a16-bf10-d7b22347ec4f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1476e6a1-f271-491d-b662-5c29c97a4af6 req-9869fb30-ceae-49ed-b50a-f10611cdf64b service nova] Acquiring lock "5803c8ed-f1fe-47ae-aaba-13b7cd8831ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1476e6a1-f271-491d-b662-5c29c97a4af6 req-9869fb30-ceae-49ed-b50a-f10611cdf64b service nova] Lock "5803c8ed-f1fe-47ae-aaba-13b7cd8831ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1476e6a1-f271-491d-b662-5c29c97a4af6 req-9869fb30-ceae-49ed-b50a-f10611cdf64b service nova] Lock "5803c8ed-f1fe-47ae-aaba-13b7cd8831ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:29 user nova-compute[71498]: DEBUG nova.compute.manager [req-1476e6a1-f271-491d-b662-5c29c97a4af6 req-9869fb30-ceae-49ed-b50a-f10611cdf64b service nova] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] No waiting events found dispatching network-vif-plugged-7e60c256-3f3d-4a16-bf10-d7b22347ec4f {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:46:29 user nova-compute[71498]: WARNING nova.compute.manager [req-1476e6a1-f271-491d-b662-5c29c97a4af6 req-9869fb30-ceae-49ed-b50a-f10611cdf64b service nova] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Received unexpected event network-vif-plugged-7e60c256-3f3d-4a16-bf10-d7b22347ec4f for instance with vm_state active and task_state deleting.
Apr 14 01:46:29 user nova-compute[71498]: DEBUG nova.network.neutron [req-f646d81b-eb72-440a-ad5a-c66c1ec4df2f req-b5447874-abff-4cee-8f8d-5575762c6b6c service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Updated VIF entry in instance network info cache for port 9894ad9b-db8c-4729-bd7b-ebb28b91af2b. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:46:29 user nova-compute[71498]: DEBUG nova.network.neutron [req-f646d81b-eb72-440a-ad5a-c66c1ec4df2f req-b5447874-abff-4cee-8f8d-5575762c6b6c service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Updating instance_info_cache with network_info: [{"id": "0912c834-ed73-4f3a-9419-2c08d6094b93", "address": "fa:16:3e:6f:18:a2", "network": {"id": "92cd3f98-b66a-42aa-a5fa-47916885d4d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1332848290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912c834-ed", "ovs_interfaceid": "0912c834-ed73-4f3a-9419-2c08d6094b93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e9a3669-2ccb-49fc-a153-dfcee715ad41", "address": "fa:16:3e:c6:76:24", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e9a3669-2c", "ovs_interfaceid": "4e9a3669-2ccb-49fc-a153-dfcee715ad41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a", "address": "fa:16:3e:b5:e1:f6", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c1d9b5-b9", "ovs_interfaceid": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6532dff7-2168-407f-be9b-bdbea1b6edd4", "address": "fa:16:3e:03:01:eb", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6532dff7-21", "ovs_interfaceid": "6532dff7-2168-407f-be9b-bdbea1b6edd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f12d4d92-cf6a-4908-a203-d32ad80cb617", "address": "fa:16:3e:45:3e:13", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12d4d92-cf", "ovs_interfaceid": "f12d4d92-cf6a-4908-a203-d32ad80cb617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6517ba71-e7ec-4e68-8860-714bb4711368", "address": "fa:16:3e:f2:29:a3", "network": {"id": "7b28d758-6a84-4044-814b-714f0f210494", "bridge": "br-int", "label": "tempest-device-tagging-net2-2125292444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6517ba71-e7", "ovs_interfaceid": "6517ba71-e7ec-4e68-8860-714bb4711368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9894ad9b-db8c-4729-bd7b-ebb28b91af2b", "address": "fa:16:3e:e0:e1:5b", "network": {"id": "7b28d758-6a84-4044-814b-714f0f210494", "bridge": "br-int", "label": "tempest-device-tagging-net2-2125292444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9894ad9b-db", "ovs_interfaceid": "9894ad9b-db8c-4729-bd7b-ebb28b91af2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:46:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f646d81b-eb72-440a-ad5a-c66c1ec4df2f req-b5447874-abff-4cee-8f8d-5575762c6b6c service nova] Releasing lock "refresh_cache-4f8101aa-2078-4f0e-becb-62636c747c60" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:46:29 user nova-compute[71498]: INFO nova.compute.manager [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Took 0.79 seconds to detach 1 volumes for instance.
Apr 14 01:46:29 user nova-compute[71498]: DEBUG nova.compute.manager [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Deleting volume: 4ab38ffd-6daf-4153-b3eb-8817849e499d {{(pid=71498) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 01:46:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:30 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:46:30 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:46:30 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:46:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.027s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:30 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 01:46:30 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Deleted allocations for instance 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae
Apr 14 01:46:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0386fb81-fb2a-4ea2-80d2-e258a5926c56 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "5803c8ed-f1fe-47ae-aaba-13b7cd8831ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.446s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:46:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fd9bc1-af0f-41e9-adea-d73323b4a76c/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG nova.compute.manager [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:46:31 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Creating image(s)
Apr 14 01:46:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Did not create local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Ensure instance console log exists: /opt/stack/data/nova/instances/4f8101aa-2078-4f0e-becb-62636c747c60/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Start _get_guest_xml network_info=[{"id": "0912c834-ed73-4f3a-9419-2c08d6094b93", "address": "fa:16:3e:6f:18:a2", "network": {"id": "92cd3f98-b66a-42aa-a5fa-47916885d4d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1332848290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912c834-ed", "ovs_interfaceid": "0912c834-ed73-4f3a-9419-2c08d6094b93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e9a3669-2ccb-49fc-a153-dfcee715ad41", "address": "fa:16:3e:c6:76:24", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e9a3669-2c", "ovs_interfaceid": "4e9a3669-2ccb-49fc-a153-dfcee715ad41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a", "address": "fa:16:3e:b5:e1:f6", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c1d9b5-b9", "ovs_interfaceid": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6532dff7-2168-407f-be9b-bdbea1b6edd4", "address": "fa:16:3e:03:01:eb", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6532dff7-21", "ovs_interfaceid": "6532dff7-2168-407f-be9b-bdbea1b6edd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f12d4d92-cf6a-4908-a203-d32ad80cb617", "address": "fa:16:3e:45:3e:13", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12d4d92-cf", "ovs_interfaceid": "f12d4d92-cf6a-4908-a203-d32ad80cb617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6517ba71-e7ec-4e68-8860-714bb4711368", "address": "fa:16:3e:f2:29:a3", "network": {"id": "7b28d758-6a84-4044-814b-714f0f210494", "bridge": "br-int", "label": "tempest-device-tagging-net2-2125292444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6517ba71-e7", "ovs_interfaceid": "6517ba71-e7ec-4e68-8860-714bb4711368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9894ad9b-db8c-4729-bd7b-ebb28b91af2b", "address": "fa:16:3e:e0:e1:5b", "network": {"id": "7b28d758-6a84-4044-814b-714f0f210494", "bridge": "br-int", "label": "tempest-device-tagging-net2-2125292444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9894ad9b-db", "ovs_interfaceid": "9894ad9b-db8c-4729-bd7b-ebb28b91af2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '39b50bc8-687b-4ade-ba07-779569acf68f', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pnIKHyQa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4f8101aa-2078-4f0e-becb-62636c747c60', 'attached_at': '', 'detached_at': '', 'volume_id': 'dccc3a21-0674-4347-842b-3d0354dfdfa8', 'serial': 'dccc3a21-0674-4347-842b-3d0354dfdfa8'}, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None}, {'attachment_id': '28e490a1-0ef3-4608-89a5-7f290c91b23b', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lUEoPgwk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4f8101aa-2078-4f0e-becb-62636c747c60', 'attached_at': '', 'detached_at': '', 'volume_id': 'f01988fc-537f-4359-9b58-2a3f4752251b', 'serial': 'f01988fc-537f-4359-9b58-2a3f4752251b'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': 1, 'device_type': 'disk', 'volume_type': None}, {'attachment_id': '4cee129c-6fa5-4659-99e5-1312f60e47ad', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wdltqivh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4f8101aa-2078-4f0e-becb-62636c747c60', 'attached_at': '', 'detached_at': '', 'volume_id': 'ae6f77e9-ea6d-4653-9cd8-5944d88d743d', 'serial': 'ae6f77e9-ea6d-4653-9cd8-5944d88d743d'}, 'mount_device': '/dev/vdc', 'guest_format': None, 'boot_index': 2, 'device_type': 'disk', 'volume_type': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:46:31 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:46:31 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:46:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pnIKHyQa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:46:31 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:46:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:46:31 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:46:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:46:31 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fd9bc1-af0f-41e9-adea-d73323b4a76c/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fd9bc1-af0f-41e9-adea-d73323b4a76c/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d6711f-eb7a-4c37-bb3f-7c5b644fcff9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:46:31 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1bd509-eacd-4d85-a88e-e5d64ab5cfa5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8] added
Apr 14 01:46:31 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf07aa7-a190-40bd-9112-b7433b1ae206]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4473f00-c937-4529-8d87-8be2e8e2928d]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pnIKHyQa {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pnIKHyQa" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fca3ed8-95c4-4d31-8941-96da62d70c65]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pnIKHyQa'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73fd9bc1-af0f-41e9-adea-d73323b4a76c/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded69976-2564-4f9e-b417-6e30bbe33bad]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5d0b22-f1d7-4f7b-a12b-e492f873ab87]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:46:31 user nova-compute[71498]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)
Apr 14 01:46:31 user nova-compute[71498]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:46:31 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:46:31 user nova-compute[71498]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)
Apr 14 01:46:31 user nova-compute[71498]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:46:31 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:46:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 -p 172.16.0.220:3260 --login" returned: 0 in 0.124s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:32 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a23da4c-9ecf-405f-b145-4367a2a418a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:32 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8, portal: 172.16.0.220,3260]
Apr 14 01:46:32 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8, portal: 172.16.0.220,3260] successful.
Apr 14 01:46:32 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:46:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:32 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c08e646-980f-423f-b3ce-7b8ae5cd6aa9]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:32 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:46:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:32 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7362b67-23db-4ce9-afc2-911138917a85]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:32 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:46:32 user nova-compute[71498]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)
Apr 14 01:46:32 user nova-compute[71498]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:46:32 user nova-compute[71498]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)
Apr 14 01:46:32 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:46:32 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:46:32 user nova-compute[71498]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)
Apr 14 01:46:32 user nova-compute[71498]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:46:32 user nova-compute[71498]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)
Apr 14 01:46:32 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:46:32 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.502s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:46:32 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:46:32 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:46:32 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:46:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:32 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d891f6ec-c3cd-4b03-bccb-eb582ec02004]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:32 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:46:32 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pnIKHyQa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:46:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.554s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] <== connect_volume: return (1557ms) {'type': 'block', 'scsi_wwn': '23230643437353862', 'path': '/dev/sdd'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230643437353862', 'path': '/dev/sdd'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lUEoPgwk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:46:33 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:46:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:46:33 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:46:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:46:33 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c05fef2-59aa-4959-aff8-cffadb309a88]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:46:33 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.033s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[420eedf2-92c1-4c81-a4ca-4e6038dfbfb3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b] added
Apr 14 01:46:33 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ba498b-bf04-4ac6-9e4e-bd719c648b7b]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dae5b95-1440-4c02-b899-0995bf59ef0e]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lUEoPgwk {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lUEoPgwk" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11e95ff-e1f7-47a4-81ad-0be4e9e64db7]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lUEoPgwk'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.052s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[863df85a-bdf9-4665-be23-53ef637fe21c]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1562ea-b845-448e-8c5e-1df688756c40]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:46:33 user nova-compute[71498]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)
Apr 14 01:46:33 user nova-compute[71498]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:46:33 user nova-compute[71498]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)
Apr 14 01:46:33 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:46:33 user nova-compute[71498]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)
Apr 14 01:46:33 user nova-compute[71498]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:46:33 user nova-compute[71498]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)
Apr 14 01:46:33 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[79701395-01ff-4796-827b-460ff0f4da32]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b, portal: 172.16.0.220,3260]
Apr 14 01:46:33 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b, portal: 172.16.0.220,3260] successful.
Apr 14 01:46:33 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a211970-2646-4c44-8b27-4284f0fcb8a9]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b0e4af-19ab-44bb-942c-eee70a333415]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:46:33 user nova-compute[71498]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)
Apr 14 01:46:33 user nova-compute[71498]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:46:33 user nova-compute[71498]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)
Apr 14 01:46:33 user nova-compute[71498]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)
Apr 14 01:46:33 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:46:33 user nova-compute[71498]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)
Apr 14 01:46:33 user nova-compute[71498]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:46:33 user nova-compute[71498]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)
Apr 14 01:46:33 user nova-compute[71498]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)
Apr 14 01:46:33 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.431s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] HCTL ('37', '-', '-', 0) found on session 18 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a704d2-64fb-4228-876b-23e05e35af5a]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lUEoPgwk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:46:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:34 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:46:34 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:46:34 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=7345MB free_disk=26.31475830078125GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance da60f4f1-2474-453f-8f84-c95daf02431a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance f68784e7-578c-4a12-87d4-f35fbc5a1d59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance a19a1c08-5454-481b-bb5a-70c39ead9afc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance fa29c144-0ff9-4efb-a574-f521d18f08fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 74311da6-d6b8-4aea-b6ce-97db8da53800 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance ee4cf01f-8d33-4696-b6ec-7f188ee18026 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 4f8101aa-2078-4f0e-becb-62636c747c60 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.470s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] <== connect_volume: return (1473ms) {'type': 'block', 'scsi_wwn': '26331656236343039', 'path': '/dev/sdf'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331656236343039', 'path': '/dev/sdf'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wdltqivh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:46:34 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:46:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:46:34 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:46:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:46:34 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:46:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e54dca-5b51-438a-b9d8-bdc0afb87940]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:46:34 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fc7638-609a-4cb5-958d-aca1b909bc96]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d] added
Apr 14 01:46:34 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f8f8d4-ba3b-4915-9256-1d766f176b55]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1426153d-3592-4e9e-b5ad-7607b44146d7]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wdltqivh {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wdltqivh" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1bc5f9-fc0a-43e7-8b19-2d5f7f17c8d8]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wdltqivh'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a051cd98-e04d-46f5-a6a7-e916098db0ac]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[785449b1-a42d-4118-b910-757691577332]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:46:34 user nova-compute[71498]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)
Apr 14 01:46:34 user nova-compute[71498]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:46:34 user nova-compute[71498]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)
Apr 14 01:46:34 user nova-compute[71498]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)
Apr 14 01:46:34 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:46:34 user nova-compute[71498]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)
Apr 14 01:46:34 user nova-compute[71498]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:46:34 user nova-compute[71498]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)
Apr 14 01:46:34 user nova-compute[71498]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)
Apr 14 01:46:34 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:46:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[92592e80-1288-460a-be15-15bec38133e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d, portal: 172.16.0.220,3260]
Apr 14 01:46:35 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d, portal: 172.16.0.220,3260] successful.
Apr 14 01:46:35 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1579aa6c-4a47-41c5-a2fa-5626feb8865a]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa167fd7-309e-4ef9-b737-9d60425e4ef9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:46:35 user nova-compute[71498]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)
Apr 14 01:46:35 user nova-compute[71498]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:46:35 user nova-compute[71498]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)
Apr 14 01:46:35 user nova-compute[71498]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)
Apr 14 01:46:35 user nova-compute[71498]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)
Apr 14 01:46:35 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:46:35 user nova-compute[71498]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)
Apr 14 01:46:35 user nova-compute[71498]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:46:35 user nova-compute[71498]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)
Apr 14 01:46:35 user nova-compute[71498]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)
Apr 14 01:46:35 user nova-compute[71498]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)
Apr 14 01:46:35 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] HCTL ('38', '-', '-', 0) found on session 19 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.503s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c97a8de-fab6-49a0-823b-89003e5f673d]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Searching for a device in session 19 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wdltqivh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Rebuilding the list of instances to heal {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Skipping network cache update for instance because it is Building. {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-da60f4f1-2474-453f-8f84-c95daf02431a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-da60f4f1-2474-453f-8f84-c95daf02431a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG nova.objects.instance [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lazy-loading 'info_cache' on Instance uuid da60f4f1-2474-453f-8f84-c95daf02431a {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:46:35 user nova-compute[71498]: INFO nova.compute.manager [None req-ed536e27-08c1-42e1-882c-052f779dfdd4 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Unrescuing
Apr 14 01:46:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ed536e27-08c1-42e1-882c-052f779dfdd4 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "refresh_cache-3a3fb53f-7b4a-48d3-85ab-418bad435c07" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ed536e27-08c1-42e1-882c-052f779dfdd4 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquired lock "refresh_cache-3a3fb53f-7b4a-48d3-85ab-418bad435c07" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG nova.network.neutron [None req-ed536e27-08c1-42e1-882c-052f779dfdd4 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Updating instance_info_cache with network_info: [{"id": "b8356c3e-ccfb-44ae-8020-af80bcb28a43", "address": "fa:16:3e:ad:43:af", "network": {"id": "93155729-11d3-4eff-bbd2-8860a881e233", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047423124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "907f632263e04bf2a6c8ff1bae77a5c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8356c3e-cc", "ovs_interfaceid": "b8356c3e-ccfb-44ae-8020-af80bcb28a43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-da60f4f1-2474-453f-8f84-c95daf02431a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Cleaning up deleted instances {{(pid=71498) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 01:46:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] There are 0 instances to clean {{(pid=71498) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.network.neutron [None req-ed536e27-08c1-42e1-882c-052f779dfdd4 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Updating instance_info_cache with network_info: [{"id": "7942720d-0958-4826-bedf-0a7eebfe45b6", "address": "fa:16:3e:0c:0e:df", "network": {"id": "95555a4e-9d95-4509-a683-f61ea2dc38a1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-560359898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4833ddea1fa74866b97ef52a730605aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7942720d-09", "ovs_interfaceid": "7942720d-0958-4826-bedf-0a7eebfe45b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ed536e27-08c1-42e1-882c-052f779dfdd4 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Releasing lock "refresh_cache-3a3fb53f-7b4a-48d3-85ab-418bad435c07" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.objects.instance [None req-ed536e27-08c1-42e1-882c-052f779dfdd4 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lazy-loading 'flavor' on Instance uuid 3a3fb53f-7b4a-48d3-85ab-418bad435c07 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23530663837633466', 'path': '/dev/sdg'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530663837633466', 'path': '/dev/sdg'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:46:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1084378513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1084378513',id=22,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYcWoVO7ZIi629hlkoHGAWtZdBozaG+O8MlSk2AwbH3DI+89IdiX5w/s5MTTIPas7dysNJjR6PIkb1jVAoIejGsoq6jIv/+Zz3sXz4wQO4UkFM2Gq/c7mopuRv8MulFtQ==',key_name='tempest-keypair-1639753774',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7782019f67b04982a58ed5272dc4cbb5',ramdisk_id='',reservation_id='r-0dgirqv3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-819739955',owner_user_name='tempest-TaggedBootDevicesTest_v242-819739955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:46:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e5234d2ffe4dc898d22be4bd648c47',uuid=4f8101aa-2078-4f0e-becb-62636c747c60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0912c834-ed73-4f3a-9419-2c08d6094b93", "address": "fa:16:3e:6f:18:a2", "network": {"id": "92cd3f98-b66a-42aa-a5fa-47916885d4d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1332848290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912c834-ed", "ovs_interfaceid": "0912c834-ed73-4f3a-9419-2c08d6094b93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converting VIF {"id": "0912c834-ed73-4f3a-9419-2c08d6094b93", "address": "fa:16:3e:6f:18:a2", "network": {"id": "92cd3f98-b66a-42aa-a5fa-47916885d4d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1332848290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912c834-ed", "ovs_interfaceid": "0912c834-ed73-4f3a-9419-2c08d6094b93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:18:a2,bridge_name='br-int',has_traffic_filtering=True,id=0912c834-ed73-4f3a-9419-2c08d6094b93,network=Network(92cd3f98-b66a-42aa-a5fa-47916885d4d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0912c834-ed') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:46:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1084378513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1084378513',id=22,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYcWoVO7ZIi629hlkoHGAWtZdBozaG+O8MlSk2AwbH3DI+89IdiX5w/s5MTTIPas7dysNJjR6PIkb1jVAoIejGsoq6jIv/+Zz3sXz4wQO4UkFM2Gq/c7mopuRv8MulFtQ==',key_name='tempest-keypair-1639753774',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7782019f67b04982a58ed5272dc4cbb5',ramdisk_id='',reservation_id='r-0dgirqv3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-819739955',owner_user_name='tempest-TaggedBootDevicesTest_v242-819739955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:46:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e5234d2ffe4dc898d22be4bd648c47',uuid=4f8101aa-2078-4f0e-becb-62636c747c60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e9a3669-2ccb-49fc-a153-dfcee715ad41", "address": "fa:16:3e:c6:76:24", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e9a3669-2c", "ovs_interfaceid": "4e9a3669-2ccb-49fc-a153-dfcee715ad41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converting VIF {"id": "4e9a3669-2ccb-49fc-a153-dfcee715ad41", "address": "fa:16:3e:c6:76:24", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e9a3669-2c", "ovs_interfaceid": "4e9a3669-2ccb-49fc-a153-dfcee715ad41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:76:24,bridge_name='br-int',has_traffic_filtering=True,id=4e9a3669-2ccb-49fc-a153-dfcee715ad41,network=Network(3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4e9a3669-2c') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:46:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1084378513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1084378513',id=22,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYcWoVO7ZIi629hlkoHGAWtZdBozaG+O8MlSk2AwbH3DI+89IdiX5w/s5MTTIPas7dysNJjR6PIkb1jVAoIejGsoq6jIv/+Zz3sXz4wQO4UkFM2Gq/c7mopuRv8MulFtQ==',key_name='tempest-keypair-1639753774',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7782019f67b04982a58ed5272dc4cbb5',ramdisk_id='',reservation_id='r-0dgirqv3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-819739955',owner_user_name='tempest-TaggedBootDevicesTest_v242-819739955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:46:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e5234d2ffe4dc898d22be4bd648c47',uuid=4f8101aa-2078-4f0e-becb-62636c747c60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a", "address": "fa:16:3e:b5:e1:f6", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c1d9b5-b9", "ovs_interfaceid": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converting VIF {"id": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a", "address": "fa:16:3e:b5:e1:f6", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c1d9b5-b9", "ovs_interfaceid": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:e1:f6,bridge_name='br-int',has_traffic_filtering=True,id=b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a,network=Network(3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb1c1d9b5-b9') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:46:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1084378513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1084378513',id=22,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYcWoVO7ZIi629hlkoHGAWtZdBozaG+O8MlSk2AwbH3DI+89IdiX5w/s5MTTIPas7dysNJjR6PIkb1jVAoIejGsoq6jIv/+Zz3sXz4wQO4UkFM2Gq/c7mopuRv8MulFtQ==',key_name='tempest-keypair-1639753774',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7782019f67b04982a58ed5272dc4cbb5',ramdisk_id='',reservation_id='r-0dgirqv3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-819739955',owner_user_name='tempest-TaggedBootDevicesTest_v242-819739955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:46:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e5234d2ffe4dc898d22be4bd648c47',uuid=4f8101aa-2078-4f0e-becb-62636c747c60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6532dff7-2168-407f-be9b-bdbea1b6edd4", "address": "fa:16:3e:03:01:eb", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6532dff7-21", "ovs_interfaceid": "6532dff7-2168-407f-be9b-bdbea1b6edd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converting VIF {"id": "6532dff7-2168-407f-be9b-bdbea1b6edd4", "address": "fa:16:3e:03:01:eb", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6532dff7-21", "ovs_interfaceid": "6532dff7-2168-407f-be9b-bdbea1b6edd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:01:eb,bridge_name='br-int',has_traffic_filtering=True,id=6532dff7-2168-407f-be9b-bdbea1b6edd4,network=Network(3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6532dff7-21') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:46:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1084378513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1084378513',id=22,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYcWoVO7ZIi629hlkoHGAWtZdBozaG+O8MlSk2AwbH3DI+89IdiX5w/s5MTTIPas7dysNJjR6PIkb1jVAoIejGsoq6jIv/+Zz3sXz4wQO4UkFM2Gq/c7mopuRv8MulFtQ==',key_name='tempest-keypair-1639753774',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7782019f67b04982a58ed5272dc4cbb5',ramdisk_id='',reservation_id='r-0dgirqv3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-819739955',owner_user_name='tempest-TaggedBootDevicesTest_v242-819739955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:46:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e5234d2ffe4dc898d22be4bd648c47',uuid=4f8101aa-2078-4f0e-becb-62636c747c60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f12d4d92-cf6a-4908-a203-d32ad80cb617", "address": "fa:16:3e:45:3e:13", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12d4d92-cf", "ovs_interfaceid": "f12d4d92-cf6a-4908-a203-d32ad80cb617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converting VIF {"id": "f12d4d92-cf6a-4908-a203-d32ad80cb617", "address": "fa:16:3e:45:3e:13", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12d4d92-cf", "ovs_interfaceid": "f12d4d92-cf6a-4908-a203-d32ad80cb617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:3e:13,bridge_name='br-int',has_traffic_filtering=True,id=f12d4d92-cf6a-4908-a203-d32ad80cb617,network=Network(3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf12d4d92-cf') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:46:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1084378513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1084378513',id=22,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYcWoVO7ZIi629hlkoHGAWtZdBozaG+O8MlSk2AwbH3DI+89IdiX5w/s5MTTIPas7dysNJjR6PIkb1jVAoIejGsoq6jIv/+Zz3sXz4wQO4UkFM2Gq/c7mopuRv8MulFtQ==',key_name='tempest-keypair-1639753774',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7782019f67b04982a58ed5272dc4cbb5',ramdisk_id='',reservation_id='r-0dgirqv3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-819739955',owner_user_name='tempest-TaggedBootDevicesTest_v242-819739955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:46:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e5234d2ffe4dc898d22be4bd648c47',uuid=4f8101aa-2078-4f0e-becb-62636c747c60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6517ba71-e7ec-4e68-8860-714bb4711368", "address": "fa:16:3e:f2:29:a3", "network": {"id": "7b28d758-6a84-4044-814b-714f0f210494", "bridge": "br-int", "label": "tempest-device-tagging-net2-2125292444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6517ba71-e7", "ovs_interfaceid": "6517ba71-e7ec-4e68-8860-714bb4711368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converting VIF {"id": "6517ba71-e7ec-4e68-8860-714bb4711368", "address": "fa:16:3e:f2:29:a3", "network": {"id": "7b28d758-6a84-4044-814b-714f0f210494", "bridge": "br-int", "label": "tempest-device-tagging-net2-2125292444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6517ba71-e7", "ovs_interfaceid": "6517ba71-e7ec-4e68-8860-714bb4711368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:29:a3,bridge_name='br-int',has_traffic_filtering=True,id=6517ba71-e7ec-4e68-8860-714bb4711368,network=Network(7b28d758-6a84-4044-814b-714f0f210494),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6517ba71-e7') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:46:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1084378513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1084378513',id=22,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYcWoVO7ZIi629hlkoHGAWtZdBozaG+O8MlSk2AwbH3DI+89IdiX5w/s5MTTIPas7dysNJjR6PIkb1jVAoIejGsoq6jIv/+Zz3sXz4wQO4UkFM2Gq/c7mopuRv8MulFtQ==',key_name='tempest-keypair-1639753774',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7782019f67b04982a58ed5272dc4cbb5',ramdisk_id='',reservation_id='r-0dgirqv3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-819739955',owner_user_name='tempest-TaggedBootDevicesTest_v242-819739955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:46:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e5234d2ffe4dc898d22be4bd648c47',uuid=4f8101aa-2078-4f0e-becb-62636c747c60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9894ad9b-db8c-4729-bd7b-ebb28b91af2b", "address": "fa:16:3e:e0:e1:5b", "network": {"id": "7b28d758-6a84-4044-814b-714f0f210494", "bridge": "br-int", "label": "tempest-device-tagging-net2-2125292444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9894ad9b-db", "ovs_interfaceid": "9894ad9b-db8c-4729-bd7b-ebb28b91af2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converting VIF {"id": "9894ad9b-db8c-4729-bd7b-ebb28b91af2b", "address": "fa:16:3e:e0:e1:5b", "network": {"id": "7b28d758-6a84-4044-814b-714f0f210494", "bridge": "br-int", "label": "tempest-device-tagging-net2-2125292444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9894ad9b-db", "ovs_interfaceid": "9894ad9b-db8c-4729-bd7b-ebb28b91af2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e1:5b,bridge_name='br-int',has_traffic_filtering=True,id=9894ad9b-db8c-4729-bd7b-ebb28b91af2b,network=Network(7b28d758-6a84-4044-814b-714f0f210494),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9894ad9b-db') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.objects.instance [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f8101aa-2078-4f0e-becb-62636c747c60 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:46:36 user nova-compute[71498]:   <uuid>4f8101aa-2078-4f0e-becb-62636c747c60</uuid>
Apr 14 01:46:36 user nova-compute[71498]:   <name>instance-00000016</name>
Apr 14 01:46:36 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:46:36 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:46:36 user nova-compute[71498]:   <metadata>
Apr 14 01:46:36 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:46:36 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:46:36 user nova-compute[71498]:       <nova:name>tempest-device-tagging-server-1084378513</nova:name>
Apr 14 01:46:36 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:46:31</nova:creationTime>
Apr 14 01:46:36 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:46:36 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:46:36 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:46:36 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:46:36 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:46:36 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:46:36 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:46:36 user nova-compute[71498]:       <nova:owner>
Apr 14 01:46:36 user nova-compute[71498]:         <nova:user uuid="c4e5234d2ffe4dc898d22be4bd648c47">tempest-TaggedBootDevicesTest_v242-819739955-project-member</nova:user>
Apr 14 01:46:36 user nova-compute[71498]:         <nova:project uuid="7782019f67b04982a58ed5272dc4cbb5">tempest-TaggedBootDevicesTest_v242-819739955</nova:project>
Apr 14 01:46:36 user nova-compute[71498]:       </nova:owner>
Apr 14 01:46:36 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:46:36 user nova-compute[71498]:       <nova:ports>
Apr 14 01:46:36 user nova-compute[71498]:         <nova:port uuid="0912c834-ed73-4f3a-9419-2c08d6094b93">
Apr 14 01:46:36 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 01:46:36 user nova-compute[71498]:         </nova:port>
Apr 14 01:46:36 user nova-compute[71498]:         <nova:port uuid="4e9a3669-2ccb-49fc-a153-dfcee715ad41">
Apr 14 01:46:36 user nova-compute[71498]:           <nova:ip type="fixed" address="10.1.1.175" ipVersion="4"/>
Apr 14 01:46:36 user nova-compute[71498]:         </nova:port>
Apr 14 01:46:36 user nova-compute[71498]:         <nova:port uuid="b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a">
Apr 14 01:46:36 user nova-compute[71498]:           <nova:ip type="fixed" address="10.1.1.203" ipVersion="4"/>
Apr 14 01:46:36 user nova-compute[71498]:         </nova:port>
Apr 14 01:46:36 user nova-compute[71498]:         <nova:port uuid="6532dff7-2168-407f-be9b-bdbea1b6edd4">
Apr 14 01:46:36 user nova-compute[71498]:           <nova:ip type="fixed" address="10.1.1.10" ipVersion="4"/>
Apr 14 01:46:36 user nova-compute[71498]:         </nova:port>
Apr 14 01:46:36 user nova-compute[71498]:         <nova:port uuid="f12d4d92-cf6a-4908-a203-d32ad80cb617">
Apr 14 01:46:36 user nova-compute[71498]:           <nova:ip type="fixed" address="10.1.1.38" ipVersion="4"/>
Apr 14 01:46:36 user nova-compute[71498]:         </nova:port>
Apr 14 01:46:36 user nova-compute[71498]:         <nova:port uuid="6517ba71-e7ec-4e68-8860-714bb4711368">
Apr 14 01:46:36 user nova-compute[71498]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 14 01:46:36 user nova-compute[71498]:         </nova:port>
Apr 14 01:46:36 user nova-compute[71498]:         <nova:port uuid="9894ad9b-db8c-4729-bd7b-ebb28b91af2b">
Apr 14 01:46:36 user nova-compute[71498]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 14 01:46:36 user nova-compute[71498]:         </nova:port>
Apr 14 01:46:36 user nova-compute[71498]:       </nova:ports>
Apr 14 01:46:36 user nova-compute[71498]:     </nova:instance>
Apr 14 01:46:36 user nova-compute[71498]:   </metadata>
Apr 14 01:46:36 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:46:36 user nova-compute[71498]:     <system>
Apr 14 01:46:36 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:46:36 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:46:36 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:46:36 user nova-compute[71498]:       <entry name="serial">4f8101aa-2078-4f0e-becb-62636c747c60</entry>
Apr 14 01:46:36 user nova-compute[71498]:       <entry name="uuid">4f8101aa-2078-4f0e-becb-62636c747c60</entry>
Apr 14 01:46:36 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:46:36 user nova-compute[71498]:     </system>
Apr 14 01:46:36 user nova-compute[71498]:   </sysinfo>
Apr 14 01:46:36 user nova-compute[71498]:   <os>
Apr 14 01:46:36 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:46:36 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:46:36 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:46:36 user nova-compute[71498]:   </os>
Apr 14 01:46:36 user nova-compute[71498]:   <features>
Apr 14 01:46:36 user nova-compute[71498]:     <acpi/>
Apr 14 01:46:36 user nova-compute[71498]:     <apic/>
Apr 14 01:46:36 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:46:36 user nova-compute[71498]:   </features>
Apr 14 01:46:36 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:46:36 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:46:36 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:46:36 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:46:36 user nova-compute[71498]:   </clock>
Apr 14 01:46:36 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:46:36 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:46:36 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:46:36 user nova-compute[71498]:   </cpu>
Apr 14 01:46:36 user nova-compute[71498]:   <devices>
Apr 14 01:46:36 user nova-compute[71498]:     <disk type="file" device="cdrom">
Apr 14 01:46:36 user nova-compute[71498]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 01:46:36 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/4f8101aa-2078-4f0e-becb-62636c747c60/disk.config"/>
Apr 14 01:46:36 user nova-compute[71498]:       <target dev="hda" bus="ide"/>
Apr 14 01:46:36 user nova-compute[71498]:     </disk>
Apr 14 01:46:36 user nova-compute[71498]:     <disk type="block" device="disk">
Apr 14 01:46:36 user nova-compute[71498]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:46:36 user nova-compute[71498]:       <source dev="/dev/sdd"/>
Apr 14 01:46:36 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:46:36 user nova-compute[71498]:       <serial>dccc3a21-0674-4347-842b-3d0354dfdfa8</serial>
Apr 14 01:46:36 user nova-compute[71498]:     </disk>
Apr 14 01:46:36 user nova-compute[71498]:     <disk type="block" device="disk">
Apr 14 01:46:36 user nova-compute[71498]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:46:36 user nova-compute[71498]:       <source dev="/dev/sdf"/>
Apr 14 01:46:36 user nova-compute[71498]:       <target dev="vdb" bus="virtio"/>
Apr 14 01:46:36 user nova-compute[71498]:       <serial>f01988fc-537f-4359-9b58-2a3f4752251b</serial>
Apr 14 01:46:36 user nova-compute[71498]:     </disk>
Apr 14 01:46:36 user nova-compute[71498]:     <disk type="block" device="disk">
Apr 14 01:46:36 user nova-compute[71498]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:46:36 user nova-compute[71498]:       <source dev="/dev/sdg"/>
Apr 14 01:46:36 user nova-compute[71498]:       <target dev="vdc" bus="virtio"/>
Apr 14 01:46:36 user nova-compute[71498]:       <serial>ae6f77e9-ea6d-4653-9cd8-5944d88d743d</serial>
Apr 14 01:46:36 user nova-compute[71498]:     </disk>
Apr 14 01:46:36 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:46:36 user nova-compute[71498]:       <mac address="fa:16:3e:6f:18:a2"/>
Apr 14 01:46:36 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:46:36 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:46:36 user nova-compute[71498]:       <target dev="tap0912c834-ed"/>
Apr 14 01:46:36 user nova-compute[71498]:     </interface>
Apr 14 01:46:36 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:46:36 user nova-compute[71498]:       <mac address="fa:16:3e:c6:76:24"/>
Apr 14 01:46:36 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:46:36 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:46:36 user nova-compute[71498]:       <target dev="tap4e9a3669-2c"/>
Apr 14 01:46:36 user nova-compute[71498]:     </interface>
Apr 14 01:46:36 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:46:36 user nova-compute[71498]:       <mac address="fa:16:3e:b5:e1:f6"/>
Apr 14 01:46:36 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:46:36 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:46:36 user nova-compute[71498]:       <target dev="tapb1c1d9b5-b9"/>
Apr 14 01:46:36 user nova-compute[71498]:     </interface>
Apr 14 01:46:36 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:46:36 user nova-compute[71498]:       <mac address="fa:16:3e:03:01:eb"/>
Apr 14 01:46:36 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:46:36 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:46:36 user nova-compute[71498]:       <target dev="tap6532dff7-21"/>
Apr 14 01:46:36 user nova-compute[71498]:     </interface>
Apr 14 01:46:36 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:46:36 user nova-compute[71498]:       <mac address="fa:16:3e:45:3e:13"/>
Apr 14 01:46:36 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:46:36 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:46:36 user nova-compute[71498]:       <target dev="tapf12d4d92-cf"/>
Apr 14 01:46:36 user nova-compute[71498]:     </interface>
Apr 14 01:46:36 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:46:36 user nova-compute[71498]:       <mac address="fa:16:3e:f2:29:a3"/>
Apr 14 01:46:36 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:46:36 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:46:36 user nova-compute[71498]:       <target dev="tap6517ba71-e7"/>
Apr 14 01:46:36 user nova-compute[71498]:     </interface>
Apr 14 01:46:36 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:46:36 user nova-compute[71498]:       <mac address="fa:16:3e:e0:e1:5b"/>
Apr 14 01:46:36 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:46:36 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:46:36 user nova-compute[71498]:       <target dev="tap9894ad9b-db"/>
Apr 14 01:46:36 user nova-compute[71498]:     </interface>
Apr 14 01:46:36 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:46:36 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/4f8101aa-2078-4f0e-becb-62636c747c60/console.log" append="off"/>
Apr 14 01:46:36 user nova-compute[71498]:     </serial>
Apr 14 01:46:36 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:46:36 user nova-compute[71498]:     <video>
Apr 14 01:46:36 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:46:36 user nova-compute[71498]:     </video>
Apr 14 01:46:36 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:46:36 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:46:36 user nova-compute[71498]:     </rng>
Apr 14 01:46:36 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:46:36 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:46:36 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:46:36 user nova-compute[71498]:     </memballoon>
Apr 14 01:46:36 user nova-compute[71498]:   </devices>
Apr 14 01:46:36 user nova-compute[71498]: </domain>
Apr 14 01:46:36 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:46:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1084378513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1084378513',id=22,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYcWoVO7ZIi629hlkoHGAWtZdBozaG+O8MlSk2AwbH3DI+89IdiX5w/s5MTTIPas7dysNJjR6PIkb1jVAoIejGsoq6jIv/+Zz3sXz4wQO4UkFM2Gq/c7mopuRv8MulFtQ==',key_name='tempest-keypair-1639753774',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7782019f67b04982a58ed5272dc4cbb5',ramdisk_id='',reservation_id='r-0dgirqv3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-819739955',owner_user_name='tempest-TaggedBootDevicesTest_v242-819739955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:46:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e5234d2ffe4dc898d22be4bd648c47',uuid=4f8101aa-2078-4f0e-becb-62636c747c60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0912c834-ed73-4f3a-9419-2c08d6094b93", "address": "fa:16:3e:6f:18:a2", "network": {"id": "92cd3f98-b66a-42aa-a5fa-47916885d4d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1332848290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912c834-ed", "ovs_interfaceid": "0912c834-ed73-4f3a-9419-2c08d6094b93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converting VIF {"id": "0912c834-ed73-4f3a-9419-2c08d6094b93", "address": "fa:16:3e:6f:18:a2", "network": {"id": "92cd3f98-b66a-42aa-a5fa-47916885d4d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1332848290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912c834-ed", "ovs_interfaceid": "0912c834-ed73-4f3a-9419-2c08d6094b93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:18:a2,bridge_name='br-int',has_traffic_filtering=True,id=0912c834-ed73-4f3a-9419-2c08d6094b93,network=Network(92cd3f98-b66a-42aa-a5fa-47916885d4d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0912c834-ed') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG os_vif [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:18:a2,bridge_name='br-int',has_traffic_filtering=True,id=0912c834-ed73-4f3a-9419-2c08d6094b93,network=Network(92cd3f98-b66a-42aa-a5fa-47916885d4d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0912c834-ed') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0912c834-ed, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0912c834-ed, col_values=(('external_ids', {'iface-id': '0912c834-ed73-4f3a-9419-2c08d6094b93', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:18:a2', 'vm-uuid': '4f8101aa-2078-4f0e-becb-62636c747c60'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:36 user nova-compute[71498]: INFO os_vif [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:18:a2,bridge_name='br-int',has_traffic_filtering=True,id=0912c834-ed73-4f3a-9419-2c08d6094b93,network=Network(92cd3f98-b66a-42aa-a5fa-47916885d4d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0912c834-ed')
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:46:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1084378513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1084378513',id=22,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYcWoVO7ZIi629hlkoHGAWtZdBozaG+O8MlSk2AwbH3DI+89IdiX5w/s5MTTIPas7dysNJjR6PIkb1jVAoIejGsoq6jIv/+Zz3sXz4wQO4UkFM2Gq/c7mopuRv8MulFtQ==',key_name='tempest-keypair-1639753774',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7782019f67b04982a58ed5272dc4cbb5',ramdisk_id='',reservation_id='r-0dgirqv3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-819739955',owner_user_name='tempest-TaggedBootDevicesTest_v242-819739955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:46:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e5234d2ffe4dc898d22be4bd648c47',uuid=4f8101aa-2078-4f0e-becb-62636c747c60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e9a3669-2ccb-49fc-a153-dfcee715ad41", "address": "fa:16:3e:c6:76:24", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e9a3669-2c", "ovs_interfaceid": "4e9a3669-2ccb-49fc-a153-dfcee715ad41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converting VIF {"id": "4e9a3669-2ccb-49fc-a153-dfcee715ad41", "address": "fa:16:3e:c6:76:24", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e9a3669-2c", "ovs_interfaceid": "4e9a3669-2ccb-49fc-a153-dfcee715ad41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:76:24,bridge_name='br-int',has_traffic_filtering=True,id=4e9a3669-2ccb-49fc-a153-dfcee715ad41,network=Network(3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4e9a3669-2c') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG os_vif [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:76:24,bridge_name='br-int',has_traffic_filtering=True,id=4e9a3669-2ccb-49fc-a153-dfcee715ad41,network=Network(3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4e9a3669-2c') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e9a3669-2c, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4e9a3669-2c, col_values=(('external_ids', {'iface-id': '4e9a3669-2ccb-49fc-a153-dfcee715ad41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:76:24', 'vm-uuid': '4f8101aa-2078-4f0e-becb-62636c747c60'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:36 user nova-compute[71498]: INFO os_vif [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:76:24,bridge_name='br-int',has_traffic_filtering=True,id=4e9a3669-2ccb-49fc-a153-dfcee715ad41,network=Network(3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4e9a3669-2c')
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:46:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1084378513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1084378513',id=22,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYcWoVO7ZIi629hlkoHGAWtZdBozaG+O8MlSk2AwbH3DI+89IdiX5w/s5MTTIPas7dysNJjR6PIkb1jVAoIejGsoq6jIv/+Zz3sXz4wQO4UkFM2Gq/c7mopuRv8MulFtQ==',key_name='tempest-keypair-1639753774',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7782019f67b04982a58ed5272dc4cbb5',ramdisk_id='',reservation_id='r-0dgirqv3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-819739955',owner_user_name='tempest-TaggedBootDevicesTest_v242-819739955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:46:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e5234d2ffe4dc898d22be4bd648c47',uuid=4f8101aa-2078-4f0e-becb-62636c747c60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a", "address": "fa:16:3e:b5:e1:f6", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c1d9b5-b9", "ovs_interfaceid": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converting VIF {"id": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a", "address": "fa:16:3e:b5:e1:f6", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c1d9b5-b9", "ovs_interfaceid": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:e1:f6,bridge_name='br-int',has_traffic_filtering=True,id=b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a,network=Network(3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb1c1d9b5-b9') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG os_vif [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:e1:f6,bridge_name='br-int',has_traffic_filtering=True,id=b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a,network=Network(3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb1c1d9b5-b9') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1c1d9b5-b9, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb1c1d9b5-b9, col_values=(('external_ids', {'iface-id': 'b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:e1:f6', 'vm-uuid': '4f8101aa-2078-4f0e-becb-62636c747c60'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:36 user nova-compute[71498]: INFO os_vif [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:e1:f6,bridge_name='br-int',has_traffic_filtering=True,id=b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a,network=Network(3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb1c1d9b5-b9')
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:46:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1084378513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1084378513',id=22,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYcWoVO7ZIi629hlkoHGAWtZdBozaG+O8MlSk2AwbH3DI+89IdiX5w/s5MTTIPas7dysNJjR6PIkb1jVAoIejGsoq6jIv/+Zz3sXz4wQO4UkFM2Gq/c7mopuRv8MulFtQ==',key_name='tempest-keypair-1639753774',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7782019f67b04982a58ed5272dc4cbb5',ramdisk_id='',reservation_id='r-0dgirqv3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-819739955',owner_user_name='tempest-TaggedBootDevicesTest_v242-819739955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:46:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e5234d2ffe4dc898d22be4bd648c47',uuid=4f8101aa-2078-4f0e-becb-62636c747c60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6532dff7-2168-407f-be9b-bdbea1b6edd4", "address": "fa:16:3e:03:01:eb", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6532dff7-21", "ovs_interfaceid": "6532dff7-2168-407f-be9b-bdbea1b6edd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converting VIF {"id": "6532dff7-2168-407f-be9b-bdbea1b6edd4", "address": "fa:16:3e:03:01:eb", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6532dff7-21", "ovs_interfaceid": "6532dff7-2168-407f-be9b-bdbea1b6edd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:01:eb,bridge_name='br-int',has_traffic_filtering=True,id=6532dff7-2168-407f-be9b-bdbea1b6edd4,network=Network(3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6532dff7-21') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG os_vif [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:01:eb,bridge_name='br-int',has_traffic_filtering=True,id=6532dff7-2168-407f-be9b-bdbea1b6edd4,network=Network(3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6532dff7-21') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6532dff7-21, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6532dff7-21, col_values=(('external_ids', {'iface-id': '6532dff7-2168-407f-be9b-bdbea1b6edd4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:01:eb', 'vm-uuid': '4f8101aa-2078-4f0e-becb-62636c747c60'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:36 user nova-compute[71498]: INFO os_vif [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:01:eb,bridge_name='br-int',has_traffic_filtering=True,id=6532dff7-2168-407f-be9b-bdbea1b6edd4,network=Network(3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6532dff7-21')
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:46:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1084378513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1084378513',id=22,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYcWoVO7ZIi629hlkoHGAWtZdBozaG+O8MlSk2AwbH3DI+89IdiX5w/s5MTTIPas7dysNJjR6PIkb1jVAoIejGsoq6jIv/+Zz3sXz4wQO4UkFM2Gq/c7mopuRv8MulFtQ==',key_name='tempest-keypair-1639753774',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7782019f67b04982a58ed5272dc4cbb5',ramdisk_id='',reservation_id='r-0dgirqv3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-819739955',owner_user_name='tempest-TaggedBootDevicesTest_v242-819739955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:46:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e5234d2ffe4dc898d22be4bd648c47',uuid=4f8101aa-2078-4f0e-becb-62636c747c60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f12d4d92-cf6a-4908-a203-d32ad80cb617", "address": "fa:16:3e:45:3e:13", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12d4d92-cf", "ovs_interfaceid": "f12d4d92-cf6a-4908-a203-d32ad80cb617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converting VIF {"id": "f12d4d92-cf6a-4908-a203-d32ad80cb617", "address": "fa:16:3e:45:3e:13", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12d4d92-cf", "ovs_interfaceid": "f12d4d92-cf6a-4908-a203-d32ad80cb617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:3e:13,bridge_name='br-int',has_traffic_filtering=True,id=f12d4d92-cf6a-4908-a203-d32ad80cb617,network=Network(3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf12d4d92-cf') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG os_vif [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:3e:13,bridge_name='br-int',has_traffic_filtering=True,id=f12d4d92-cf6a-4908-a203-d32ad80cb617,network=Network(3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf12d4d92-cf') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf12d4d92-cf, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf12d4d92-cf, col_values=(('external_ids', {'iface-id': 'f12d4d92-cf6a-4908-a203-d32ad80cb617', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:3e:13', 'vm-uuid': '4f8101aa-2078-4f0e-becb-62636c747c60'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:36 user nova-compute[71498]: INFO os_vif [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:3e:13,bridge_name='br-int',has_traffic_filtering=True,id=f12d4d92-cf6a-4908-a203-d32ad80cb617,network=Network(3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf12d4d92-cf')
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:46:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1084378513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1084378513',id=22,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYcWoVO7ZIi629hlkoHGAWtZdBozaG+O8MlSk2AwbH3DI+89IdiX5w/s5MTTIPas7dysNJjR6PIkb1jVAoIejGsoq6jIv/+Zz3sXz4wQO4UkFM2Gq/c7mopuRv8MulFtQ==',key_name='tempest-keypair-1639753774',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7782019f67b04982a58ed5272dc4cbb5',ramdisk_id='',reservation_id='r-0dgirqv3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-819739955',owner_user_name='tempest-TaggedBootDevicesTest_v242-819739955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:46:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e5234d2ffe4dc898d22be4bd648c47',uuid=4f8101aa-2078-4f0e-becb-62636c747c60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6517ba71-e7ec-4e68-8860-714bb4711368", "address": "fa:16:3e:f2:29:a3", "network": {"id": "7b28d758-6a84-4044-814b-714f0f210494", "bridge": "br-int", "label": "tempest-device-tagging-net2-2125292444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6517ba71-e7", "ovs_interfaceid": "6517ba71-e7ec-4e68-8860-714bb4711368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converting VIF {"id": "6517ba71-e7ec-4e68-8860-714bb4711368", "address": "fa:16:3e:f2:29:a3", "network": {"id": "7b28d758-6a84-4044-814b-714f0f210494", "bridge": "br-int", "label": "tempest-device-tagging-net2-2125292444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6517ba71-e7", "ovs_interfaceid": "6517ba71-e7ec-4e68-8860-714bb4711368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:29:a3,bridge_name='br-int',has_traffic_filtering=True,id=6517ba71-e7ec-4e68-8860-714bb4711368,network=Network(7b28d758-6a84-4044-814b-714f0f210494),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6517ba71-e7') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG os_vif [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:29:a3,bridge_name='br-int',has_traffic_filtering=True,id=6517ba71-e7ec-4e68-8860-714bb4711368,network=Network(7b28d758-6a84-4044-814b-714f0f210494),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6517ba71-e7') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6517ba71-e7, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6517ba71-e7, col_values=(('external_ids', {'iface-id': '6517ba71-e7ec-4e68-8860-714bb4711368', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:29:a3', 'vm-uuid': '4f8101aa-2078-4f0e-becb-62636c747c60'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:36 user nova-compute[71498]: INFO os_vif [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:29:a3,bridge_name='br-int',has_traffic_filtering=True,id=6517ba71-e7ec-4e68-8860-714bb4711368,network=Network(7b28d758-6a84-4044-814b-714f0f210494),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6517ba71-e7')
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:46:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1084378513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1084378513',id=22,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYcWoVO7ZIi629hlkoHGAWtZdBozaG+O8MlSk2AwbH3DI+89IdiX5w/s5MTTIPas7dysNJjR6PIkb1jVAoIejGsoq6jIv/+Zz3sXz4wQO4UkFM2Gq/c7mopuRv8MulFtQ==',key_name='tempest-keypair-1639753774',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7782019f67b04982a58ed5272dc4cbb5',ramdisk_id='',reservation_id='r-0dgirqv3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-819739955',owner_user_name='tempest-TaggedBootDevicesTest_v242-819739955-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:46:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e5234d2ffe4dc898d22be4bd648c47',uuid=4f8101aa-2078-4f0e-becb-62636c747c60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9894ad9b-db8c-4729-bd7b-ebb28b91af2b", "address": "fa:16:3e:e0:e1:5b", "network": {"id": "7b28d758-6a84-4044-814b-714f0f210494", "bridge": "br-int", "label": "tempest-device-tagging-net2-2125292444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9894ad9b-db", "ovs_interfaceid": "9894ad9b-db8c-4729-bd7b-ebb28b91af2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converting VIF {"id": "9894ad9b-db8c-4729-bd7b-ebb28b91af2b", "address": "fa:16:3e:e0:e1:5b", "network": {"id": "7b28d758-6a84-4044-814b-714f0f210494", "bridge": "br-int", "label": "tempest-device-tagging-net2-2125292444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9894ad9b-db", "ovs_interfaceid": "9894ad9b-db8c-4729-bd7b-ebb28b91af2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e1:5b,bridge_name='br-int',has_traffic_filtering=True,id=9894ad9b-db8c-4729-bd7b-ebb28b91af2b,network=Network(7b28d758-6a84-4044-814b-714f0f210494),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9894ad9b-db') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG os_vif [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e1:5b,bridge_name='br-int',has_traffic_filtering=True,id=9894ad9b-db8c-4729-bd7b-ebb28b91af2b,network=Network(7b28d758-6a84-4044-814b-714f0f210494),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9894ad9b-db') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9894ad9b-db, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9894ad9b-db, col_values=(('external_ids', {'iface-id': '9894ad9b-db8c-4729-bd7b-ebb28b91af2b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:e1:5b', 'vm-uuid': '4f8101aa-2078-4f0e-becb-62636c747c60'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.compute.manager [req-e8e22109-b190-44a0-8f18-20620326109e req-384159f5-9396-4c42-9b70-69ea74e703f6 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Received event network-vif-unplugged-7942720d-0958-4826-bedf-0a7eebfe45b6 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e8e22109-b190-44a0-8f18-20620326109e req-384159f5-9396-4c42-9b70-69ea74e703f6 service nova] Acquiring lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e8e22109-b190-44a0-8f18-20620326109e req-384159f5-9396-4c42-9b70-69ea74e703f6 service nova] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e8e22109-b190-44a0-8f18-20620326109e req-384159f5-9396-4c42-9b70-69ea74e703f6 service nova] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.compute.manager [req-e8e22109-b190-44a0-8f18-20620326109e req-384159f5-9396-4c42-9b70-69ea74e703f6 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] No waiting events found dispatching network-vif-unplugged-7942720d-0958-4826-bedf-0a7eebfe45b6 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:46:36 user nova-compute[71498]: WARNING nova.compute.manager [req-e8e22109-b190-44a0-8f18-20620326109e req-384159f5-9396-4c42-9b70-69ea74e703f6 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Received unexpected event network-vif-unplugged-7942720d-0958-4826-bedf-0a7eebfe45b6 for instance with vm_state rescued and task_state unrescuing.
Apr 14 01:46:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:36 user nova-compute[71498]: INFO os_vif [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e1:5b,bridge_name='br-int',has_traffic_filtering=True,id=9894ad9b-db8c-4729-bd7b-ebb28b91af2b,network=Network(7b28d758-6a84-4044-814b-714f0f210494),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9894ad9b-db')
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] No BDM found with device name hda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] No VIF found with MAC fa:16:3e:6f:18:a2, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] No VIF found with MAC fa:16:3e:45:3e:13, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:46:36 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Using config drive
Apr 14 01:46:36 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Instance destroyed successfully.
Apr 14 01:46:36 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Creating config drive at /opt/stack/data/nova/instances/4f8101aa-2078-4f0e-becb-62636c747c60/disk.config
Apr 14 01:46:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4f8101aa-2078-4f0e-becb-62636c747c60/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp4i01ynnw {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:46:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4f8101aa-2078-4f0e-becb-62636c747c60/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp4i01ynnw" returned: 0 in 0.055s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:46:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:38 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:46:38 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:46:38 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 01:46:38 user nova-compute[71498]: DEBUG nova.compute.manager [req-6f519318-fabb-450e-95a5-b085f777bfa3 req-ab72bc96-7614-4874-8768-795a88769b11 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Received event network-vif-plugged-7942720d-0958-4826-bedf-0a7eebfe45b6 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6f519318-fabb-450e-95a5-b085f777bfa3 req-ab72bc96-7614-4874-8768-795a88769b11 service nova] Acquiring lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6f519318-fabb-450e-95a5-b085f777bfa3 req-ab72bc96-7614-4874-8768-795a88769b11 service nova] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6f519318-fabb-450e-95a5-b085f777bfa3 req-ab72bc96-7614-4874-8768-795a88769b11 service nova] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:38 user nova-compute[71498]: DEBUG nova.compute.manager [req-6f519318-fabb-450e-95a5-b085f777bfa3 req-ab72bc96-7614-4874-8768-795a88769b11 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] No waiting events found dispatching network-vif-plugged-7942720d-0958-4826-bedf-0a7eebfe45b6 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:46:38 user nova-compute[71498]: WARNING nova.compute.manager [req-6f519318-fabb-450e-95a5-b085f777bfa3 req-ab72bc96-7614-4874-8768-795a88769b11 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Received unexpected event network-vif-plugged-7942720d-0958-4826-bedf-0a7eebfe45b6 for instance with vm_state rescued and task_state unrescuing.
Apr 14 01:46:38 user nova-compute[71498]: DEBUG nova.compute.manager [req-6f519318-fabb-450e-95a5-b085f777bfa3 req-ab72bc96-7614-4874-8768-795a88769b11 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Received event network-changed-7942720d-0958-4826-bedf-0a7eebfe45b6 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:38 user nova-compute[71498]: DEBUG nova.compute.manager [req-6f519318-fabb-450e-95a5-b085f777bfa3 req-ab72bc96-7614-4874-8768-795a88769b11 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Refreshing instance network info cache due to event network-changed-7942720d-0958-4826-bedf-0a7eebfe45b6. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:46:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6f519318-fabb-450e-95a5-b085f777bfa3 req-ab72bc96-7614-4874-8768-795a88769b11 service nova] Acquiring lock "refresh_cache-3a3fb53f-7b4a-48d3-85ab-418bad435c07" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:46:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6f519318-fabb-450e-95a5-b085f777bfa3 req-ab72bc96-7614-4874-8768-795a88769b11 service nova] Acquired lock "refresh_cache-3a3fb53f-7b4a-48d3-85ab-418bad435c07" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:46:38 user nova-compute[71498]: DEBUG nova.network.neutron [req-6f519318-fabb-450e-95a5-b085f777bfa3 req-ab72bc96-7614-4874-8768-795a88769b11 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Refreshing network info cache for port 7942720d-0958-4826-bedf-0a7eebfe45b6 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:46:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:39 user nova-compute[71498]: DEBUG nova.network.neutron [req-6f519318-fabb-450e-95a5-b085f777bfa3 req-ab72bc96-7614-4874-8768-795a88769b11 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Updated VIF entry in instance network info cache for port 7942720d-0958-4826-bedf-0a7eebfe45b6. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:46:39 user nova-compute[71498]: DEBUG nova.network.neutron [req-6f519318-fabb-450e-95a5-b085f777bfa3 req-ab72bc96-7614-4874-8768-795a88769b11 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Updating instance_info_cache with network_info: [{"id": "7942720d-0958-4826-bedf-0a7eebfe45b6", "address": "fa:16:3e:0c:0e:df", "network": {"id": "95555a4e-9d95-4509-a683-f61ea2dc38a1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-560359898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4833ddea1fa74866b97ef52a730605aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7942720d-09", "ovs_interfaceid": "7942720d-0958-4826-bedf-0a7eebfe45b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:46:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6f519318-fabb-450e-95a5-b085f777bfa3 req-ab72bc96-7614-4874-8768-795a88769b11 service nova] Releasing lock "refresh_cache-3a3fb53f-7b4a-48d3-85ab-418bad435c07" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:46:39 user nova-compute[71498]: DEBUG nova.compute.manager [req-6f519318-fabb-450e-95a5-b085f777bfa3 req-ab72bc96-7614-4874-8768-795a88769b11 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Received event network-changed-7942720d-0958-4826-bedf-0a7eebfe45b6 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:39 user nova-compute[71498]: DEBUG nova.compute.manager [req-6f519318-fabb-450e-95a5-b085f777bfa3 req-ab72bc96-7614-4874-8768-795a88769b11 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Refreshing instance network info cache due to event network-changed-7942720d-0958-4826-bedf-0a7eebfe45b6. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:46:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6f519318-fabb-450e-95a5-b085f777bfa3 req-ab72bc96-7614-4874-8768-795a88769b11 service nova] Acquiring lock "refresh_cache-3a3fb53f-7b4a-48d3-85ab-418bad435c07" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:46:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6f519318-fabb-450e-95a5-b085f777bfa3 req-ab72bc96-7614-4874-8768-795a88769b11 service nova] Acquired lock "refresh_cache-3a3fb53f-7b4a-48d3-85ab-418bad435c07" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:46:39 user nova-compute[71498]: DEBUG nova.network.neutron [req-6f519318-fabb-450e-95a5-b085f777bfa3 req-ab72bc96-7614-4874-8768-795a88769b11 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Refreshing network info cache for port 7942720d-0958-4826-bedf-0a7eebfe45b6 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:46:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:39 user nova-compute[71498]: DEBUG nova.compute.manager [req-055b7a27-ede1-46e0-bafe-460d3ab013e7 req-863d5b84-d6fe-482d-acab-cf13f8d0ab37 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-plugged-0912c834-ed73-4f3a-9419-2c08d6094b93 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-055b7a27-ede1-46e0-bafe-460d3ab013e7 req-863d5b84-d6fe-482d-acab-cf13f8d0ab37 service nova] Acquiring lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-055b7a27-ede1-46e0-bafe-460d3ab013e7 req-863d5b84-d6fe-482d-acab-cf13f8d0ab37 service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-055b7a27-ede1-46e0-bafe-460d3ab013e7 req-863d5b84-d6fe-482d-acab-cf13f8d0ab37 service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:39 user nova-compute[71498]: DEBUG nova.compute.manager [req-055b7a27-ede1-46e0-bafe-460d3ab013e7 req-863d5b84-d6fe-482d-acab-cf13f8d0ab37 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] No waiting events found dispatching network-vif-plugged-0912c834-ed73-4f3a-9419-2c08d6094b93 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:46:39 user nova-compute[71498]: WARNING nova.compute.manager [req-055b7a27-ede1-46e0-bafe-460d3ab013e7 req-863d5b84-d6fe-482d-acab-cf13f8d0ab37 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received unexpected event network-vif-plugged-0912c834-ed73-4f3a-9419-2c08d6094b93 for instance with vm_state building and task_state spawning.
Apr 14 01:46:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:39 user nova-compute[71498]: DEBUG nova.network.neutron [req-6f519318-fabb-450e-95a5-b085f777bfa3 req-ab72bc96-7614-4874-8768-795a88769b11 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Updated VIF entry in instance network info cache for port 7942720d-0958-4826-bedf-0a7eebfe45b6. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:46:39 user nova-compute[71498]: DEBUG nova.network.neutron [req-6f519318-fabb-450e-95a5-b085f777bfa3 req-ab72bc96-7614-4874-8768-795a88769b11 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Updating instance_info_cache with network_info: [{"id": "7942720d-0958-4826-bedf-0a7eebfe45b6", "address": "fa:16:3e:0c:0e:df", "network": {"id": "95555a4e-9d95-4509-a683-f61ea2dc38a1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-560359898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4833ddea1fa74866b97ef52a730605aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7942720d-09", "ovs_interfaceid": "7942720d-0958-4826-bedf-0a7eebfe45b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:46:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6f519318-fabb-450e-95a5-b085f777bfa3 req-ab72bc96-7614-4874-8768-795a88769b11 service nova] Releasing lock "refresh_cache-3a3fb53f-7b4a-48d3-85ab-418bad435c07" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-b2bae6f2-ce5a-4aaf-8edf-9bd5057e9f49 req-76790d26-abec-421b-bca2-8755b3410469 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-plugged-b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b2bae6f2-ce5a-4aaf-8edf-9bd5057e9f49 req-76790d26-abec-421b-bca2-8755b3410469 service nova] Acquiring lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b2bae6f2-ce5a-4aaf-8edf-9bd5057e9f49 req-76790d26-abec-421b-bca2-8755b3410469 service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b2bae6f2-ce5a-4aaf-8edf-9bd5057e9f49 req-76790d26-abec-421b-bca2-8755b3410469 service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-b2bae6f2-ce5a-4aaf-8edf-9bd5057e9f49 req-76790d26-abec-421b-bca2-8755b3410469 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] No waiting events found dispatching network-vif-plugged-b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:46:40 user nova-compute[71498]: WARNING nova.compute.manager [req-b2bae6f2-ce5a-4aaf-8edf-9bd5057e9f49 req-76790d26-abec-421b-bca2-8755b3410469 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received unexpected event network-vif-plugged-b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a for instance with vm_state building and task_state spawning.
Apr 14 01:46:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-bf6794f8-49a7-4ea0-ad9f-a4ff1b83591f req-c0122765-c492-4918-86b0-ab71fb694b31 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Received event network-vif-plugged-7942720d-0958-4826-bedf-0a7eebfe45b6 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-bf6794f8-49a7-4ea0-ad9f-a4ff1b83591f req-c0122765-c492-4918-86b0-ab71fb694b31 service nova] Acquiring lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-bf6794f8-49a7-4ea0-ad9f-a4ff1b83591f req-c0122765-c492-4918-86b0-ab71fb694b31 service nova] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-bf6794f8-49a7-4ea0-ad9f-a4ff1b83591f req-c0122765-c492-4918-86b0-ab71fb694b31 service nova] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-bf6794f8-49a7-4ea0-ad9f-a4ff1b83591f req-c0122765-c492-4918-86b0-ab71fb694b31 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] No waiting events found dispatching network-vif-plugged-7942720d-0958-4826-bedf-0a7eebfe45b6 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:46:40 user nova-compute[71498]: WARNING nova.compute.manager [req-bf6794f8-49a7-4ea0-ad9f-a4ff1b83591f req-c0122765-c492-4918-86b0-ab71fb694b31 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Received unexpected event network-vif-plugged-7942720d-0958-4826-bedf-0a7eebfe45b6 for instance with vm_state rescued and task_state unrescuing.
Apr 14 01:46:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-bf6794f8-49a7-4ea0-ad9f-a4ff1b83591f req-c0122765-c492-4918-86b0-ab71fb694b31 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Received event network-vif-plugged-7942720d-0958-4826-bedf-0a7eebfe45b6 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-bf6794f8-49a7-4ea0-ad9f-a4ff1b83591f req-c0122765-c492-4918-86b0-ab71fb694b31 service nova] Acquiring lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-bf6794f8-49a7-4ea0-ad9f-a4ff1b83591f req-c0122765-c492-4918-86b0-ab71fb694b31 service nova] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-bf6794f8-49a7-4ea0-ad9f-a4ff1b83591f req-c0122765-c492-4918-86b0-ab71fb694b31 service nova] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-bf6794f8-49a7-4ea0-ad9f-a4ff1b83591f req-c0122765-c492-4918-86b0-ab71fb694b31 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] No waiting events found dispatching network-vif-plugged-7942720d-0958-4826-bedf-0a7eebfe45b6 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:46:40 user nova-compute[71498]: WARNING nova.compute.manager [req-bf6794f8-49a7-4ea0-ad9f-a4ff1b83591f req-c0122765-c492-4918-86b0-ab71fb694b31 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Received unexpected event network-vif-plugged-7942720d-0958-4826-bedf-0a7eebfe45b6 for instance with vm_state rescued and task_state unrescuing.
Apr 14 01:46:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-bf6794f8-49a7-4ea0-ad9f-a4ff1b83591f req-c0122765-c492-4918-86b0-ab71fb694b31 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-plugged-4e9a3669-2ccb-49fc-a153-dfcee715ad41 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-bf6794f8-49a7-4ea0-ad9f-a4ff1b83591f req-c0122765-c492-4918-86b0-ab71fb694b31 service nova] Acquiring lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-bf6794f8-49a7-4ea0-ad9f-a4ff1b83591f req-c0122765-c492-4918-86b0-ab71fb694b31 service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-bf6794f8-49a7-4ea0-ad9f-a4ff1b83591f req-c0122765-c492-4918-86b0-ab71fb694b31 service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-bf6794f8-49a7-4ea0-ad9f-a4ff1b83591f req-c0122765-c492-4918-86b0-ab71fb694b31 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] No waiting events found dispatching network-vif-plugged-4e9a3669-2ccb-49fc-a153-dfcee715ad41 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:46:40 user nova-compute[71498]: WARNING nova.compute.manager [req-bf6794f8-49a7-4ea0-ad9f-a4ff1b83591f req-c0122765-c492-4918-86b0-ab71fb694b31 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received unexpected event network-vif-plugged-4e9a3669-2ccb-49fc-a153-dfcee715ad41 for instance with vm_state building and task_state spawning.
Apr 14 01:46:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-bf6794f8-49a7-4ea0-ad9f-a4ff1b83591f req-c0122765-c492-4918-86b0-ab71fb694b31 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-plugged-4e9a3669-2ccb-49fc-a153-dfcee715ad41 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-bf6794f8-49a7-4ea0-ad9f-a4ff1b83591f req-c0122765-c492-4918-86b0-ab71fb694b31 service nova] Acquiring lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-bf6794f8-49a7-4ea0-ad9f-a4ff1b83591f req-c0122765-c492-4918-86b0-ab71fb694b31 service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-bf6794f8-49a7-4ea0-ad9f-a4ff1b83591f req-c0122765-c492-4918-86b0-ab71fb694b31 service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-bf6794f8-49a7-4ea0-ad9f-a4ff1b83591f req-c0122765-c492-4918-86b0-ab71fb694b31 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] No waiting events found dispatching network-vif-plugged-4e9a3669-2ccb-49fc-a153-dfcee715ad41 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:46:40 user nova-compute[71498]: WARNING nova.compute.manager [req-bf6794f8-49a7-4ea0-ad9f-a4ff1b83591f req-c0122765-c492-4918-86b0-ab71fb694b31 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received unexpected event network-vif-plugged-4e9a3669-2ccb-49fc-a153-dfcee715ad41 for instance with vm_state building and task_state spawning.
Apr 14 01:46:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:41 user nova-compute[71498]: DEBUG nova.compute.manager [req-caf4f7de-4db0-4579-b16b-bbc4cf937ba3 req-7dcf850c-f887-42ed-99a7-83875dac7bb1 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-plugged-0912c834-ed73-4f3a-9419-2c08d6094b93 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-caf4f7de-4db0-4579-b16b-bbc4cf937ba3 req-7dcf850c-f887-42ed-99a7-83875dac7bb1 service nova] Acquiring lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-caf4f7de-4db0-4579-b16b-bbc4cf937ba3 req-7dcf850c-f887-42ed-99a7-83875dac7bb1 service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-caf4f7de-4db0-4579-b16b-bbc4cf937ba3 req-7dcf850c-f887-42ed-99a7-83875dac7bb1 service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:41 user nova-compute[71498]: DEBUG nova.compute.manager [req-caf4f7de-4db0-4579-b16b-bbc4cf937ba3 req-7dcf850c-f887-42ed-99a7-83875dac7bb1 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] No waiting events found dispatching network-vif-plugged-0912c834-ed73-4f3a-9419-2c08d6094b93 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:46:41 user nova-compute[71498]: WARNING nova.compute.manager [req-caf4f7de-4db0-4579-b16b-bbc4cf937ba3 req-7dcf850c-f887-42ed-99a7-83875dac7bb1 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received unexpected event network-vif-plugged-0912c834-ed73-4f3a-9419-2c08d6094b93 for instance with vm_state building and task_state spawning.
Apr 14 01:46:41 user nova-compute[71498]: DEBUG nova.compute.manager [req-caf4f7de-4db0-4579-b16b-bbc4cf937ba3 req-7dcf850c-f887-42ed-99a7-83875dac7bb1 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-plugged-6532dff7-2168-407f-be9b-bdbea1b6edd4 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-caf4f7de-4db0-4579-b16b-bbc4cf937ba3 req-7dcf850c-f887-42ed-99a7-83875dac7bb1 service nova] Acquiring lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-caf4f7de-4db0-4579-b16b-bbc4cf937ba3 req-7dcf850c-f887-42ed-99a7-83875dac7bb1 service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-caf4f7de-4db0-4579-b16b-bbc4cf937ba3 req-7dcf850c-f887-42ed-99a7-83875dac7bb1 service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:41 user nova-compute[71498]: DEBUG nova.compute.manager [req-caf4f7de-4db0-4579-b16b-bbc4cf937ba3 req-7dcf850c-f887-42ed-99a7-83875dac7bb1 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] No waiting events found dispatching network-vif-plugged-6532dff7-2168-407f-be9b-bdbea1b6edd4 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:46:41 user nova-compute[71498]: WARNING nova.compute.manager [req-caf4f7de-4db0-4579-b16b-bbc4cf937ba3 req-7dcf850c-f887-42ed-99a7-83875dac7bb1 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received unexpected event network-vif-plugged-6532dff7-2168-407f-be9b-bdbea1b6edd4 for instance with vm_state building and task_state spawning.
Apr 14 01:46:41 user nova-compute[71498]: DEBUG nova.compute.manager [req-caf4f7de-4db0-4579-b16b-bbc4cf937ba3 req-7dcf850c-f887-42ed-99a7-83875dac7bb1 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-plugged-6532dff7-2168-407f-be9b-bdbea1b6edd4 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-caf4f7de-4db0-4579-b16b-bbc4cf937ba3 req-7dcf850c-f887-42ed-99a7-83875dac7bb1 service nova] Acquiring lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-caf4f7de-4db0-4579-b16b-bbc4cf937ba3 req-7dcf850c-f887-42ed-99a7-83875dac7bb1 service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-caf4f7de-4db0-4579-b16b-bbc4cf937ba3 req-7dcf850c-f887-42ed-99a7-83875dac7bb1 service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:41 user nova-compute[71498]: DEBUG nova.compute.manager [req-caf4f7de-4db0-4579-b16b-bbc4cf937ba3 req-7dcf850c-f887-42ed-99a7-83875dac7bb1 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] No waiting events found dispatching network-vif-plugged-6532dff7-2168-407f-be9b-bdbea1b6edd4 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:46:41 user nova-compute[71498]: WARNING nova.compute.manager [req-caf4f7de-4db0-4579-b16b-bbc4cf937ba3 req-7dcf850c-f887-42ed-99a7-83875dac7bb1 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received unexpected event network-vif-plugged-6532dff7-2168-407f-be9b-bdbea1b6edd4 for instance with vm_state building and task_state spawning.
Apr 14 01:46:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-ed536e27-08c1-42e1-882c-052f779dfdd4 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:46:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Removed pending event for 3a3fb53f-7b4a-48d3-85ab-418bad435c07 due to event {{(pid=71498) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 01:46:42 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436802.7076437, 3a3fb53f-7b4a-48d3-85ab-418bad435c07 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:46:42 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] VM Resumed (Lifecycle Event)
Apr 14 01:46:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-3e4320d3-9bf4-4e97-b878-a00f100399cc req-b836f19e-80d0-4698-b370-ac66372424bf service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-plugged-b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3e4320d3-9bf4-4e97-b878-a00f100399cc req-b836f19e-80d0-4698-b370-ac66372424bf service nova] Acquiring lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3e4320d3-9bf4-4e97-b878-a00f100399cc req-b836f19e-80d0-4698-b370-ac66372424bf service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3e4320d3-9bf4-4e97-b878-a00f100399cc req-b836f19e-80d0-4698-b370-ac66372424bf service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-3e4320d3-9bf4-4e97-b878-a00f100399cc req-b836f19e-80d0-4698-b370-ac66372424bf service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] No waiting events found dispatching network-vif-plugged-b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:46:42 user nova-compute[71498]: WARNING nova.compute.manager [req-3e4320d3-9bf4-4e97-b878-a00f100399cc req-b836f19e-80d0-4698-b370-ac66372424bf service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received unexpected event network-vif-plugged-b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a for instance with vm_state building and task_state spawning.
Apr 14 01:46:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-3e4320d3-9bf4-4e97-b878-a00f100399cc req-b836f19e-80d0-4698-b370-ac66372424bf service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-plugged-f12d4d92-cf6a-4908-a203-d32ad80cb617 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3e4320d3-9bf4-4e97-b878-a00f100399cc req-b836f19e-80d0-4698-b370-ac66372424bf service nova] Acquiring lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3e4320d3-9bf4-4e97-b878-a00f100399cc req-b836f19e-80d0-4698-b370-ac66372424bf service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3e4320d3-9bf4-4e97-b878-a00f100399cc req-b836f19e-80d0-4698-b370-ac66372424bf service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-3e4320d3-9bf4-4e97-b878-a00f100399cc req-b836f19e-80d0-4698-b370-ac66372424bf service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] No waiting events found dispatching network-vif-plugged-f12d4d92-cf6a-4908-a203-d32ad80cb617 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:46:42 user nova-compute[71498]: WARNING nova.compute.manager [req-3e4320d3-9bf4-4e97-b878-a00f100399cc req-b836f19e-80d0-4698-b370-ac66372424bf service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received unexpected event network-vif-plugged-f12d4d92-cf6a-4908-a203-d32ad80cb617 for instance with vm_state building and task_state spawning.
Apr 14 01:46:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-3e4320d3-9bf4-4e97-b878-a00f100399cc req-b836f19e-80d0-4698-b370-ac66372424bf service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-plugged-f12d4d92-cf6a-4908-a203-d32ad80cb617 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3e4320d3-9bf4-4e97-b878-a00f100399cc req-b836f19e-80d0-4698-b370-ac66372424bf service nova] Acquiring lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3e4320d3-9bf4-4e97-b878-a00f100399cc req-b836f19e-80d0-4698-b370-ac66372424bf service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3e4320d3-9bf4-4e97-b878-a00f100399cc req-b836f19e-80d0-4698-b370-ac66372424bf service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-3e4320d3-9bf4-4e97-b878-a00f100399cc req-b836f19e-80d0-4698-b370-ac66372424bf service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] No waiting events found dispatching network-vif-plugged-f12d4d92-cf6a-4908-a203-d32ad80cb617 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:46:42 user nova-compute[71498]: WARNING nova.compute.manager [req-3e4320d3-9bf4-4e97-b878-a00f100399cc req-b836f19e-80d0-4698-b370-ac66372424bf service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received unexpected event network-vif-plugged-f12d4d92-cf6a-4908-a203-d32ad80cb617 for instance with vm_state building and task_state spawning.
Apr 14 01:46:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:46:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:46:42 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 01:46:42 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436802.7087426, 3a3fb53f-7b4a-48d3-85ab-418bad435c07 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:46:42 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] VM Started (Lifecycle Event)
Apr 14 01:46:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:46:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:46:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-4e9da72e-d6dd-43cd-b824-ff52e17f5d90 req-455e868a-e52a-484f-b1aa-9b5824e74329 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-plugged-6517ba71-e7ec-4e68-8860-714bb4711368 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4e9da72e-d6dd-43cd-b824-ff52e17f5d90 req-455e868a-e52a-484f-b1aa-9b5824e74329 service nova] Acquiring lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4e9da72e-d6dd-43cd-b824-ff52e17f5d90 req-455e868a-e52a-484f-b1aa-9b5824e74329 service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4e9da72e-d6dd-43cd-b824-ff52e17f5d90 req-455e868a-e52a-484f-b1aa-9b5824e74329 service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-4e9da72e-d6dd-43cd-b824-ff52e17f5d90 req-455e868a-e52a-484f-b1aa-9b5824e74329 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] No waiting events found dispatching network-vif-plugged-6517ba71-e7ec-4e68-8860-714bb4711368 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:46:42 user nova-compute[71498]: WARNING nova.compute.manager [req-4e9da72e-d6dd-43cd-b824-ff52e17f5d90 req-455e868a-e52a-484f-b1aa-9b5824e74329 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received unexpected event network-vif-plugged-6517ba71-e7ec-4e68-8860-714bb4711368 for instance with vm_state building and task_state spawning.
Apr 14 01:46:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-4e9da72e-d6dd-43cd-b824-ff52e17f5d90 req-455e868a-e52a-484f-b1aa-9b5824e74329 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-plugged-6517ba71-e7ec-4e68-8860-714bb4711368 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4e9da72e-d6dd-43cd-b824-ff52e17f5d90 req-455e868a-e52a-484f-b1aa-9b5824e74329 service nova] Acquiring lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4e9da72e-d6dd-43cd-b824-ff52e17f5d90 req-455e868a-e52a-484f-b1aa-9b5824e74329 service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4e9da72e-d6dd-43cd-b824-ff52e17f5d90 req-455e868a-e52a-484f-b1aa-9b5824e74329 service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-4e9da72e-d6dd-43cd-b824-ff52e17f5d90 req-455e868a-e52a-484f-b1aa-9b5824e74329 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] No waiting events found dispatching network-vif-plugged-6517ba71-e7ec-4e68-8860-714bb4711368 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:46:42 user nova-compute[71498]: WARNING nova.compute.manager [req-4e9da72e-d6dd-43cd-b824-ff52e17f5d90 req-455e868a-e52a-484f-b1aa-9b5824e74329 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received unexpected event network-vif-plugged-6517ba71-e7ec-4e68-8860-714bb4711368 for instance with vm_state building and task_state spawning.
Apr 14 01:46:43 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681436788.014692, d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:46:43 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] VM Stopped (Lifecycle Event)
Apr 14 01:46:43 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681436788.0299363, 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:46:43 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] VM Stopped (Lifecycle Event)
Apr 14 01:46:43 user nova-compute[71498]: DEBUG nova.compute.manager [None req-a6b9a235-a944-4a75-a47e-995ed9f2b04c None None] [instance: d579aeea-b72f-4fc5-8ee9-8bf0ebd4cbeb] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:46:43 user nova-compute[71498]: DEBUG nova.compute.manager [None req-a24a6ae5-4acd-4b2a-b444-bbbe11f5678e None None] [instance: 5803c8ed-f1fe-47ae-aaba-13b7cd8831ae] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:46:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:43 user nova-compute[71498]: DEBUG nova.compute.manager [req-a4db33f8-f15a-4af6-8846-35504d4f8638 req-527aba2a-20f7-4595-94b4-05b1ea380bf4 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-plugged-9894ad9b-db8c-4729-bd7b-ebb28b91af2b {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a4db33f8-f15a-4af6-8846-35504d4f8638 req-527aba2a-20f7-4595-94b4-05b1ea380bf4 service nova] Acquiring lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a4db33f8-f15a-4af6-8846-35504d4f8638 req-527aba2a-20f7-4595-94b4-05b1ea380bf4 service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a4db33f8-f15a-4af6-8846-35504d4f8638 req-527aba2a-20f7-4595-94b4-05b1ea380bf4 service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:43 user nova-compute[71498]: DEBUG nova.compute.manager [req-a4db33f8-f15a-4af6-8846-35504d4f8638 req-527aba2a-20f7-4595-94b4-05b1ea380bf4 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] No waiting events found dispatching network-vif-plugged-9894ad9b-db8c-4729-bd7b-ebb28b91af2b {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:46:43 user nova-compute[71498]: WARNING nova.compute.manager [req-a4db33f8-f15a-4af6-8846-35504d4f8638 req-527aba2a-20f7-4595-94b4-05b1ea380bf4 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received unexpected event network-vif-plugged-9894ad9b-db8c-4729-bd7b-ebb28b91af2b for instance with vm_state building and task_state spawning.
Apr 14 01:46:43 user nova-compute[71498]: DEBUG nova.compute.manager [req-a4db33f8-f15a-4af6-8846-35504d4f8638 req-527aba2a-20f7-4595-94b4-05b1ea380bf4 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-plugged-9894ad9b-db8c-4729-bd7b-ebb28b91af2b {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a4db33f8-f15a-4af6-8846-35504d4f8638 req-527aba2a-20f7-4595-94b4-05b1ea380bf4 service nova] Acquiring lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a4db33f8-f15a-4af6-8846-35504d4f8638 req-527aba2a-20f7-4595-94b4-05b1ea380bf4 service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a4db33f8-f15a-4af6-8846-35504d4f8638 req-527aba2a-20f7-4595-94b4-05b1ea380bf4 service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:43 user nova-compute[71498]: DEBUG nova.compute.manager [req-a4db33f8-f15a-4af6-8846-35504d4f8638 req-527aba2a-20f7-4595-94b4-05b1ea380bf4 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] No waiting events found dispatching network-vif-plugged-9894ad9b-db8c-4729-bd7b-ebb28b91af2b {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:46:43 user nova-compute[71498]: WARNING nova.compute.manager [req-a4db33f8-f15a-4af6-8846-35504d4f8638 req-527aba2a-20f7-4595-94b4-05b1ea380bf4 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received unexpected event network-vif-plugged-9894ad9b-db8c-4729-bd7b-ebb28b91af2b for instance with vm_state building and task_state spawning.
Apr 14 01:46:44 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436804.0000565, 4f8101aa-2078-4f0e-becb-62636c747c60 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:46:44 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] VM Resumed (Lifecycle Event)
Apr 14 01:46:44 user nova-compute[71498]: DEBUG nova.compute.manager [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:46:44 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:46:44 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Instance spawned successfully.
Apr 14 01:46:44 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:46:44 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:46:44 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:46:44 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:46:44 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436804.005513, 4f8101aa-2078-4f0e-becb-62636c747c60 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:46:44 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] VM Started (Lifecycle Event)
Apr 14 01:46:44 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:46:44 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:46:44 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:46:44 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:46:44 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:46:44 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:46:44 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:46:44 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:46:44 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:46:44 user nova-compute[71498]: INFO nova.compute.manager [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Took 12.53 seconds to spawn the instance on the hypervisor.
Apr 14 01:46:44 user nova-compute[71498]: DEBUG nova.compute.manager [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:46:44 user nova-compute[71498]: INFO nova.compute.manager [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Took 28.22 seconds to build instance.
Apr 14 01:46:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2415ed54-4fb1-4e4e-964c-466241b546ca tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "4f8101aa-2078-4f0e-becb-62636c747c60" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.332s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:46 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "f68784e7-578c-4a12-87d4-f35fbc5a1d59" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "f68784e7-578c-4a12-87d4-f35fbc5a1d59" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "f68784e7-578c-4a12-87d4-f35fbc5a1d59-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "f68784e7-578c-4a12-87d4-f35fbc5a1d59-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "f68784e7-578c-4a12-87d4-f35fbc5a1d59-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:46 user nova-compute[71498]: INFO nova.compute.manager [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Terminating instance
Apr 14 01:46:46 user nova-compute[71498]: DEBUG nova.compute.manager [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 01:46:46 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:46 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:46 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:46 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:46 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:47 user nova-compute[71498]: DEBUG nova.compute.manager [req-5addfc81-75e4-4227-b4b9-1df41c9440f4 req-a28694a1-f07f-476a-91c0-e250bd494424 service nova] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Received event network-vif-unplugged-08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5addfc81-75e4-4227-b4b9-1df41c9440f4 req-a28694a1-f07f-476a-91c0-e250bd494424 service nova] Acquiring lock "f68784e7-578c-4a12-87d4-f35fbc5a1d59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5addfc81-75e4-4227-b4b9-1df41c9440f4 req-a28694a1-f07f-476a-91c0-e250bd494424 service nova] Lock "f68784e7-578c-4a12-87d4-f35fbc5a1d59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5addfc81-75e4-4227-b4b9-1df41c9440f4 req-a28694a1-f07f-476a-91c0-e250bd494424 service nova] Lock "f68784e7-578c-4a12-87d4-f35fbc5a1d59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:47 user nova-compute[71498]: DEBUG nova.compute.manager [req-5addfc81-75e4-4227-b4b9-1df41c9440f4 req-a28694a1-f07f-476a-91c0-e250bd494424 service nova] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] No waiting events found dispatching network-vif-unplugged-08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:46:47 user nova-compute[71498]: DEBUG nova.compute.manager [req-5addfc81-75e4-4227-b4b9-1df41c9440f4 req-a28694a1-f07f-476a-91c0-e250bd494424 service nova] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Received event network-vif-unplugged-08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:46:47 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Instance destroyed successfully.
Apr 14 01:46:47 user nova-compute[71498]: DEBUG nova.objects.instance [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lazy-loading 'resources' on Instance uuid f68784e7-578c-4a12-87d4-f35fbc5a1d59 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:46:47 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1105703559',display_name='tempest-VolumesAdminNegativeTest-server-1105703559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1105703559',id=5,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzSqKeU7xuvAUNkvNUpnnFYDg8L9Gwcz3w0hcuWLt8QTfKNS7hjjtyP4reBw4U2xq2tJ0MdbpLZFiWL5B1QKuYrfH5MWbhJ069nr4zUrKudohsn7krJGDoFkJv3XJBPFQ==',key_name='tempest-keypair-1858701247',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:41:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0a409270d6d4d408de33c5e71a56da9',ramdisk_id='',reservation_id='r-5cawmr1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1981219566',owner_user_name='tempest-VolumesAdminNegativeTest-1981219566-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:41:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbaf843e44ff4359a15ab6d625134b07',uuid=f68784e7-578c-4a12-87d4-f35fbc5a1d59,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd", "address": "fa:16:3e:f5:7f:82", "network": {"id": "6569db42-40ba-4426-a76b-b3e64ecae5b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1148770119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a409270d6d4d408de33c5e71a56da9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c0ebf7-58", "ovs_interfaceid": "08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:46:47 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Converting VIF {"id": "08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd", "address": "fa:16:3e:f5:7f:82", "network": {"id": "6569db42-40ba-4426-a76b-b3e64ecae5b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1148770119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a409270d6d4d408de33c5e71a56da9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c0ebf7-58", "ovs_interfaceid": "08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:46:47 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:7f:82,bridge_name='br-int',has_traffic_filtering=True,id=08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd,network=Network(6569db42-40ba-4426-a76b-b3e64ecae5b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08c0ebf7-58') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:46:47 user nova-compute[71498]: DEBUG os_vif [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:7f:82,bridge_name='br-int',has_traffic_filtering=True,id=08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd,network=Network(6569db42-40ba-4426-a76b-b3e64ecae5b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08c0ebf7-58') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:46:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08c0ebf7-58, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:46:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:46:47 user nova-compute[71498]: INFO os_vif [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:7f:82,bridge_name='br-int',has_traffic_filtering=True,id=08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd,network=Network(6569db42-40ba-4426-a76b-b3e64ecae5b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08c0ebf7-58')
Apr 14 01:46:47 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Deleting instance files /opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59_del
Apr 14 01:46:47 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Deletion of /opt/stack/data/nova/instances/f68784e7-578c-4a12-87d4-f35fbc5a1d59_del complete
Apr 14 01:46:47 user nova-compute[71498]: INFO nova.compute.manager [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Took 0.91 seconds to destroy the instance on the hypervisor.
Apr 14 01:46:47 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 01:46:47 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 01:46:47 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 01:46:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:48 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:46:48 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Took 1.04 seconds to deallocate network for instance.
Apr 14 01:46:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:48 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Refreshing inventories for resource provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 01:46:48 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Updating ProviderTree inventory for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 01:46:48 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Updating inventory in ProviderTree for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 01:46:49 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Refreshing aggregate associations for resource provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4, aggregates: None {{(pid=71498) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 01:46:49 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Refreshing trait associations for resource provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,HW_CPU_X86_SSE2 {{(pid=71498) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 01:46:49 user nova-compute[71498]: DEBUG nova.compute.manager [req-4285a0db-f5b0-4ddf-89c7-1331af015bc0 req-d47d833a-b55c-4359-a8d3-005795798793 service nova] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Received event network-vif-plugged-08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4285a0db-f5b0-4ddf-89c7-1331af015bc0 req-d47d833a-b55c-4359-a8d3-005795798793 service nova] Acquiring lock "f68784e7-578c-4a12-87d4-f35fbc5a1d59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4285a0db-f5b0-4ddf-89c7-1331af015bc0 req-d47d833a-b55c-4359-a8d3-005795798793 service nova] Lock "f68784e7-578c-4a12-87d4-f35fbc5a1d59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4285a0db-f5b0-4ddf-89c7-1331af015bc0 req-d47d833a-b55c-4359-a8d3-005795798793 service nova] Lock "f68784e7-578c-4a12-87d4-f35fbc5a1d59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:49 user nova-compute[71498]: DEBUG nova.compute.manager [req-4285a0db-f5b0-4ddf-89c7-1331af015bc0 req-d47d833a-b55c-4359-a8d3-005795798793 service nova] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] No waiting events found dispatching network-vif-plugged-08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:46:49 user nova-compute[71498]: WARNING nova.compute.manager [req-4285a0db-f5b0-4ddf-89c7-1331af015bc0 req-d47d833a-b55c-4359-a8d3-005795798793 service nova] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Received unexpected event network-vif-plugged-08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd for instance with vm_state deleted and task_state None.
Apr 14 01:46:49 user nova-compute[71498]: DEBUG nova.compute.manager [req-4285a0db-f5b0-4ddf-89c7-1331af015bc0 req-d47d833a-b55c-4359-a8d3-005795798793 service nova] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Received event network-vif-deleted-08c0ebf7-58cc-4dc9-896c-1c1fb3b882cd {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:49 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:46:49 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:46:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.626s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:49 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Deleted allocations for instance f68784e7-578c-4a12-87d4-f35fbc5a1d59
Apr 14 01:46:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adde67de-9061-4ad8-bcd8-652adb46b1fe tempest-VolumesAdminNegativeTest-1981219566 tempest-VolumesAdminNegativeTest-1981219566-project-member] Lock "f68784e7-578c-4a12-87d4-f35fbc5a1d59" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.853s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:46:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 01:46:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:46:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:46:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:58 user nova-compute[71498]: INFO nova.compute.manager [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Rescuing
Apr 14 01:46:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "refresh_cache-fa29c144-0ff9-4efb-a574-f521d18f08fa" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:46:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquired lock "refresh_cache-fa29c144-0ff9-4efb-a574-f521d18f08fa" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:46:58 user nova-compute[71498]: DEBUG nova.network.neutron [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:46:59 user nova-compute[71498]: DEBUG nova.network.neutron [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Updating instance_info_cache with network_info: [{"id": "6a841349-4e6e-40e1-90f0-998d46c60567", "address": "fa:16:3e:49:5d:eb", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a841349-4e", "ovs_interfaceid": "6a841349-4e6e-40e1-90f0-998d46c60567", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:46:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Releasing lock "refresh_cache-fa29c144-0ff9-4efb-a574-f521d18f08fa" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:46:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:59 user nova-compute[71498]: DEBUG nova.compute.manager [req-a2d16cdf-8475-4818-a477-9174f04b481b req-a6d10e50-6388-4511-b846-e8fad9a5f219 service nova] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Received event network-vif-unplugged-6a841349-4e6e-40e1-90f0-998d46c60567 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:46:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a2d16cdf-8475-4818-a477-9174f04b481b req-a6d10e50-6388-4511-b846-e8fad9a5f219 service nova] Acquiring lock "fa29c144-0ff9-4efb-a574-f521d18f08fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:46:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a2d16cdf-8475-4818-a477-9174f04b481b req-a6d10e50-6388-4511-b846-e8fad9a5f219 service nova] Lock "fa29c144-0ff9-4efb-a574-f521d18f08fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:46:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a2d16cdf-8475-4818-a477-9174f04b481b req-a6d10e50-6388-4511-b846-e8fad9a5f219 service nova] Lock "fa29c144-0ff9-4efb-a574-f521d18f08fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:46:59 user nova-compute[71498]: DEBUG nova.compute.manager [req-a2d16cdf-8475-4818-a477-9174f04b481b req-a6d10e50-6388-4511-b846-e8fad9a5f219 service nova] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] No waiting events found dispatching network-vif-unplugged-6a841349-4e6e-40e1-90f0-998d46c60567 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:46:59 user nova-compute[71498]: WARNING nova.compute.manager [req-a2d16cdf-8475-4818-a477-9174f04b481b req-a6d10e50-6388-4511-b846-e8fad9a5f219 service nova] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Received unexpected event network-vif-unplugged-6a841349-4e6e-40e1-90f0-998d46c60567 for instance with vm_state active and task_state rescuing.
Apr 14 01:46:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:46:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:00 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Instance destroyed successfully.
Apr 14 01:47:00 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Attempting rescue
Apr 14 01:47:00 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71498) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Instance directory exists: not creating {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 01:47:00 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Creating image(s)
Apr 14 01:47:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "/opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "/opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG nova.objects.instance [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'trusted_certs' on Instance uuid fa29c144-0ff9-4efb-a574-f521d18f08fa {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.149s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue" returned: 0 in 0.063s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG nova.objects.instance [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'migration_context' on Instance uuid fa29c144-0ff9-4efb-a574-f521d18f08fa {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Start _get_guest_xml network_info=[{"id": "6a841349-4e6e-40e1-90f0-998d46c60567", "address": "fa:16:3e:49:5d:eb", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "vif_mac": "fa:16:3e:49:5d:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a841349-4e", "ovs_interfaceid": "6a841349-4e6e-40e1-90f0-998d46c60567", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG nova.objects.instance [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'resources' on Instance uuid fa29c144-0ff9-4efb-a574-f521d18f08fa {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG nova.objects.instance [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'numa_topology' on Instance uuid fa29c144-0ff9-4efb-a574-f521d18f08fa {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:47:00 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:47:00 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:47:00 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG nova.objects.instance [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'vcpu_model' on Instance uuid fa29c144-0ff9-4efb-a574-f521d18f08fa {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:45:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2109836040',display_name='tempest-ServerRescueNegativeTestJSON-server-2109836040',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2109836040',id=19,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:45:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d3de04739384e3ea3a475fee28be3c0',ramdisk_id='',reservation_id='r-9ja500p2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1453869246',owner_user_name='tempest-ServerRescueNegativeTestJSON-1453869246-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:45:17Z,user_data=None,user_id='eeb5f26be86e43b3b61fff98fdc83cf3',uuid=fa29c144-0ff9-4efb-a574-f521d18f08fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a841349-4e6e-40e1-90f0-998d46c60567", "address": "fa:16:3e:49:5d:eb", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "vif_mac": "fa:16:3e:49:5d:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a841349-4e", "ovs_interfaceid": "6a841349-4e6e-40e1-90f0-998d46c60567", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Converting VIF {"id": "6a841349-4e6e-40e1-90f0-998d46c60567", "address": "fa:16:3e:49:5d:eb", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "vif_mac": "fa:16:3e:49:5d:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a841349-4e", "ovs_interfaceid": "6a841349-4e6e-40e1-90f0-998d46c60567", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:5d:eb,bridge_name='br-int',has_traffic_filtering=True,id=6a841349-4e6e-40e1-90f0-998d46c60567,network=Network(2c4fba9e-0217-4e37-af1c-065b3f0cd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a841349-4e') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG nova.objects.instance [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'pci_devices' on Instance uuid fa29c144-0ff9-4efb-a574-f521d18f08fa {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:47:00 user nova-compute[71498]:   <uuid>fa29c144-0ff9-4efb-a574-f521d18f08fa</uuid>
Apr 14 01:47:00 user nova-compute[71498]:   <name>instance-00000013</name>
Apr 14 01:47:00 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:47:00 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:47:00 user nova-compute[71498]:   <metadata>
Apr 14 01:47:00 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:47:00 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:47:00 user nova-compute[71498]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2109836040</nova:name>
Apr 14 01:47:00 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:47:00</nova:creationTime>
Apr 14 01:47:00 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:47:00 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:47:00 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:47:00 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:47:00 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:47:00 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:47:00 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:47:00 user nova-compute[71498]:       <nova:owner>
Apr 14 01:47:00 user nova-compute[71498]:         <nova:user uuid="eeb5f26be86e43b3b61fff98fdc83cf3">tempest-ServerRescueNegativeTestJSON-1453869246-project-member</nova:user>
Apr 14 01:47:00 user nova-compute[71498]:         <nova:project uuid="6d3de04739384e3ea3a475fee28be3c0">tempest-ServerRescueNegativeTestJSON-1453869246</nova:project>
Apr 14 01:47:00 user nova-compute[71498]:       </nova:owner>
Apr 14 01:47:00 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:47:00 user nova-compute[71498]:       <nova:ports>
Apr 14 01:47:00 user nova-compute[71498]:         <nova:port uuid="6a841349-4e6e-40e1-90f0-998d46c60567">
Apr 14 01:47:00 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 01:47:00 user nova-compute[71498]:         </nova:port>
Apr 14 01:47:00 user nova-compute[71498]:       </nova:ports>
Apr 14 01:47:00 user nova-compute[71498]:     </nova:instance>
Apr 14 01:47:00 user nova-compute[71498]:   </metadata>
Apr 14 01:47:00 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:47:00 user nova-compute[71498]:     <system>
Apr 14 01:47:00 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:47:00 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:47:00 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:47:00 user nova-compute[71498]:       <entry name="serial">fa29c144-0ff9-4efb-a574-f521d18f08fa</entry>
Apr 14 01:47:00 user nova-compute[71498]:       <entry name="uuid">fa29c144-0ff9-4efb-a574-f521d18f08fa</entry>
Apr 14 01:47:00 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:47:00 user nova-compute[71498]:     </system>
Apr 14 01:47:00 user nova-compute[71498]:   </sysinfo>
Apr 14 01:47:00 user nova-compute[71498]:   <os>
Apr 14 01:47:00 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:47:00 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:47:00 user nova-compute[71498]:   </os>
Apr 14 01:47:00 user nova-compute[71498]:   <features>
Apr 14 01:47:00 user nova-compute[71498]:     <acpi/>
Apr 14 01:47:00 user nova-compute[71498]:     <apic/>
Apr 14 01:47:00 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:47:00 user nova-compute[71498]:   </features>
Apr 14 01:47:00 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:47:00 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:47:00 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:47:00 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:47:00 user nova-compute[71498]:   </clock>
Apr 14 01:47:00 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:47:00 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:47:00 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:47:00 user nova-compute[71498]:   </cpu>
Apr 14 01:47:00 user nova-compute[71498]:   <devices>
Apr 14 01:47:00 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:47:00 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:47:00 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue"/>
Apr 14 01:47:00 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:47:00 user nova-compute[71498]:     </disk>
Apr 14 01:47:00 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:47:00 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:47:00 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk"/>
Apr 14 01:47:00 user nova-compute[71498]:       <target dev="vdb" bus="virtio"/>
Apr 14 01:47:00 user nova-compute[71498]:     </disk>
Apr 14 01:47:00 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:47:00 user nova-compute[71498]:       <mac address="fa:16:3e:49:5d:eb"/>
Apr 14 01:47:00 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:47:00 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:47:00 user nova-compute[71498]:       <target dev="tap6a841349-4e"/>
Apr 14 01:47:00 user nova-compute[71498]:     </interface>
Apr 14 01:47:00 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:47:00 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/console.log" append="off"/>
Apr 14 01:47:00 user nova-compute[71498]:     </serial>
Apr 14 01:47:00 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:47:00 user nova-compute[71498]:     <video>
Apr 14 01:47:00 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:47:00 user nova-compute[71498]:     </video>
Apr 14 01:47:00 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:47:00 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:47:00 user nova-compute[71498]:     </rng>
Apr 14 01:47:00 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:47:00 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:47:00 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:47:00 user nova-compute[71498]:     </memballoon>
Apr 14 01:47:00 user nova-compute[71498]:   </devices>
Apr 14 01:47:00 user nova-compute[71498]: </domain>
Apr 14 01:47:00 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:47:00 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Instance destroyed successfully.
Apr 14 01:47:00 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:47:00 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] No VIF found with MAC fa:16:3e:49:5d:eb, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:47:01 user nova-compute[71498]: DEBUG nova.compute.manager [req-e5e148c5-7421-4738-a3bc-fdcacdd87528 req-56edcb23-516f-43de-ae1b-b8c16d8f68b1 service nova] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Received event network-vif-plugged-6a841349-4e6e-40e1-90f0-998d46c60567 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:47:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e5e148c5-7421-4738-a3bc-fdcacdd87528 req-56edcb23-516f-43de-ae1b-b8c16d8f68b1 service nova] Acquiring lock "fa29c144-0ff9-4efb-a574-f521d18f08fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:47:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e5e148c5-7421-4738-a3bc-fdcacdd87528 req-56edcb23-516f-43de-ae1b-b8c16d8f68b1 service nova] Lock "fa29c144-0ff9-4efb-a574-f521d18f08fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:47:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e5e148c5-7421-4738-a3bc-fdcacdd87528 req-56edcb23-516f-43de-ae1b-b8c16d8f68b1 service nova] Lock "fa29c144-0ff9-4efb-a574-f521d18f08fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:47:01 user nova-compute[71498]: DEBUG nova.compute.manager [req-e5e148c5-7421-4738-a3bc-fdcacdd87528 req-56edcb23-516f-43de-ae1b-b8c16d8f68b1 service nova] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] No waiting events found dispatching network-vif-plugged-6a841349-4e6e-40e1-90f0-998d46c60567 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:47:01 user nova-compute[71498]: WARNING nova.compute.manager [req-e5e148c5-7421-4738-a3bc-fdcacdd87528 req-56edcb23-516f-43de-ae1b-b8c16d8f68b1 service nova] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Received unexpected event network-vif-plugged-6a841349-4e6e-40e1-90f0-998d46c60567 for instance with vm_state active and task_state rescuing.
Apr 14 01:47:01 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:02 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681436807.556406, f68784e7-578c-4a12-87d4-f35fbc5a1d59 => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:47:02 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] VM Stopped (Lifecycle Event)
Apr 14 01:47:02 user nova-compute[71498]: DEBUG nova.compute.manager [None req-615e92d2-1eec-4959-8837-25c8c0212380 None None] [instance: f68784e7-578c-4a12-87d4-f35fbc5a1d59] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:47:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:03 user nova-compute[71498]: DEBUG nova.compute.manager [req-3f44a651-7ead-4013-99a7-467f25c5929c req-54ae5899-3c84-4cfa-81f2-2d72165bd851 service nova] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Received event network-vif-plugged-6a841349-4e6e-40e1-90f0-998d46c60567 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:47:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3f44a651-7ead-4013-99a7-467f25c5929c req-54ae5899-3c84-4cfa-81f2-2d72165bd851 service nova] Acquiring lock "fa29c144-0ff9-4efb-a574-f521d18f08fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:47:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3f44a651-7ead-4013-99a7-467f25c5929c req-54ae5899-3c84-4cfa-81f2-2d72165bd851 service nova] Lock "fa29c144-0ff9-4efb-a574-f521d18f08fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:47:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3f44a651-7ead-4013-99a7-467f25c5929c req-54ae5899-3c84-4cfa-81f2-2d72165bd851 service nova] Lock "fa29c144-0ff9-4efb-a574-f521d18f08fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:47:03 user nova-compute[71498]: DEBUG nova.compute.manager [req-3f44a651-7ead-4013-99a7-467f25c5929c req-54ae5899-3c84-4cfa-81f2-2d72165bd851 service nova] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] No waiting events found dispatching network-vif-plugged-6a841349-4e6e-40e1-90f0-998d46c60567 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:47:03 user nova-compute[71498]: WARNING nova.compute.manager [req-3f44a651-7ead-4013-99a7-467f25c5929c req-54ae5899-3c84-4cfa-81f2-2d72165bd851 service nova] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Received unexpected event network-vif-plugged-6a841349-4e6e-40e1-90f0-998d46c60567 for instance with vm_state active and task_state rescuing.
Apr 14 01:47:03 user nova-compute[71498]: DEBUG nova.compute.manager [req-3f44a651-7ead-4013-99a7-467f25c5929c req-54ae5899-3c84-4cfa-81f2-2d72165bd851 service nova] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Received event network-vif-plugged-6a841349-4e6e-40e1-90f0-998d46c60567 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:47:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3f44a651-7ead-4013-99a7-467f25c5929c req-54ae5899-3c84-4cfa-81f2-2d72165bd851 service nova] Acquiring lock "fa29c144-0ff9-4efb-a574-f521d18f08fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:47:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3f44a651-7ead-4013-99a7-467f25c5929c req-54ae5899-3c84-4cfa-81f2-2d72165bd851 service nova] Lock "fa29c144-0ff9-4efb-a574-f521d18f08fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:47:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3f44a651-7ead-4013-99a7-467f25c5929c req-54ae5899-3c84-4cfa-81f2-2d72165bd851 service nova] Lock "fa29c144-0ff9-4efb-a574-f521d18f08fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:47:03 user nova-compute[71498]: DEBUG nova.compute.manager [req-3f44a651-7ead-4013-99a7-467f25c5929c req-54ae5899-3c84-4cfa-81f2-2d72165bd851 service nova] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] No waiting events found dispatching network-vif-plugged-6a841349-4e6e-40e1-90f0-998d46c60567 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:47:03 user nova-compute[71498]: WARNING nova.compute.manager [req-3f44a651-7ead-4013-99a7-467f25c5929c req-54ae5899-3c84-4cfa-81f2-2d72165bd851 service nova] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Received unexpected event network-vif-plugged-6a841349-4e6e-40e1-90f0-998d46c60567 for instance with vm_state active and task_state rescuing.
Apr 14 01:47:04 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Removed pending event for fa29c144-0ff9-4efb-a574-f521d18f08fa due to event {{(pid=71498) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 01:47:04 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436824.179183, fa29c144-0ff9-4efb-a574-f521d18f08fa => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:47:04 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] VM Resumed (Lifecycle Event)
Apr 14 01:47:04 user nova-compute[71498]: DEBUG nova.compute.manager [None req-34ec7d58-856c-438c-9fdd-71ef70a25600 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:47:04 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:47:04 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:47:04 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 01:47:04 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436824.1825154, fa29c144-0ff9-4efb-a574-f521d18f08fa => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:47:04 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] VM Started (Lifecycle Event)
Apr 14 01:47:04 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:47:04 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:47:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:47:09 user nova-compute[71498]: INFO nova.compute.manager [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Detaching volume 7298e05a-b142-4365-95e1-f8551de0ae79
Apr 14 01:47:09 user nova-compute[71498]: INFO nova.virt.block_device [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Attempting to driver detach volume 7298e05a-b142-4365-95e1-f8551de0ae79 from mountpoint /dev/vdb
Apr 14 01:47:09 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Attempting to detach device vdb from instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07 from the persistent domain config. {{(pid=71498) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 01:47:09 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:47:09 user nova-compute[71498]:   <source dev="/dev/sdc"/>
Apr 14 01:47:09 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:47:09 user nova-compute[71498]:   <serial>7298e05a-b142-4365-95e1-f8551de0ae79</serial>
Apr 14 01:47:09 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 01:47:09 user nova-compute[71498]: </disk>
Apr 14 01:47:09 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:47:09 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Successfully detached device vdb from instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07 from the persistent domain config.
Apr 14 01:47:09 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07 from the live domain config. {{(pid=71498) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 01:47:09 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:47:09 user nova-compute[71498]:   <source dev="/dev/sdc"/>
Apr 14 01:47:09 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:47:09 user nova-compute[71498]:   <serial>7298e05a-b142-4365-95e1-f8551de0ae79</serial>
Apr 14 01:47:09 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 01:47:09 user nova-compute[71498]: </disk>
Apr 14 01:47:09 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Received event <DeviceRemovedEvent: 1681436829.822979, 3a3fb53f-7b4a-48d3-85ab-418bad435c07 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71498) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07 {{(pid=71498) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 01:47:09 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Successfully detached device vdb from instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07 from the live domain config.
Apr 14 01:47:09 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nmkLiNCj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:47:09 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:47:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[da868ab7-0455-4573-8957-9019686732f3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:47:09 user nova-compute[71498]: No targets found.
Apr 14 01:47:09 user nova-compute[71498]: iSNS:
Apr 14 01:47:09 user nova-compute[71498]: No targets found.
Apr 14 01:47:09 user nova-compute[71498]: STATIC:
Apr 14 01:47:09 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8
Apr 14 01:47:09 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:47:09 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:47:09 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53
Apr 14 01:47:09 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:47:09 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:47:09 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d
Apr 14 01:47:09 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:47:09 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:47:09 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b
Apr 14 01:47:09 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:47:09 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:47:09 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22
Apr 14 01:47:09 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:47:09 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:47:09 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79
Apr 14 01:47:09 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:47:09 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:47:09 user nova-compute[71498]: FIRMWARE:
Apr 14 01:47:09 user nova-compute[71498]: No targets found.
Apr 14 01:47:09 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:47:09 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:47:09 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[778cadca-c6ef-4a28-bdbf-fd39f06631c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6191ee5-6ae6-481f-8f66-ec092d18e21d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:47:09 user nova-compute[71498]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)
Apr 14 01:47:09 user nova-compute[71498]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:47:09 user nova-compute[71498]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)
Apr 14 01:47:09 user nova-compute[71498]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)
Apr 14 01:47:09 user nova-compute[71498]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)
Apr 14 01:47:09 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:47:09 user nova-compute[71498]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 (non-flash)
Apr 14 01:47:09 user nova-compute[71498]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:47:09 user nova-compute[71498]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)
Apr 14 01:47:09 user nova-compute[71498]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)
Apr 14 01:47:09 user nova-compute[71498]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)
Apr 14 01:47:09 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51fee3e3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79'): ({'sdc'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Removing single pathed devices sdc {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9aef80-f16c-4229-a179-d968b398b92e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5158a316-d9cc-4b36-adc6-219b59716af3]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Flushing IO for device /dev/sdc {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c690d8b-6bbe-4ba3-8527-ea664acb98ff]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:47:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:10 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[163748a7-33d7-48a0-ae39-0f261ec25996]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:10 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:47:10 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] SCSI volumes sdc have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:47:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:47:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:10 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7961e41f-9c3d-46b8-bfbd-225ae7bc1ec6]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:47:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:10 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[70feab28-bb59-4de9-9571-0a13a32b608a]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79, portal: 172.16.0.220,3260]
Apr 14 01:47:10 user nova-compute[71498]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79, portal: 172.16.0.220,3260] successful.
Apr 14 01:47:10 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:47:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7298e05a-b142-4365-95e1-f8551de0ae79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:10 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbb3603-2d37-4dee-bda2-25660633d887]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:47:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:47:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] <== disconnect_volume: return (324ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:47:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:47:10 user nova-compute[71498]: DEBUG nova.objects.instance [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lazy-loading 'flavor' on Instance uuid 3a3fb53f-7b4a-48d3-85ab-418bad435c07 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:47:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c484f095-d3f3-476e-a826-ee8a2148e8c5 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.718s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:47:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._sync_power_states {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Triggering sync for uuid da60f4f1-2474-453f-8f84-c95daf02431a {{(pid=71498) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Triggering sync for uuid 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 {{(pid=71498) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Triggering sync for uuid 3a3fb53f-7b4a-48d3-85ab-418bad435c07 {{(pid=71498) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Triggering sync for uuid ee4cf01f-8d33-4696-b6ec-7f188ee18026 {{(pid=71498) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Triggering sync for uuid 73fd9bc1-af0f-41e9-adea-d73323b4a76c {{(pid=71498) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Triggering sync for uuid a19a1c08-5454-481b-bb5a-70c39ead9afc {{(pid=71498) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Triggering sync for uuid fa29c144-0ff9-4efb-a574-f521d18f08fa {{(pid=71498) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Triggering sync for uuid 73cc8ede-babd-4281-bf1d-c5a3f8bad440 {{(pid=71498) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Triggering sync for uuid 74311da6-d6b8-4aea-b6ce-97db8da53800 {{(pid=71498) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Triggering sync for uuid 4f8101aa-2078-4f0e-becb-62636c747c60 {{(pid=71498) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "da60f4f1-2474-453f-8f84-c95daf02431a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "da60f4f1-2474-453f-8f84-c95daf02431a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "8e042a42-7cc2-4d72-b7ed-2b80339f2c85" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "8e042a42-7cc2-4d72-b7ed-2b80339f2c85" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "a19a1c08-5454-481b-bb5a-70c39ead9afc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "a19a1c08-5454-481b-bb5a-70c39ead9afc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "fa29c144-0ff9-4efb-a574-f521d18f08fa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "fa29c144-0ff9-4efb-a574-f521d18f08fa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "74311da6-d6b8-4aea-b6ce-97db8da53800" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "4f8101aa-2078-4f0e-becb-62636c747c60" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "4f8101aa-2078-4f0e-becb-62636c747c60" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "8e042a42-7cc2-4d72-b7ed-2b80339f2c85" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "da60f4f1-2474-453f-8f84-c95daf02431a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "a19a1c08-5454-481b-bb5a-70c39ead9afc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "fa29c144-0ff9-4efb-a574-f521d18f08fa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:47:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "4f8101aa-2078-4f0e-becb-62636c747c60" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:47:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:18 user nova-compute[71498]: DEBUG nova.compute.manager [req-75ac1b6e-a45a-469b-8238-da9d127acbb3 req-7bf3c385-a9a1-4d57-aa54-f4f4a6790c7c service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Received event network-changed-84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:47:18 user nova-compute[71498]: DEBUG nova.compute.manager [req-75ac1b6e-a45a-469b-8238-da9d127acbb3 req-7bf3c385-a9a1-4d57-aa54-f4f4a6790c7c service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Refreshing instance network info cache due to event network-changed-84d281bf-164e-48f3-a3ee-ca796d9a48e7. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:47:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-75ac1b6e-a45a-469b-8238-da9d127acbb3 req-7bf3c385-a9a1-4d57-aa54-f4f4a6790c7c service nova] Acquiring lock "refresh_cache-73cc8ede-babd-4281-bf1d-c5a3f8bad440" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:47:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-75ac1b6e-a45a-469b-8238-da9d127acbb3 req-7bf3c385-a9a1-4d57-aa54-f4f4a6790c7c service nova] Acquired lock "refresh_cache-73cc8ede-babd-4281-bf1d-c5a3f8bad440" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:47:18 user nova-compute[71498]: DEBUG nova.network.neutron [req-75ac1b6e-a45a-469b-8238-da9d127acbb3 req-7bf3c385-a9a1-4d57-aa54-f4f4a6790c7c service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Refreshing network info cache for port 84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:47:18 user nova-compute[71498]: DEBUG nova.network.neutron [req-75ac1b6e-a45a-469b-8238-da9d127acbb3 req-7bf3c385-a9a1-4d57-aa54-f4f4a6790c7c service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Updated VIF entry in instance network info cache for port 84d281bf-164e-48f3-a3ee-ca796d9a48e7. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:47:18 user nova-compute[71498]: DEBUG nova.network.neutron [req-75ac1b6e-a45a-469b-8238-da9d127acbb3 req-7bf3c385-a9a1-4d57-aa54-f4f4a6790c7c service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Updating instance_info_cache with network_info: [{"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:47:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-75ac1b6e-a45a-469b-8238-da9d127acbb3 req-7bf3c385-a9a1-4d57-aa54-f4f4a6790c7c service nova] Releasing lock "refresh_cache-73cc8ede-babd-4281-bf1d-c5a3f8bad440" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:47:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:26 user nova-compute[71498]: INFO nova.compute.manager [None req-ae1fba90-67d2-4ae4-84c7-51695ca6debc tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Unrescuing
Apr 14 01:47:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ae1fba90-67d2-4ae4-84c7-51695ca6debc tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "refresh_cache-73fd9bc1-af0f-41e9-adea-d73323b4a76c" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:47:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ae1fba90-67d2-4ae4-84c7-51695ca6debc tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquired lock "refresh_cache-73fd9bc1-af0f-41e9-adea-d73323b4a76c" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:47:26 user nova-compute[71498]: DEBUG nova.network.neutron [None req-ae1fba90-67d2-4ae4-84c7-51695ca6debc tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:47:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "1ccf53b5-9199-4812-a635-4f4f22fb5d28" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:47:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "1ccf53b5-9199-4812-a635-4f4f22fb5d28" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:47:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 01:47:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:47:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:47:26 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:47:26 user nova-compute[71498]: INFO nova.compute.claims [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Claim successful on node user
Apr 14 01:47:26 user nova-compute[71498]: DEBUG nova.network.neutron [None req-ae1fba90-67d2-4ae4-84c7-51695ca6debc tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Updating instance_info_cache with network_info: [{"id": "4146457e-4b16-4c22-afd2-ffae8a58c0c5", "address": "fa:16:3e:4c:4f:e1", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4146457e-4b", "ovs_interfaceid": "4146457e-4b16-4c22-afd2-ffae8a58c0c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:47:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ae1fba90-67d2-4ae4-84c7-51695ca6debc tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Releasing lock "refresh_cache-73fd9bc1-af0f-41e9-adea-d73323b4a76c" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:47:26 user nova-compute[71498]: DEBUG nova.objects.instance [None req-ae1fba90-67d2-4ae4-84c7-51695ca6debc tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lazy-loading 'flavor' on Instance uuid 73fd9bc1-af0f-41e9-adea-d73323b4a76c {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:47:26 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:26 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:27 user nova-compute[71498]: DEBUG nova.compute.manager [req-78b728dc-36de-4a42-8f49-c2ae7a95c579 req-bc669e39-b256-4f46-83a2-6f015d9df28b service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Received event network-vif-unplugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:47:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-78b728dc-36de-4a42-8f49-c2ae7a95c579 req-bc669e39-b256-4f46-83a2-6f015d9df28b service nova] Acquiring lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:47:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-78b728dc-36de-4a42-8f49-c2ae7a95c579 req-bc669e39-b256-4f46-83a2-6f015d9df28b service nova] Lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:47:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-78b728dc-36de-4a42-8f49-c2ae7a95c579 req-bc669e39-b256-4f46-83a2-6f015d9df28b service nova] Lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:47:27 user nova-compute[71498]: DEBUG nova.compute.manager [req-78b728dc-36de-4a42-8f49-c2ae7a95c579 req-bc669e39-b256-4f46-83a2-6f015d9df28b service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] No waiting events found dispatching network-vif-unplugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:47:27 user nova-compute[71498]: WARNING nova.compute.manager [req-78b728dc-36de-4a42-8f49-c2ae7a95c579 req-bc669e39-b256-4f46-83a2-6f015d9df28b service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Received unexpected event network-vif-unplugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 for instance with vm_state rescued and task_state unrescuing.
Apr 14 01:47:27 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:47:27 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:47:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.561s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:47:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 01:47:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 01:47:27 user nova-compute[71498]: DEBUG nova.network.neutron [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:47:27 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 01:47:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 01:47:27 user nova-compute[71498]: INFO nova.virt.block_device [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Booting with volume f9cb54ed-9520-43e9-a1c8-2be10b7f955e at /dev/vda
Apr 14 01:47:27 user nova-compute[71498]: DEBUG nova.policy [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50e3354ac1a84c59a7dee8e1ae6e771a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f4117a4adb4aa3b42951cf1fc84237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:47:27 user nova-compute[71498]: DEBUG os_brick.utils [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:47:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:27 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee29ed42-d2d7-43c7-a6da-e4a5ca473a69]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:27 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f6a48c-9cf1-4bca-bdaf-5f198b73dc89]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:27 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dd1f1d-0fef-465b-a52d-e3a3113ac82d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:27 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74aeb08-7ec2-4bc0-adc8-754edbd018c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:47:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:47:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:27 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Instance destroyed successfully.
Apr 14 01:47:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:47:27 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:47:27 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e083529-2f8e-493e-a038-e3e8c64d99a8]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:47:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:47:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:47:27 user nova-compute[71498]: DEBUG os_brick.utils [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:47:27 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Updating existing volume attachment record: 8027938d-3ad1-4401-b369-fc538dd26498 {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:47:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:28 user nova-compute[71498]: DEBUG nova.network.neutron [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Successfully created port: d58d1594-1a97-4a63-be67-e8101e889654 {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:47:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:29 user nova-compute[71498]: DEBUG nova.compute.manager [req-f961e85a-b26b-41b3-a31f-15eb24d9d88e req-85d08394-13de-4adc-b0a3-5405082e0748 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Received event network-vif-plugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:47:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f961e85a-b26b-41b3-a31f-15eb24d9d88e req-85d08394-13de-4adc-b0a3-5405082e0748 service nova] Acquiring lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:47:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f961e85a-b26b-41b3-a31f-15eb24d9d88e req-85d08394-13de-4adc-b0a3-5405082e0748 service nova] Lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:47:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f961e85a-b26b-41b3-a31f-15eb24d9d88e req-85d08394-13de-4adc-b0a3-5405082e0748 service nova] Lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:47:29 user nova-compute[71498]: DEBUG nova.compute.manager [req-f961e85a-b26b-41b3-a31f-15eb24d9d88e req-85d08394-13de-4adc-b0a3-5405082e0748 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] No waiting events found dispatching network-vif-plugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:47:29 user nova-compute[71498]: WARNING nova.compute.manager [req-f961e85a-b26b-41b3-a31f-15eb24d9d88e req-85d08394-13de-4adc-b0a3-5405082e0748 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Received unexpected event network-vif-plugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 for instance with vm_state rescued and task_state unrescuing.
Apr 14 01:47:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:29 user nova-compute[71498]: DEBUG nova.network.neutron [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Successfully updated port: d58d1594-1a97-4a63-be67-e8101e889654 {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:47:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "refresh_cache-1ccf53b5-9199-4812-a635-4f4f22fb5d28" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:47:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquired lock "refresh_cache-1ccf53b5-9199-4812-a635-4f4f22fb5d28" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:47:29 user nova-compute[71498]: DEBUG nova.network.neutron [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:47:29 user nova-compute[71498]: DEBUG nova.compute.manager [req-58559704-ce2e-4c51-8837-6332f81c1a01 req-e5f92eff-016f-4656-9a08-cbb75cc21378 service nova] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Received event network-changed-d58d1594-1a97-4a63-be67-e8101e889654 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:47:29 user nova-compute[71498]: DEBUG nova.compute.manager [req-58559704-ce2e-4c51-8837-6332f81c1a01 req-e5f92eff-016f-4656-9a08-cbb75cc21378 service nova] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Refreshing instance network info cache due to event network-changed-d58d1594-1a97-4a63-be67-e8101e889654. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:47:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-58559704-ce2e-4c51-8837-6332f81c1a01 req-e5f92eff-016f-4656-9a08-cbb75cc21378 service nova] Acquiring lock "refresh_cache-1ccf53b5-9199-4812-a635-4f4f22fb5d28" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:47:29 user nova-compute[71498]: DEBUG nova.network.neutron [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:47:29 user nova-compute[71498]: DEBUG nova.network.neutron [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Updating instance_info_cache with network_info: [{"id": "d58d1594-1a97-4a63-be67-e8101e889654", "address": "fa:16:3e:1d:82:b9", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd58d1594-1a", "ovs_interfaceid": "d58d1594-1a97-4a63-be67-e8101e889654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:47:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Releasing lock "refresh_cache-1ccf53b5-9199-4812-a635-4f4f22fb5d28" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:47:29 user nova-compute[71498]: DEBUG nova.compute.manager [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Instance network_info: |[{"id": "d58d1594-1a97-4a63-be67-e8101e889654", "address": "fa:16:3e:1d:82:b9", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd58d1594-1a", "ovs_interfaceid": "d58d1594-1a97-4a63-be67-e8101e889654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 01:47:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-58559704-ce2e-4c51-8837-6332f81c1a01 req-e5f92eff-016f-4656-9a08-cbb75cc21378 service nova] Acquired lock "refresh_cache-1ccf53b5-9199-4812-a635-4f4f22fb5d28" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:47:29 user nova-compute[71498]: DEBUG nova.network.neutron [req-58559704-ce2e-4c51-8837-6332f81c1a01 req-e5f92eff-016f-4656-9a08-cbb75cc21378 service nova] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Refreshing network info cache for port d58d1594-1a97-4a63-be67-e8101e889654 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:47:30 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:47:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:47:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:47:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:47:30 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 01:47:30 user nova-compute[71498]: DEBUG nova.network.neutron [req-58559704-ce2e-4c51-8837-6332f81c1a01 req-e5f92eff-016f-4656-9a08-cbb75cc21378 service nova] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Updated VIF entry in instance network info cache for port d58d1594-1a97-4a63-be67-e8101e889654. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:47:30 user nova-compute[71498]: DEBUG nova.network.neutron [req-58559704-ce2e-4c51-8837-6332f81c1a01 req-e5f92eff-016f-4656-9a08-cbb75cc21378 service nova] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Updating instance_info_cache with network_info: [{"id": "d58d1594-1a97-4a63-be67-e8101e889654", "address": "fa:16:3e:1d:82:b9", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd58d1594-1a", "ovs_interfaceid": "d58d1594-1a97-4a63-be67-e8101e889654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:47:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-58559704-ce2e-4c51-8837-6332f81c1a01 req-e5f92eff-016f-4656-9a08-cbb75cc21378 service nova] Releasing lock "refresh_cache-1ccf53b5-9199-4812-a635-4f4f22fb5d28" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:47:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Removed pending event for 73fd9bc1-af0f-41e9-adea-d73323b4a76c due to event {{(pid=71498) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 01:47:31 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436851.1134727, 73fd9bc1-af0f-41e9-adea-d73323b4a76c => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:47:31 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] VM Resumed (Lifecycle Event)
Apr 14 01:47:31 user nova-compute[71498]: DEBUG nova.compute.manager [None req-ae1fba90-67d2-4ae4-84c7-51695ca6debc tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:47:31 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:47:31 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:47:31 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 01:47:31 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436851.1156416, 73fd9bc1-af0f-41e9-adea-d73323b4a76c => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:47:31 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] VM Started (Lifecycle Event)
Apr 14 01:47:31 user nova-compute[71498]: DEBUG nova.compute.manager [req-35d3e59c-7396-475f-94fd-c1841de8d346 req-de6e6eee-c856-4bac-8818-d587bf2809c5 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Received event network-vif-plugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:47:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-35d3e59c-7396-475f-94fd-c1841de8d346 req-de6e6eee-c856-4bac-8818-d587bf2809c5 service nova] Acquiring lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:47:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-35d3e59c-7396-475f-94fd-c1841de8d346 req-de6e6eee-c856-4bac-8818-d587bf2809c5 service nova] Lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:47:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-35d3e59c-7396-475f-94fd-c1841de8d346 req-de6e6eee-c856-4bac-8818-d587bf2809c5 service nova] Lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:47:31 user nova-compute[71498]: DEBUG nova.compute.manager [req-35d3e59c-7396-475f-94fd-c1841de8d346 req-de6e6eee-c856-4bac-8818-d587bf2809c5 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] No waiting events found dispatching network-vif-plugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:47:31 user nova-compute[71498]: WARNING nova.compute.manager [req-35d3e59c-7396-475f-94fd-c1841de8d346 req-de6e6eee-c856-4bac-8818-d587bf2809c5 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Received unexpected event network-vif-plugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 for instance with vm_state rescued and task_state unrescuing.
Apr 14 01:47:31 user nova-compute[71498]: DEBUG nova.compute.manager [req-35d3e59c-7396-475f-94fd-c1841de8d346 req-de6e6eee-c856-4bac-8818-d587bf2809c5 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Received event network-vif-plugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:47:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-35d3e59c-7396-475f-94fd-c1841de8d346 req-de6e6eee-c856-4bac-8818-d587bf2809c5 service nova] Acquiring lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:47:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-35d3e59c-7396-475f-94fd-c1841de8d346 req-de6e6eee-c856-4bac-8818-d587bf2809c5 service nova] Lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:47:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-35d3e59c-7396-475f-94fd-c1841de8d346 req-de6e6eee-c856-4bac-8818-d587bf2809c5 service nova] Lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:47:31 user nova-compute[71498]: DEBUG nova.compute.manager [req-35d3e59c-7396-475f-94fd-c1841de8d346 req-de6e6eee-c856-4bac-8818-d587bf2809c5 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] No waiting events found dispatching network-vif-plugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:47:31 user nova-compute[71498]: WARNING nova.compute.manager [req-35d3e59c-7396-475f-94fd-c1841de8d346 req-de6e6eee-c856-4bac-8818-d587bf2809c5 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Received unexpected event network-vif-plugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 for instance with vm_state rescued and task_state unrescuing.
Apr 14 01:47:31 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:47:31 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:47:31 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 01:47:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:47:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:47:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:47:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk --force-share --output=json" returned: 0 in 0.458s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07/disk --force-share --output=json" returned: 0 in 0.311s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk --force-share --output=json" returned: 0 in 0.303s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:32 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:47:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG nova.compute.manager [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:47:33 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Creating image(s)
Apr 14 01:47:33 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Did not create local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Ensure instance console log exists: /opt/stack/data/nova/instances/1ccf53b5-9199-4812-a635-4f4f22fb5d28/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Start _get_guest_xml network_info=[{"id": "d58d1594-1a97-4a63-be67-e8101e889654", "address": "fa:16:3e:1d:82:b9", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd58d1594-1a", "ovs_interfaceid": "d58d1594-1a97-4a63-be67-e8101e889654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8027938d-3ad1-4401-b369-fc538dd26498', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sxmOykTu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1ccf53b5-9199-4812-a635-4f4f22fb5d28', 'attached_at': '', 'detached_at': '', 'volume_id': 'f9cb54ed-9520-43e9-a1c8-2be10b7f955e', 'serial': 'f9cb54ed-9520-43e9-a1c8-2be10b7f955e'}, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:47:33 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:47:33 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:47:33 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sxmOykTu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:47:33 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:47:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:47:33 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:47:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:47:33 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:47:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fdd33e-c09b-4f16-8bc5-7749531d481e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:47:33 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[055d3502-7625-4b71-b4e2-17b1a7aea61c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e] added
Apr 14 01:47:33 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0268f49c-20a9-471b-913b-a91b1a6827bd]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[66edd81b-d2cd-4d92-a8e8-f51189594d88]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:47:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sxmOykTu {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sxmOykTu" returned: 0 in 0.257s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed94eefc-c2fa-4d88-9cd7-8bec46c3ad65]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sxmOykTu'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d95fc1-e9e5-4b2a-8a60-a410bb275654]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbd3009-bb36-4015-a376-c4f2058538c5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:47:34 user nova-compute[71498]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:47:34 user nova-compute[71498]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)
Apr 14 01:47:34 user nova-compute[71498]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)
Apr 14 01:47:34 user nova-compute[71498]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)
Apr 14 01:47:34 user nova-compute[71498]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f (non-flash)
Apr 14 01:47:34 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:47:34 user nova-compute[71498]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:47:34 user nova-compute[71498]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)
Apr 14 01:47:34 user nova-compute[71498]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)
Apr 14 01:47:34 user nova-compute[71498]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)
Apr 14 01:47:34 user nova-compute[71498]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f (non-flash)
Apr 14 01:47:34 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json" returned: 0 in 0.777s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f59fab-2846-4c0e-bd77-26245a3234e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e, portal: 172.16.0.220,3260]
Apr 14 01:47:34 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e, portal: 172.16.0.220,3260] successful.
Apr 14 01:47:34 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6754703-ce9a-4175-8c9c-7827f53284aa]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1f4662-0566-43ec-9c4d-ab20b4e4058c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:47:34 user nova-compute[71498]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:47:34 user nova-compute[71498]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)
Apr 14 01:47:34 user nova-compute[71498]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)
Apr 14 01:47:34 user nova-compute[71498]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)
Apr 14 01:47:34 user nova-compute[71498]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f (non-flash)
Apr 14 01:47:34 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:47:34 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:47:34 user nova-compute[71498]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:47:34 user nova-compute[71498]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)
Apr 14 01:47:34 user nova-compute[71498]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)
Apr 14 01:47:34 user nova-compute[71498]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)
Apr 14 01:47:34 user nova-compute[71498]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:867d3b5e-ebe5-4dfe-b37b-1d6589e7d19f (non-flash)
Apr 14 01:47:34 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:47:34 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.598s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] HCTL ('39', '-', '-', 0) found on session 21 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.027s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[29258dff-03ac-49be-baa9-f05fc2bd7548]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Searching for a device in session 21 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sxmOykTu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:47:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:35 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.691s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:47:35 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] <== connect_volume: return (1695ms) {'type': 'block', 'scsi_wwn': '23362363461653238', 'path': '/dev/sdh'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:47:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362363461653238', 'path': '/dev/sdh'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:47:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:47:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-305851277',display_name='tempest-TestVolumeBootPattern-volume-backed-server-305851277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-305851277',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1f4117a4adb4aa3b42951cf1fc84237',ramdisk_id='',reservation_id='r-1jywfjut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-224521177',owner_user_name='tempest-TestVolumeBootPattern-224521177-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:47:27Z,user_data=None,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',uuid=1ccf53b5-9199-4812-a635-4f4f22fb5d28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d58d1594-1a97-4a63-be67-e8101e889654", "address": "fa:16:3e:1d:82:b9", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd58d1594-1a", "ovs_interfaceid": "d58d1594-1a97-4a63-be67-e8101e889654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:47:35 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converting VIF {"id": "d58d1594-1a97-4a63-be67-e8101e889654", "address": "fa:16:3e:1d:82:b9", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd58d1594-1a", "ovs_interfaceid": "d58d1594-1a97-4a63-be67-e8101e889654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:47:35 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:82:b9,bridge_name='br-int',has_traffic_filtering=True,id=d58d1594-1a97-4a63-be67-e8101e889654,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd58d1594-1a') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:47:35 user nova-compute[71498]: DEBUG nova.objects.instance [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ccf53b5-9199-4812-a635-4f4f22fb5d28 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:47:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:47:35 user nova-compute[71498]:   <uuid>1ccf53b5-9199-4812-a635-4f4f22fb5d28</uuid>
Apr 14 01:47:35 user nova-compute[71498]:   <name>instance-00000017</name>
Apr 14 01:47:35 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:47:35 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:47:35 user nova-compute[71498]:   <metadata>
Apr 14 01:47:35 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:47:35 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:47:35 user nova-compute[71498]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-305851277</nova:name>
Apr 14 01:47:35 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:47:33</nova:creationTime>
Apr 14 01:47:35 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:47:35 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:47:35 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:47:35 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:47:35 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:47:35 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:47:35 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:47:35 user nova-compute[71498]:       <nova:owner>
Apr 14 01:47:35 user nova-compute[71498]:         <nova:user uuid="50e3354ac1a84c59a7dee8e1ae6e771a">tempest-TestVolumeBootPattern-224521177-project-member</nova:user>
Apr 14 01:47:35 user nova-compute[71498]:         <nova:project uuid="c1f4117a4adb4aa3b42951cf1fc84237">tempest-TestVolumeBootPattern-224521177</nova:project>
Apr 14 01:47:35 user nova-compute[71498]:       </nova:owner>
Apr 14 01:47:35 user nova-compute[71498]:       <nova:ports>
Apr 14 01:47:35 user nova-compute[71498]:         <nova:port uuid="d58d1594-1a97-4a63-be67-e8101e889654">
Apr 14 01:47:35 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 01:47:35 user nova-compute[71498]:         </nova:port>
Apr 14 01:47:35 user nova-compute[71498]:       </nova:ports>
Apr 14 01:47:35 user nova-compute[71498]:     </nova:instance>
Apr 14 01:47:35 user nova-compute[71498]:   </metadata>
Apr 14 01:47:35 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:47:35 user nova-compute[71498]:     <system>
Apr 14 01:47:35 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:47:35 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:47:35 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:47:35 user nova-compute[71498]:       <entry name="serial">1ccf53b5-9199-4812-a635-4f4f22fb5d28</entry>
Apr 14 01:47:35 user nova-compute[71498]:       <entry name="uuid">1ccf53b5-9199-4812-a635-4f4f22fb5d28</entry>
Apr 14 01:47:35 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:47:35 user nova-compute[71498]:     </system>
Apr 14 01:47:35 user nova-compute[71498]:   </sysinfo>
Apr 14 01:47:35 user nova-compute[71498]:   <os>
Apr 14 01:47:35 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:47:35 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:47:35 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:47:35 user nova-compute[71498]:   </os>
Apr 14 01:47:35 user nova-compute[71498]:   <features>
Apr 14 01:47:35 user nova-compute[71498]:     <acpi/>
Apr 14 01:47:35 user nova-compute[71498]:     <apic/>
Apr 14 01:47:35 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:47:35 user nova-compute[71498]:   </features>
Apr 14 01:47:35 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:47:35 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:47:35 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:47:35 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:47:35 user nova-compute[71498]:   </clock>
Apr 14 01:47:35 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:47:35 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:47:35 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:47:35 user nova-compute[71498]:   </cpu>
Apr 14 01:47:35 user nova-compute[71498]:   <devices>
Apr 14 01:47:35 user nova-compute[71498]:     <disk type="block" device="disk">
Apr 14 01:47:35 user nova-compute[71498]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:47:35 user nova-compute[71498]:       <source dev="/dev/sdh"/>
Apr 14 01:47:35 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:47:35 user nova-compute[71498]:       <serial>f9cb54ed-9520-43e9-a1c8-2be10b7f955e</serial>
Apr 14 01:47:35 user nova-compute[71498]:     </disk>
Apr 14 01:47:35 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:47:35 user nova-compute[71498]:       <mac address="fa:16:3e:1d:82:b9"/>
Apr 14 01:47:35 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:47:35 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:47:35 user nova-compute[71498]:       <target dev="tapd58d1594-1a"/>
Apr 14 01:47:35 user nova-compute[71498]:     </interface>
Apr 14 01:47:35 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:47:35 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/1ccf53b5-9199-4812-a635-4f4f22fb5d28/console.log" append="off"/>
Apr 14 01:47:35 user nova-compute[71498]:     </serial>
Apr 14 01:47:35 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:47:35 user nova-compute[71498]:     <video>
Apr 14 01:47:35 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:47:35 user nova-compute[71498]:     </video>
Apr 14 01:47:35 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:47:35 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:47:35 user nova-compute[71498]:     </rng>
Apr 14 01:47:35 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:47:35 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:47:35 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:47:35 user nova-compute[71498]:     </memballoon>
Apr 14 01:47:35 user nova-compute[71498]:   </devices>
Apr 14 01:47:35 user nova-compute[71498]: </domain>
Apr 14 01:47:35 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:47:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:47:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-305851277',display_name='tempest-TestVolumeBootPattern-volume-backed-server-305851277',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-305851277',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1f4117a4adb4aa3b42951cf1fc84237',ramdisk_id='',reservation_id='r-1jywfjut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-224521177',owner_user_name='tempest-TestVolumeBootPattern-224521177-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:47:27Z,user_data=None,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',uuid=1ccf53b5-9199-4812-a635-4f4f22fb5d28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d58d1594-1a97-4a63-be67-e8101e889654", "address": "fa:16:3e:1d:82:b9", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd58d1594-1a", "ovs_interfaceid": "d58d1594-1a97-4a63-be67-e8101e889654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:47:35 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converting VIF {"id": "d58d1594-1a97-4a63-be67-e8101e889654", "address": "fa:16:3e:1d:82:b9", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd58d1594-1a", "ovs_interfaceid": "d58d1594-1a97-4a63-be67-e8101e889654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:47:35 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:82:b9,bridge_name='br-int',has_traffic_filtering=True,id=d58d1594-1a97-4a63-be67-e8101e889654,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd58d1594-1a') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:47:35 user nova-compute[71498]: DEBUG os_vif [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:82:b9,bridge_name='br-int',has_traffic_filtering=True,id=d58d1594-1a97-4a63-be67-e8101e889654,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd58d1594-1a') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:47:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:47:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:47:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd58d1594-1a, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:47:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd58d1594-1a, col_values=(('external_ids', {'iface-id': 'd58d1594-1a97-4a63-be67-e8101e889654', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:82:b9', 'vm-uuid': '1ccf53b5-9199-4812-a635-4f4f22fb5d28'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:47:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:47:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:35 user nova-compute[71498]: INFO os_vif [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:82:b9,bridge_name='br-int',has_traffic_filtering=True,id=d58d1594-1a97-4a63-be67-e8101e889654,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd58d1594-1a')
Apr 14 01:47:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:47:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] No VIF found with MAC fa:16:3e:1d:82:b9, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436859.6821306, 1ccf53b5-9199-4812-a635-4f4f22fb5d28 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:47:40 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] VM Resumed (Lifecycle Event)
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-db97c858-b843-4ee3-b22e-2b1c333141d1 req-97199599-29c1-40bd-b6d7-8d03b906cb0c service nova] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Received event network-vif-plugged-d58d1594-1a97-4a63-be67-e8101e889654 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-db97c858-b843-4ee3-b22e-2b1c333141d1 req-97199599-29c1-40bd-b6d7-8d03b906cb0c service nova] Acquiring lock "1ccf53b5-9199-4812-a635-4f4f22fb5d28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-db97c858-b843-4ee3-b22e-2b1c333141d1 req-97199599-29c1-40bd-b6d7-8d03b906cb0c service nova] Lock "1ccf53b5-9199-4812-a635-4f4f22fb5d28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-db97c858-b843-4ee3-b22e-2b1c333141d1 req-97199599-29c1-40bd-b6d7-8d03b906cb0c service nova] Lock "1ccf53b5-9199-4812-a635-4f4f22fb5d28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-db97c858-b843-4ee3-b22e-2b1c333141d1 req-97199599-29c1-40bd-b6d7-8d03b906cb0c service nova] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] No waiting events found dispatching network-vif-plugged-d58d1594-1a97-4a63-be67-e8101e889654 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:47:40 user nova-compute[71498]: WARNING nova.compute.manager [req-db97c858-b843-4ee3-b22e-2b1c333141d1 req-97199599-29c1-40bd-b6d7-8d03b906cb0c service nova] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Received unexpected event network-vif-plugged-d58d1594-1a97-4a63-be67-e8101e889654 for instance with vm_state building and task_state spawning.
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-f97c3216-788b-4299-8639-b67df578bad7 req-d4f61779-8355-432a-bc17-c963155e2066 service nova] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Received event network-vif-plugged-d58d1594-1a97-4a63-be67-e8101e889654 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f97c3216-788b-4299-8639-b67df578bad7 req-d4f61779-8355-432a-bc17-c963155e2066 service nova] Acquiring lock "1ccf53b5-9199-4812-a635-4f4f22fb5d28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f97c3216-788b-4299-8639-b67df578bad7 req-d4f61779-8355-432a-bc17-c963155e2066 service nova] Lock "1ccf53b5-9199-4812-a635-4f4f22fb5d28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f97c3216-788b-4299-8639-b67df578bad7 req-d4f61779-8355-432a-bc17-c963155e2066 service nova] Lock "1ccf53b5-9199-4812-a635-4f4f22fb5d28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-f97c3216-788b-4299-8639-b67df578bad7 req-d4f61779-8355-432a-bc17-c963155e2066 service nova] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] No waiting events found dispatching network-vif-plugged-d58d1594-1a97-4a63-be67-e8101e889654 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:47:40 user nova-compute[71498]: WARNING nova.compute.manager [req-f97c3216-788b-4299-8639-b67df578bad7 req-d4f61779-8355-432a-bc17-c963155e2066 service nova] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Received unexpected event network-vif-plugged-d58d1594-1a97-4a63-be67-e8101e889654 for instance with vm_state building and task_state spawning.
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.compute.manager [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:47:40 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Instance spawned successfully.
Apr 14 01:47:40 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:47:40 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=7512MB free_disk=26.009571075439453GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:47:40 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436859.6830075, 1ccf53b5-9199-4812-a635-4f4f22fb5d28 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:47:40 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] VM Started (Lifecycle Event)
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:47:40 user nova-compute[71498]: INFO nova.compute.manager [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Took 6.50 seconds to spawn the instance on the hypervisor.
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.compute.manager [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:47:40 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance da60f4f1-2474-453f-8f84-c95daf02431a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance a19a1c08-5454-481b-bb5a-70c39ead9afc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance fa29c144-0ff9-4efb-a574-f521d18f08fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 74311da6-d6b8-4aea-b6ce-97db8da53800 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance ee4cf01f-8d33-4696-b6ec-7f188ee18026 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 4f8101aa-2078-4f0e-becb-62636c747c60 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 1ccf53b5-9199-4812-a635-4f4f22fb5d28 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 01:47:40 user nova-compute[71498]: INFO nova.compute.manager [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Took 13.88 seconds to build instance.
Apr 14 01:47:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5d209768-0db8-4c62-a616-71e512c84f75 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "1ccf53b5-9199-4812-a635-4f4f22fb5d28" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.995s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 01:47:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.646s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:47:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:41 user nova-compute[71498]: DEBUG nova.compute.manager [req-a287fa03-a506-4605-8a0b-0db3c1240308 req-13c56b74-0d55-43b2-b018-f83987d1e4aa service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Received event network-changed-20a227b0-3b4d-4df0-b583-071771a0ae44 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:47:41 user nova-compute[71498]: DEBUG nova.compute.manager [req-a287fa03-a506-4605-8a0b-0db3c1240308 req-13c56b74-0d55-43b2-b018-f83987d1e4aa service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Refreshing instance network info cache due to event network-changed-20a227b0-3b4d-4df0-b583-071771a0ae44. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:47:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a287fa03-a506-4605-8a0b-0db3c1240308 req-13c56b74-0d55-43b2-b018-f83987d1e4aa service nova] Acquiring lock "refresh_cache-74311da6-d6b8-4aea-b6ce-97db8da53800" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:47:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a287fa03-a506-4605-8a0b-0db3c1240308 req-13c56b74-0d55-43b2-b018-f83987d1e4aa service nova] Acquired lock "refresh_cache-74311da6-d6b8-4aea-b6ce-97db8da53800" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:47:41 user nova-compute[71498]: DEBUG nova.network.neutron [req-a287fa03-a506-4605-8a0b-0db3c1240308 req-13c56b74-0d55-43b2-b018-f83987d1e4aa service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Refreshing network info cache for port 20a227b0-3b4d-4df0-b583-071771a0ae44 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:47:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "74311da6-d6b8-4aea-b6ce-97db8da53800" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:47:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:47:41 user nova-compute[71498]: DEBUG nova.objects.instance [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lazy-loading 'flavor' on Instance uuid 74311da6-d6b8-4aea-b6ce-97db8da53800 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:47:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:47:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "74311da6-d6b8-4aea-b6ce-97db8da53800" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:47:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:47:42 user nova-compute[71498]: INFO nova.compute.manager [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Attaching volume 64fbddc5-4def-42b8-8084-284892fa8b62 to /dev/vdb
Apr 14 01:47:42 user nova-compute[71498]: DEBUG os_brick.utils [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:47:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:42 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae739acc-2f3f-42d2-bfdc-d3eae39c6b85]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:42 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b5e82f-9fc6-4b21-b452-578d94fbc996]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.037s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:42 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[824758e3-9772-46b5-bbad-a225a29c7c08]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:42 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce03c573-75dc-4b91-8302-853a2fbfafba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:47:42 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:47:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:47:42 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:47:42 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5c3419-2b85-42d8-9739-582dcbee8388]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:42 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:47:42 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:47:42 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:47:42 user nova-compute[71498]: DEBUG os_brick.utils [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] <== get_connector_properties: return (188ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:47:42 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Updating existing volume attachment record: eb686bb5-ca2f-4c57-91c1-aed639bae3bb {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:47:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:42 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:47:42 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:47:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 01:47:42 user nova-compute[71498]: DEBUG nova.network.neutron [req-a287fa03-a506-4605-8a0b-0db3c1240308 req-13c56b74-0d55-43b2-b018-f83987d1e4aa service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Updated VIF entry in instance network info cache for port 20a227b0-3b4d-4df0-b583-071771a0ae44. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:47:42 user nova-compute[71498]: DEBUG nova.network.neutron [req-a287fa03-a506-4605-8a0b-0db3c1240308 req-13c56b74-0d55-43b2-b018-f83987d1e4aa service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Updating instance_info_cache with network_info: [{"id": "20a227b0-3b4d-4df0-b583-071771a0ae44", "address": "fa:16:3e:c7:d7:5e", "network": {"id": "31f4b7e9-13bd-4aca-b6c3-a283c637ed63", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-802021657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "740488dbb5114fb2b38be20f8ce4adb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a227b0-3b", "ovs_interfaceid": "20a227b0-3b4d-4df0-b583-071771a0ae44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:47:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a287fa03-a506-4605-8a0b-0db3c1240308 req-13c56b74-0d55-43b2-b018-f83987d1e4aa service nova] Releasing lock "refresh_cache-74311da6-d6b8-4aea-b6ce-97db8da53800" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:47:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-8e042a42-7cc2-4d72-b7ed-2b80339f2c85" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:47:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-8e042a42-7cc2-4d72-b7ed-2b80339f2c85" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:47:42 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 01:47:43 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Updating instance_info_cache with network_info: [{"id": "ed749832-992f-44d3-8316-87f59088b737", "address": "fa:16:3e:98:9d:2e", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped749832-99", "ovs_interfaceid": "ed749832-992f-44d3-8316-87f59088b737", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:47:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-8e042a42-7cc2-4d72-b7ed-2b80339f2c85" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:47:43 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 01:47:43 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:47:43 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:47:43 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:47:43 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:47:43 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:47:43 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:47:43 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 01:47:44 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:45 user nova-compute[71498]: DEBUG nova.compute.manager [req-2c524d3a-236a-4529-9893-9c7dd4693849 req-4846167c-05b5-4152-b943-c68e253b7c51 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Received event network-changed-9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:47:45 user nova-compute[71498]: DEBUG nova.compute.manager [req-2c524d3a-236a-4529-9893-9c7dd4693849 req-4846167c-05b5-4152-b943-c68e253b7c51 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Refreshing instance network info cache due to event network-changed-9b10b56a-df5a-429e-a551-db729007648a. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:47:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-2c524d3a-236a-4529-9893-9c7dd4693849 req-4846167c-05b5-4152-b943-c68e253b7c51 service nova] Acquiring lock "refresh_cache-ee4cf01f-8d33-4696-b6ec-7f188ee18026" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:47:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-2c524d3a-236a-4529-9893-9c7dd4693849 req-4846167c-05b5-4152-b943-c68e253b7c51 service nova] Acquired lock "refresh_cache-ee4cf01f-8d33-4696-b6ec-7f188ee18026" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:47:45 user nova-compute[71498]: DEBUG nova.network.neutron [req-2c524d3a-236a-4529-9893-9c7dd4693849 req-4846167c-05b5-4152-b943-c68e253b7c51 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Refreshing network info cache for port 9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:47:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:47:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:47:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:47:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:47:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:47:45 user nova-compute[71498]: INFO nova.compute.manager [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Terminating instance
Apr 14 01:47:45 user nova-compute[71498]: DEBUG nova.compute.manager [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 01:47:45 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:45 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:45 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:45 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:45 user nova-compute[71498]: DEBUG nova.compute.manager [req-d06d5dae-167d-406b-a229-e5fadc8c3d8a req-43ee0b26-e964-4939-96b4-d8423a803088 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Received event network-vif-unplugged-9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:47:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d06d5dae-167d-406b-a229-e5fadc8c3d8a req-43ee0b26-e964-4939-96b4-d8423a803088 service nova] Acquiring lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:47:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d06d5dae-167d-406b-a229-e5fadc8c3d8a req-43ee0b26-e964-4939-96b4-d8423a803088 service nova] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:47:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d06d5dae-167d-406b-a229-e5fadc8c3d8a req-43ee0b26-e964-4939-96b4-d8423a803088 service nova] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:47:45 user nova-compute[71498]: DEBUG nova.compute.manager [req-d06d5dae-167d-406b-a229-e5fadc8c3d8a req-43ee0b26-e964-4939-96b4-d8423a803088 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] No waiting events found dispatching network-vif-unplugged-9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:47:45 user nova-compute[71498]: DEBUG nova.compute.manager [req-d06d5dae-167d-406b-a229-e5fadc8c3d8a req-43ee0b26-e964-4939-96b4-d8423a803088 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Received event network-vif-unplugged-9b10b56a-df5a-429e-a551-db729007648a for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:47:45 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:45 user nova-compute[71498]: DEBUG nova.network.neutron [req-2c524d3a-236a-4529-9893-9c7dd4693849 req-4846167c-05b5-4152-b943-c68e253b7c51 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Updated VIF entry in instance network info cache for port 9b10b56a-df5a-429e-a551-db729007648a. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:47:45 user nova-compute[71498]: DEBUG nova.network.neutron [req-2c524d3a-236a-4529-9893-9c7dd4693849 req-4846167c-05b5-4152-b943-c68e253b7c51 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Updating instance_info_cache with network_info: [{"id": "9b10b56a-df5a-429e-a551-db729007648a", "address": "fa:16:3e:89:b1:39", "network": {"id": "4f7f7e24-860c-47ce-b635-be72e8fe2913", "bridge": "br-int", "label": "tempest-TestShelveInstance-1817709221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef081a56d11d4b4d82ba5fe6572f3b95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b10b56a-df", "ovs_interfaceid": "9b10b56a-df5a-429e-a551-db729007648a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:47:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-2c524d3a-236a-4529-9893-9c7dd4693849 req-4846167c-05b5-4152-b943-c68e253b7c51 service nova] Releasing lock "refresh_cache-ee4cf01f-8d33-4696-b6ec-7f188ee18026" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:47:46 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Instance destroyed successfully.
Apr 14 01:47:46 user nova-compute[71498]: DEBUG nova.objects.instance [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lazy-loading 'resources' on Instance uuid ee4cf01f-8d33-4696-b6ec-7f188ee18026 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T01:42:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1018221636',display_name='tempest-TestShelveInstance-server-1018221636',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1018221636',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8oQGYR+FY0LiM859XrQ9H3YlzTk6smIp49cfjoqSvxd/aONSV1r/k9gt1d5Db4fmA7gXaDRWLZ6VOsvQ07UleStWf5lgaLtfeieMukM+I8PpxvvoXTX8ZP8xMyS5I5RA==',key_name='tempest-TestShelveInstance-711764184',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:46:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef081a56d11d4b4d82ba5fe6572f3b95',ramdisk_id='',reservation_id='r-fjanozaf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-437254779',owner_user_name='tempest-TestShelveInstance-437254779-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:46:07Z,user_data=None,user_id='447da297b18f4e7f86fa94cd4d5d7918',uuid=ee4cf01f-8d33-4696-b6ec-7f188ee18026,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b10b56a-df5a-429e-a551-db729007648a", "address": "fa:16:3e:89:b1:39", "network": {"id": "4f7f7e24-860c-47ce-b635-be72e8fe2913", "bridge": "br-int", "label": "tempest-TestShelveInstance-1817709221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef081a56d11d4b4d82ba5fe6572f3b95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b10b56a-df", "ovs_interfaceid": "9b10b56a-df5a-429e-a551-db729007648a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Converting VIF {"id": "9b10b56a-df5a-429e-a551-db729007648a", "address": "fa:16:3e:89:b1:39", "network": {"id": "4f7f7e24-860c-47ce-b635-be72e8fe2913", "bridge": "br-int", "label": "tempest-TestShelveInstance-1817709221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef081a56d11d4b4d82ba5fe6572f3b95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b10b56a-df", "ovs_interfaceid": "9b10b56a-df5a-429e-a551-db729007648a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:b1:39,bridge_name='br-int',has_traffic_filtering=True,id=9b10b56a-df5a-429e-a551-db729007648a,network=Network(4f7f7e24-860c-47ce-b635-be72e8fe2913),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b10b56a-df') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG os_vif [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:b1:39,bridge_name='br-int',has_traffic_filtering=True,id=9b10b56a-df5a-429e-a551-db729007648a,network=Network(4f7f7e24-860c-47ce-b635-be72e8fe2913),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b10b56a-df') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b10b56a-df, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:46 user nova-compute[71498]: INFO os_vif [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:b1:39,bridge_name='br-int',has_traffic_filtering=True,id=9b10b56a-df5a-429e-a551-db729007648a,network=Network(4f7f7e24-860c-47ce-b635-be72e8fe2913),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b10b56a-df')
Apr 14 01:47:46 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eLIEctAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:47:46 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:47:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bddc87-b989-4f80-9207-786a4314bce7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:47:46 user nova-compute[71498]: No targets found.
Apr 14 01:47:46 user nova-compute[71498]: iSNS:
Apr 14 01:47:46 user nova-compute[71498]: No targets found.
Apr 14 01:47:46 user nova-compute[71498]: STATIC:
Apr 14 01:47:46 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8
Apr 14 01:47:46 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:47:46 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:47:46 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53
Apr 14 01:47:46 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:47:46 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:47:46 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d
Apr 14 01:47:46 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:47:46 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:47:46 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b
Apr 14 01:47:46 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:47:46 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:47:46 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e
Apr 14 01:47:46 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:47:46 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:47:46 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22
Apr 14 01:47:46 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:47:46 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:47:46 user nova-compute[71498]: FIRMWARE:
Apr 14 01:47:46 user nova-compute[71498]: No targets found.
Apr 14 01:47:46 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:47:46 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:47:46 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbc9d60-f77a-47fa-8d98-21c337386a79]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c1b867-16f7-4aa0-90ee-c0a0c4a453a5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:47:46 user nova-compute[71498]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:47:46 user nova-compute[71498]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)
Apr 14 01:47:46 user nova-compute[71498]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)
Apr 14 01:47:46 user nova-compute[71498]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)
Apr 14 01:47:46 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:47:46 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:47:46 user nova-compute[71498]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 (non-flash)
Apr 14 01:47:46 user nova-compute[71498]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)
Apr 14 01:47:46 user nova-compute[71498]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)
Apr 14 01:47:46 user nova-compute[71498]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)
Apr 14 01:47:46 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:47:46 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52014937f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53'): ({'sde'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Removing single pathed devices sde {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2667c1e-8e3a-447b-83ff-c8c75cc11c00]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe83350-3961-45b4-9768-8b4e235ddcbf]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Flushing IO for device /dev/sde {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00ce8c3-ae20-4b59-aeac-7cf05ab33aed]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.058s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef113ea6-b739-4610-b3f6-268731a88051]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] SCSI volumes sde have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO27cdafdd-a43d3506631a64cd', '/dev/disk/by-id/scsi-26134336433353036', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_27cdafdd') {{(pid=81721) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[badd7477-537c-44ae-9822-d7077d98e4f1]: (4, None) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf66b25-04f1-4e43-864f-d4a020c83884]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5e08aa-f73f-45d7-82df-fc331aa9c195]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53, portal: 172.16.0.220,3260]
Apr 14 01:47:46 user nova-compute[71498]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53, portal: 172.16.0.220,3260] successful.
Apr 14 01:47:46 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f78596d7-c339-491a-a0d2-470a1c158a53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[549fc675-29f1-4991-8b16-0fa75923d6d3]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] <== disconnect_volume: return (413ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:47:46 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Deleting instance files /opt/stack/data/nova/instances/ee4cf01f-8d33-4696-b6ec-7f188ee18026_del
Apr 14 01:47:46 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Deletion of /opt/stack/data/nova/instances/ee4cf01f-8d33-4696-b6ec-7f188ee18026_del complete
Apr 14 01:47:46 user nova-compute[71498]: INFO nova.compute.manager [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Took 1.33 seconds to destroy the instance on the hypervisor.
Apr 14 01:47:46 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 01:47:46 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:47:47 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Took 0.64 seconds to deallocate network for instance.
Apr 14 01:47:47 user nova-compute[71498]: DEBUG nova.compute.manager [req-08f452fb-ccdc-425f-b1e8-d3d55fe31025 req-7ad1c449-41ff-4f05-a002-162dc86235b7 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Received event network-vif-deleted-9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'csJKGTSq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:47:47 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:47:47 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:47:47 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:47:47 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:47:47 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:47:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7858b446-a5d4-4b3c-9512-ea61d18ebce3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:47:47 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3775c9-8019-4f9e-bfe0-425288120d55]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62] added
Apr 14 01:47:47 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[498bb2a0-7e3d-4c56-821e-84f246ca43c5]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG nova.compute.manager [req-e14b6a5a-ff15-4024-bbe6-692053d1f22f req-076b1ff6-9d11-49e6-b7e9-ea01673016d9 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Received event network-vif-plugged-9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e14b6a5a-ff15-4024-bbe6-692053d1f22f req-076b1ff6-9d11-49e6-b7e9-ea01673016d9 service nova] Acquiring lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e14b6a5a-ff15-4024-bbe6-692053d1f22f req-076b1ff6-9d11-49e6-b7e9-ea01673016d9 service nova] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e14b6a5a-ff15-4024-bbe6-692053d1f22f req-076b1ff6-9d11-49e6-b7e9-ea01673016d9 service nova] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG nova.compute.manager [req-e14b6a5a-ff15-4024-bbe6-692053d1f22f req-076b1ff6-9d11-49e6-b7e9-ea01673016d9 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] No waiting events found dispatching network-vif-plugged-9b10b56a-df5a-429e-a551-db729007648a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:47:47 user nova-compute[71498]: WARNING nova.compute.manager [req-e14b6a5a-ff15-4024-bbe6-692053d1f22f req-076b1ff6-9d11-49e6-b7e9-ea01673016d9 service nova] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Received unexpected event network-vif-plugged-9b10b56a-df5a-429e-a551-db729007648a for instance with vm_state active and task_state deleting.
Apr 14 01:47:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa22c8ce-a573-417e-81f8-3be3737d6fa2]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v csJKGTSq {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v csJKGTSq" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ed4ebc-41d8-4cc7-aeb1-05a4ee79056b]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'csJKGTSq'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4820ba73-fbcc-4dba-9afc-8d7f180d2fb6]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[238ee159-f464-4467-9c9b-425a43b455b7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:47:47 user nova-compute[71498]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)
Apr 14 01:47:47 user nova-compute[71498]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)
Apr 14 01:47:47 user nova-compute[71498]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)
Apr 14 01:47:47 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:47:47 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:47:47 user nova-compute[71498]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)
Apr 14 01:47:47 user nova-compute[71498]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)
Apr 14 01:47:47 user nova-compute[71498]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)
Apr 14 01:47:47 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:47:47 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4aa7e8e-68dc-4452-a426-29f1ac4fcb65]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62, portal: 172.16.0.220,3260]
Apr 14 01:47:47 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62, portal: 172.16.0.220,3260] successful.
Apr 14 01:47:47 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3141ab3-ba57-4539-950d-ec38082d534c]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[918abcd6-edb5-4e9c-875c-b31a6e89af00]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:47:47 user nova-compute[71498]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)
Apr 14 01:47:47 user nova-compute[71498]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)
Apr 14 01:47:47 user nova-compute[71498]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)
Apr 14 01:47:47 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:47:47 user nova-compute[71498]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 (non-flash)
Apr 14 01:47:47 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:47:47 user nova-compute[71498]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)
Apr 14 01:47:47 user nova-compute[71498]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)
Apr 14 01:47:47 user nova-compute[71498]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)
Apr 14 01:47:47 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:47:47 user nova-compute[71498]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 (non-flash)
Apr 14 01:47:47 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:47:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:47:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:47:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b1471f-4e1d-4845-9f57-a75cc92d27f1]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:47:48 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:47:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'csJKGTSq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:47:48 user nova-compute[71498]: INFO nova.compute.manager [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Took 0.94 seconds to detach 1 volumes for instance.
Apr 14 01:47:48 user nova-compute[71498]: DEBUG nova.compute.manager [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Deleting volume: f78596d7-c339-491a-a0d2-470a1c158a53 {{(pid=71498) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 01:47:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:47:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:47:48 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:47:48 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:47:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.422s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:47:48 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Deleted allocations for instance ee4cf01f-8d33-4696-b6ec-7f188ee18026
Apr 14 01:47:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-068fb27f-0739-41e3-9df3-4d00630526dd tempest-TestShelveInstance-437254779 tempest-TestShelveInstance-437254779-project-member] Lock "ee4cf01f-8d33-4696-b6ec-7f188ee18026" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.639s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:47:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:47:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '26162623361316436', 'path': '/dev/sdc'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:47:49 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162623361316436', 'path': '/dev/sdc'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:47:49 user nova-compute[71498]: DEBUG nova.objects.instance [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lazy-loading 'flavor' on Instance uuid 74311da6-d6b8-4aea-b6ce-97db8da53800 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:47:49 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 01:47:49 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:47:49 user nova-compute[71498]:   <source dev="/dev/sdc"/>
Apr 14 01:47:49 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:47:49 user nova-compute[71498]:   <serial>64fbddc5-4def-42b8-8084-284892fa8b62</serial>
Apr 14 01:47:49 user nova-compute[71498]: </disk>
Apr 14 01:47:49 user nova-compute[71498]:  {{(pid=71498) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 01:47:49 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:47:49 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:47:49 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] No VIF found with MAC fa:16:3e:c7:d7:5e, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:47:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-420b21b6-15d4-404d-a8cd-c5fe966d510f tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.544s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:47:51 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:47:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "74311da6-d6b8-4aea-b6ce-97db8da53800" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:47:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:47:59 user nova-compute[71498]: INFO nova.compute.manager [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Detaching volume 64fbddc5-4def-42b8-8084-284892fa8b62
Apr 14 01:47:59 user nova-compute[71498]: INFO nova.virt.block_device [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Attempting to driver detach volume 64fbddc5-4def-42b8-8084-284892fa8b62 from mountpoint /dev/vdb
Apr 14 01:47:59 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Attempting to detach device vdb from instance 74311da6-d6b8-4aea-b6ce-97db8da53800 from the persistent domain config. {{(pid=71498) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 01:47:59 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 01:47:59 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:47:59 user nova-compute[71498]:   <source dev="/dev/sdc"/>
Apr 14 01:47:59 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:47:59 user nova-compute[71498]:   <serial>64fbddc5-4def-42b8-8084-284892fa8b62</serial>
Apr 14 01:47:59 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 01:47:59 user nova-compute[71498]: </disk>
Apr 14 01:47:59 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:47:59 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Successfully detached device vdb from instance 74311da6-d6b8-4aea-b6ce-97db8da53800 from the persistent domain config.
Apr 14 01:47:59 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 74311da6-d6b8-4aea-b6ce-97db8da53800 from the live domain config. {{(pid=71498) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 01:47:59 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 01:47:59 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:47:59 user nova-compute[71498]:   <source dev="/dev/sdc"/>
Apr 14 01:47:59 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:47:59 user nova-compute[71498]:   <serial>64fbddc5-4def-42b8-8084-284892fa8b62</serial>
Apr 14 01:47:59 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 01:47:59 user nova-compute[71498]: </disk>
Apr 14 01:47:59 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Received event <DeviceRemovedEvent: 1681436880.1761873, 74311da6-d6b8-4aea-b6ce-97db8da53800 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71498) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 74311da6-d6b8-4aea-b6ce-97db8da53800 {{(pid=71498) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 01:48:00 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Successfully detached device vdb from instance 74311da6-d6b8-4aea-b6ce-97db8da53800 from the live domain config.
Apr 14 01:48:00 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'csJKGTSq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:48:00 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:48:00 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcab5cd4-85ed-486e-bd07-bd5662ba4739]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:48:00 user nova-compute[71498]: No targets found.
Apr 14 01:48:00 user nova-compute[71498]: iSNS:
Apr 14 01:48:00 user nova-compute[71498]: No targets found.
Apr 14 01:48:00 user nova-compute[71498]: STATIC:
Apr 14 01:48:00 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8
Apr 14 01:48:00 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:48:00 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:48:00 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d
Apr 14 01:48:00 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:48:00 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:48:00 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b
Apr 14 01:48:00 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:48:00 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:48:00 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e
Apr 14 01:48:00 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:48:00 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:48:00 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22
Apr 14 01:48:00 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:48:00 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:48:00 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62
Apr 14 01:48:00 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:48:00 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:48:00 user nova-compute[71498]: FIRMWARE:
Apr 14 01:48:00 user nova-compute[71498]: No targets found.
Apr 14 01:48:00 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:48:00 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:48:00 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff69622d-ed89-4e0f-a6de-4fd83fb58487]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a6178e-4853-4baa-b673-996833e48091]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:48:00 user nova-compute[71498]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)
Apr 14 01:48:00 user nova-compute[71498]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)
Apr 14 01:48:00 user nova-compute[71498]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)
Apr 14 01:48:00 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:48:00 user nova-compute[71498]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 (non-flash)
Apr 14 01:48:00 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:48:00 user nova-compute[71498]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)
Apr 14 01:48:00 user nova-compute[71498]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)
Apr 14 01:48:00 user nova-compute[71498]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)
Apr 14 01:48:00 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:48:00 user nova-compute[71498]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 (non-flash)
Apr 14 01:48:00 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5201493490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62'): ({'sdc'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Removing single pathed devices sdc {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[89636a60-747d-4b84-8f9a-2cd5abacde67]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb9f3b7-51f8-448e-bbb0-5f094269d627]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Flushing IO for device /dev/sdc {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[886c6314-c1ab-42bc-90e1-724f12e984bf]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6cd31b-93a7-4f9e-8649-bb521d9d33e5]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] SCSI volumes sdc have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c292c465-1484-430b-b2ab-081acb84946e]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[401e6d4d-b7e9-4556-8bc4-ae030e879378]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62, portal: 172.16.0.220,3260]
Apr 14 01:48:00 user nova-compute[71498]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62, portal: 172.16.0.220,3260] successful.
Apr 14 01:48:00 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fbddc5-4def-42b8-8084-284892fa8b62 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2959cd61-d975-4f76-b2fc-b13f55c714a9]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] <== disconnect_volume: return (352ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:48:00 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:48:01 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681436866.11835, ee4cf01f-8d33-4696-b6ec-7f188ee18026 => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:48:01 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] VM Stopped (Lifecycle Event)
Apr 14 01:48:01 user nova-compute[71498]: DEBUG nova.compute.manager [None req-7cc3f4f9-f935-4b86-82c7-5b4062cb8128 None None] [instance: ee4cf01f-8d33-4696-b6ec-7f188ee18026] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:48:01 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:01 user nova-compute[71498]: DEBUG nova.objects.instance [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lazy-loading 'flavor' on Instance uuid 74311da6-d6b8-4aea-b6ce-97db8da53800 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:48:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9b758d40-9b9b-4fe3-8e9d-233278c06f7e tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.765s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:48:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dfc31a49-9b65-4dfe-9804-d8664ff6c345 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:48:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dfc31a49-9b65-4dfe-9804-d8664ff6c345 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:48:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dfc31a49-9b65-4dfe-9804-d8664ff6c345 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:48:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dfc31a49-9b65-4dfe-9804-d8664ff6c345 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:48:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dfc31a49-9b65-4dfe-9804-d8664ff6c345 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:48:03 user nova-compute[71498]: INFO nova.compute.manager [None req-dfc31a49-9b65-4dfe-9804-d8664ff6c345 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Terminating instance
Apr 14 01:48:03 user nova-compute[71498]: DEBUG nova.compute.manager [None req-dfc31a49-9b65-4dfe-9804-d8664ff6c345 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 01:48:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:03 user nova-compute[71498]: DEBUG nova.compute.manager [req-ef126774-e276-42e9-bac0-60fed880f9e1 req-a3df8620-3fc5-4092-9e84-2eb48c208806 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Received event network-vif-unplugged-7942720d-0958-4826-bedf-0a7eebfe45b6 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:48:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ef126774-e276-42e9-bac0-60fed880f9e1 req-a3df8620-3fc5-4092-9e84-2eb48c208806 service nova] Acquiring lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:48:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ef126774-e276-42e9-bac0-60fed880f9e1 req-a3df8620-3fc5-4092-9e84-2eb48c208806 service nova] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:48:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ef126774-e276-42e9-bac0-60fed880f9e1 req-a3df8620-3fc5-4092-9e84-2eb48c208806 service nova] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:48:03 user nova-compute[71498]: DEBUG nova.compute.manager [req-ef126774-e276-42e9-bac0-60fed880f9e1 req-a3df8620-3fc5-4092-9e84-2eb48c208806 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] No waiting events found dispatching network-vif-unplugged-7942720d-0958-4826-bedf-0a7eebfe45b6 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:48:03 user nova-compute[71498]: DEBUG nova.compute.manager [req-ef126774-e276-42e9-bac0-60fed880f9e1 req-a3df8620-3fc5-4092-9e84-2eb48c208806 service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Received event network-vif-unplugged-7942720d-0958-4826-bedf-0a7eebfe45b6 for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:48:04 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Instance destroyed successfully.
Apr 14 01:48:04 user nova-compute[71498]: DEBUG nova.objects.instance [None req-dfc31a49-9b65-4dfe-9804-d8664ff6c345 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lazy-loading 'resources' on Instance uuid 3a3fb53f-7b4a-48d3-85ab-418bad435c07 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:48:04 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-dfc31a49-9b65-4dfe-9804-d8664ff6c345 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:40:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1267413302',display_name='tempest-ServerStableDeviceRescueTest-server-1267413302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1267413302',id=4,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClEbUZCS4BNpBa3d/c+E5gxA0W0UKOCjR2aXoCFkSjH1TtZ7VyBn5ergCTIl3tkCVYAq22i3BavCcYyS+Tyc9WpPRWr8ud0N+f5IiF1KOJhw1hKiESl8P8LoB9KVFwn9Q==',key_name='tempest-keypair-1599380679',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:44:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4833ddea1fa74866b97ef52a730605aa',ramdisk_id='',reservation_id='r-8cuxpjqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-131403183',owner_user_name='tempest-ServerStableDeviceRescueTest-131403183-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:46:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f09ab986a00f43b384cf5d517857a13d',uuid=3a3fb53f-7b4a-48d3-85ab-418bad435c07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7942720d-0958-4826-bedf-0a7eebfe45b6", "address": "fa:16:3e:0c:0e:df", "network": {"id": "95555a4e-9d95-4509-a683-f61ea2dc38a1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-560359898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4833ddea1fa74866b97ef52a730605aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7942720d-09", "ovs_interfaceid": "7942720d-0958-4826-bedf-0a7eebfe45b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:48:04 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-dfc31a49-9b65-4dfe-9804-d8664ff6c345 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Converting VIF {"id": "7942720d-0958-4826-bedf-0a7eebfe45b6", "address": "fa:16:3e:0c:0e:df", "network": {"id": "95555a4e-9d95-4509-a683-f61ea2dc38a1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-560359898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4833ddea1fa74866b97ef52a730605aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7942720d-09", "ovs_interfaceid": "7942720d-0958-4826-bedf-0a7eebfe45b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:48:04 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-dfc31a49-9b65-4dfe-9804-d8664ff6c345 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:0e:df,bridge_name='br-int',has_traffic_filtering=True,id=7942720d-0958-4826-bedf-0a7eebfe45b6,network=Network(95555a4e-9d95-4509-a683-f61ea2dc38a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7942720d-09') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:48:04 user nova-compute[71498]: DEBUG os_vif [None req-dfc31a49-9b65-4dfe-9804-d8664ff6c345 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:0e:df,bridge_name='br-int',has_traffic_filtering=True,id=7942720d-0958-4826-bedf-0a7eebfe45b6,network=Network(95555a4e-9d95-4509-a683-f61ea2dc38a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7942720d-09') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:48:04 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:04 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7942720d-09, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:48:04 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:04 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:04 user nova-compute[71498]: INFO os_vif [None req-dfc31a49-9b65-4dfe-9804-d8664ff6c345 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:0e:df,bridge_name='br-int',has_traffic_filtering=True,id=7942720d-0958-4826-bedf-0a7eebfe45b6,network=Network(95555a4e-9d95-4509-a683-f61ea2dc38a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7942720d-09')
Apr 14 01:48:04 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-dfc31a49-9b65-4dfe-9804-d8664ff6c345 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Deleting instance files /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07_del
Apr 14 01:48:04 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-dfc31a49-9b65-4dfe-9804-d8664ff6c345 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Deletion of /opt/stack/data/nova/instances/3a3fb53f-7b4a-48d3-85ab-418bad435c07_del complete
Apr 14 01:48:04 user nova-compute[71498]: INFO nova.compute.manager [None req-dfc31a49-9b65-4dfe-9804-d8664ff6c345 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 14 01:48:04 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-dfc31a49-9b65-4dfe-9804-d8664ff6c345 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 01:48:04 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 01:48:04 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 01:48:05 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:48:05 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Took 1.10 seconds to deallocate network for instance.
Apr 14 01:48:05 user nova-compute[71498]: DEBUG nova.compute.manager [req-736edba7-42af-43de-8c3d-807b18a99101 req-e60d38fe-07e8-4c4d-982f-ca49a05a074c service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Received event network-vif-deleted-7942720d-0958-4826-bedf-0a7eebfe45b6 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:48:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dfc31a49-9b65-4dfe-9804-d8664ff6c345 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:48:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dfc31a49-9b65-4dfe-9804-d8664ff6c345 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:48:05 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-dfc31a49-9b65-4dfe-9804-d8664ff6c345 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:48:05 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-dfc31a49-9b65-4dfe-9804-d8664ff6c345 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:48:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dfc31a49-9b65-4dfe-9804-d8664ff6c345 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:48:05 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-dfc31a49-9b65-4dfe-9804-d8664ff6c345 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Deleted allocations for instance 3a3fb53f-7b4a-48d3-85ab-418bad435c07
Apr 14 01:48:05 user nova-compute[71498]: DEBUG nova.compute.manager [req-18ca7b14-32d5-48b9-88dc-22aa9d6bbbca req-15ca018a-3f38-4d31-a284-8377589f18fc service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Received event network-vif-plugged-7942720d-0958-4826-bedf-0a7eebfe45b6 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:48:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-18ca7b14-32d5-48b9-88dc-22aa9d6bbbca req-15ca018a-3f38-4d31-a284-8377589f18fc service nova] Acquiring lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:48:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-18ca7b14-32d5-48b9-88dc-22aa9d6bbbca req-15ca018a-3f38-4d31-a284-8377589f18fc service nova] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:48:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-18ca7b14-32d5-48b9-88dc-22aa9d6bbbca req-15ca018a-3f38-4d31-a284-8377589f18fc service nova] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:48:05 user nova-compute[71498]: DEBUG nova.compute.manager [req-18ca7b14-32d5-48b9-88dc-22aa9d6bbbca req-15ca018a-3f38-4d31-a284-8377589f18fc service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] No waiting events found dispatching network-vif-plugged-7942720d-0958-4826-bedf-0a7eebfe45b6 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:48:05 user nova-compute[71498]: WARNING nova.compute.manager [req-18ca7b14-32d5-48b9-88dc-22aa9d6bbbca req-15ca018a-3f38-4d31-a284-8377589f18fc service nova] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Received unexpected event network-vif-plugged-7942720d-0958-4826-bedf-0a7eebfe45b6 for instance with vm_state deleted and task_state None.
Apr 14 01:48:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dfc31a49-9b65-4dfe-9804-d8664ff6c345 tempest-ServerStableDeviceRescueTest-131403183 tempest-ServerStableDeviceRescueTest-131403183-project-member] Lock "3a3fb53f-7b4a-48d3-85ab-418bad435c07" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.462s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:48:07 user nova-compute[71498]: DEBUG nova.compute.manager [req-1c88285e-a311-4d00-9258-3a6bbc6566c3 req-649e3b0c-aa8f-4952-a35f-5ae950285334 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-changed-0912c834-ed73-4f3a-9419-2c08d6094b93 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:48:07 user nova-compute[71498]: DEBUG nova.compute.manager [req-1c88285e-a311-4d00-9258-3a6bbc6566c3 req-649e3b0c-aa8f-4952-a35f-5ae950285334 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Refreshing instance network info cache due to event network-changed-0912c834-ed73-4f3a-9419-2c08d6094b93. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:48:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1c88285e-a311-4d00-9258-3a6bbc6566c3 req-649e3b0c-aa8f-4952-a35f-5ae950285334 service nova] Acquiring lock "refresh_cache-4f8101aa-2078-4f0e-becb-62636c747c60" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:48:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1c88285e-a311-4d00-9258-3a6bbc6566c3 req-649e3b0c-aa8f-4952-a35f-5ae950285334 service nova] Acquired lock "refresh_cache-4f8101aa-2078-4f0e-becb-62636c747c60" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:48:07 user nova-compute[71498]: DEBUG nova.network.neutron [req-1c88285e-a311-4d00-9258-3a6bbc6566c3 req-649e3b0c-aa8f-4952-a35f-5ae950285334 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Refreshing network info cache for port 0912c834-ed73-4f3a-9419-2c08d6094b93 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:48:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "4f8101aa-2078-4f0e-becb-62636c747c60" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:48:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "4f8101aa-2078-4f0e-becb-62636c747c60" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:48:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:48:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:48:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:48:08 user nova-compute[71498]: INFO nova.compute.manager [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Terminating instance
Apr 14 01:48:08 user nova-compute[71498]: DEBUG nova.compute.manager [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 01:48:08 user nova-compute[71498]: DEBUG nova.network.neutron [req-1c88285e-a311-4d00-9258-3a6bbc6566c3 req-649e3b0c-aa8f-4952-a35f-5ae950285334 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Updated VIF entry in instance network info cache for port 0912c834-ed73-4f3a-9419-2c08d6094b93. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:48:08 user nova-compute[71498]: DEBUG nova.network.neutron [req-1c88285e-a311-4d00-9258-3a6bbc6566c3 req-649e3b0c-aa8f-4952-a35f-5ae950285334 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Updating instance_info_cache with network_info: [{"id": "0912c834-ed73-4f3a-9419-2c08d6094b93", "address": "fa:16:3e:6f:18:a2", "network": {"id": "92cd3f98-b66a-42aa-a5fa-47916885d4d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1332848290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912c834-ed", "ovs_interfaceid": "0912c834-ed73-4f3a-9419-2c08d6094b93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e9a3669-2ccb-49fc-a153-dfcee715ad41", "address": "fa:16:3e:c6:76:24", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e9a3669-2c", "ovs_interfaceid": "4e9a3669-2ccb-49fc-a153-dfcee715ad41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a", "address": "fa:16:3e:b5:e1:f6", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c1d9b5-b9", "ovs_interfaceid": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6532dff7-2168-407f-be9b-bdbea1b6edd4", "address": "fa:16:3e:03:01:eb", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6532dff7-21", "ovs_interfaceid": "6532dff7-2168-407f-be9b-bdbea1b6edd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f12d4d92-cf6a-4908-a203-d32ad80cb617", "address": "fa:16:3e:45:3e:13", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12d4d92-cf", "ovs_interfaceid": "f12d4d92-cf6a-4908-a203-d32ad80cb617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6517ba71-e7ec-4e68-8860-714bb4711368", "address": "fa:16:3e:f2:29:a3", "network": {"id": "7b28d758-6a84-4044-814b-714f0f210494", "bridge": "br-int", "label": "tempest-device-tagging-net2-2125292444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6517ba71-e7", "ovs_interfaceid": "6517ba71-e7ec-4e68-8860-714bb4711368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9894ad9b-db8c-4729-bd7b-ebb28b91af2b", "address": "fa:16:3e:e0:e1:5b", "network": {"id": "7b28d758-6a84-4044-814b-714f0f210494", "bridge": "br-int", "label": "tempest-device-tagging-net2-2125292444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9894ad9b-db", "ovs_interfaceid": "9894ad9b-db8c-4729-bd7b-ebb28b91af2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:48:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1c88285e-a311-4d00-9258-3a6bbc6566c3 req-649e3b0c-aa8f-4952-a35f-5ae950285334 service nova] Releasing lock "refresh_cache-4f8101aa-2078-4f0e-becb-62636c747c60" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:48:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:08 user nova-compute[71498]: DEBUG nova.compute.manager [req-a64930c9-e9d4-4993-aa4c-21dfc5776ea9 req-219496e6-026a-43d7-ba0b-5c3ddcdafbdf service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-unplugged-0912c834-ed73-4f3a-9419-2c08d6094b93 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:48:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a64930c9-e9d4-4993-aa4c-21dfc5776ea9 req-219496e6-026a-43d7-ba0b-5c3ddcdafbdf service nova] Acquiring lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:48:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a64930c9-e9d4-4993-aa4c-21dfc5776ea9 req-219496e6-026a-43d7-ba0b-5c3ddcdafbdf service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:48:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a64930c9-e9d4-4993-aa4c-21dfc5776ea9 req-219496e6-026a-43d7-ba0b-5c3ddcdafbdf service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:48:08 user nova-compute[71498]: DEBUG nova.compute.manager [req-a64930c9-e9d4-4993-aa4c-21dfc5776ea9 req-219496e6-026a-43d7-ba0b-5c3ddcdafbdf service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] No waiting events found dispatching network-vif-unplugged-0912c834-ed73-4f3a-9419-2c08d6094b93 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:48:08 user nova-compute[71498]: DEBUG nova.compute.manager [req-a64930c9-e9d4-4993-aa4c-21dfc5776ea9 req-219496e6-026a-43d7-ba0b-5c3ddcdafbdf service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-unplugged-0912c834-ed73-4f3a-9419-2c08d6094b93 for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:48:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:08 user nova-compute[71498]: DEBUG nova.compute.manager [req-382e1d22-ed33-4e26-b824-8fca88035ab6 req-cb2865fd-9afc-4782-be45-f51aef99327c service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-unplugged-b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:48:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-382e1d22-ed33-4e26-b824-8fca88035ab6 req-cb2865fd-9afc-4782-be45-f51aef99327c service nova] Acquiring lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:48:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-382e1d22-ed33-4e26-b824-8fca88035ab6 req-cb2865fd-9afc-4782-be45-f51aef99327c service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:48:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-382e1d22-ed33-4e26-b824-8fca88035ab6 req-cb2865fd-9afc-4782-be45-f51aef99327c service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:48:08 user nova-compute[71498]: DEBUG nova.compute.manager [req-382e1d22-ed33-4e26-b824-8fca88035ab6 req-cb2865fd-9afc-4782-be45-f51aef99327c service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] No waiting events found dispatching network-vif-unplugged-b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:48:08 user nova-compute[71498]: DEBUG nova.compute.manager [req-382e1d22-ed33-4e26-b824-8fca88035ab6 req-cb2865fd-9afc-4782-be45-f51aef99327c service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-unplugged-b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:48:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:09 user nova-compute[71498]: DEBUG nova.compute.manager [req-fd52d64f-0792-42a0-93d1-ab0c740eef08 req-1960d174-1639-4904-893f-696642eff05c service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-unplugged-4e9a3669-2ccb-49fc-a153-dfcee715ad41 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:48:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-fd52d64f-0792-42a0-93d1-ab0c740eef08 req-1960d174-1639-4904-893f-696642eff05c service nova] Acquiring lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:48:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-fd52d64f-0792-42a0-93d1-ab0c740eef08 req-1960d174-1639-4904-893f-696642eff05c service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:48:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-fd52d64f-0792-42a0-93d1-ab0c740eef08 req-1960d174-1639-4904-893f-696642eff05c service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:48:09 user nova-compute[71498]: DEBUG nova.compute.manager [req-fd52d64f-0792-42a0-93d1-ab0c740eef08 req-1960d174-1639-4904-893f-696642eff05c service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] No waiting events found dispatching network-vif-unplugged-4e9a3669-2ccb-49fc-a153-dfcee715ad41 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:48:09 user nova-compute[71498]: DEBUG nova.compute.manager [req-fd52d64f-0792-42a0-93d1-ab0c740eef08 req-1960d174-1639-4904-893f-696642eff05c service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-unplugged-4e9a3669-2ccb-49fc-a153-dfcee715ad41 for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:48:09 user nova-compute[71498]: DEBUG nova.compute.manager [req-fd52d64f-0792-42a0-93d1-ab0c740eef08 req-1960d174-1639-4904-893f-696642eff05c service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-plugged-4e9a3669-2ccb-49fc-a153-dfcee715ad41 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:48:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-fd52d64f-0792-42a0-93d1-ab0c740eef08 req-1960d174-1639-4904-893f-696642eff05c service nova] Acquiring lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:48:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-fd52d64f-0792-42a0-93d1-ab0c740eef08 req-1960d174-1639-4904-893f-696642eff05c service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:48:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-fd52d64f-0792-42a0-93d1-ab0c740eef08 req-1960d174-1639-4904-893f-696642eff05c service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:48:09 user nova-compute[71498]: DEBUG nova.compute.manager [req-fd52d64f-0792-42a0-93d1-ab0c740eef08 req-1960d174-1639-4904-893f-696642eff05c service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] No waiting events found dispatching network-vif-plugged-4e9a3669-2ccb-49fc-a153-dfcee715ad41 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:48:09 user nova-compute[71498]: WARNING nova.compute.manager [req-fd52d64f-0792-42a0-93d1-ab0c740eef08 req-1960d174-1639-4904-893f-696642eff05c service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received unexpected event network-vif-plugged-4e9a3669-2ccb-49fc-a153-dfcee715ad41 for instance with vm_state active and task_state deleting.
Apr 14 01:48:09 user nova-compute[71498]: DEBUG nova.compute.manager [req-fd52d64f-0792-42a0-93d1-ab0c740eef08 req-1960d174-1639-4904-893f-696642eff05c service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-unplugged-6517ba71-e7ec-4e68-8860-714bb4711368 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:48:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-fd52d64f-0792-42a0-93d1-ab0c740eef08 req-1960d174-1639-4904-893f-696642eff05c service nova] Acquiring lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:48:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-fd52d64f-0792-42a0-93d1-ab0c740eef08 req-1960d174-1639-4904-893f-696642eff05c service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:48:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-fd52d64f-0792-42a0-93d1-ab0c740eef08 req-1960d174-1639-4904-893f-696642eff05c service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:48:09 user nova-compute[71498]: DEBUG nova.compute.manager [req-fd52d64f-0792-42a0-93d1-ab0c740eef08 req-1960d174-1639-4904-893f-696642eff05c service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] No waiting events found dispatching network-vif-unplugged-6517ba71-e7ec-4e68-8860-714bb4711368 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:48:09 user nova-compute[71498]: DEBUG nova.compute.manager [req-fd52d64f-0792-42a0-93d1-ab0c740eef08 req-1960d174-1639-4904-893f-696642eff05c service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-unplugged-6517ba71-e7ec-4e68-8860-714bb4711368 for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:48:10 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Instance destroyed successfully.
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.objects.instance [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lazy-loading 'resources' on Instance uuid 4f8101aa-2078-4f0e-becb-62636c747c60 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:46:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1084378513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1084378513',id=22,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYcWoVO7ZIi629hlkoHGAWtZdBozaG+O8MlSk2AwbH3DI+89IdiX5w/s5MTTIPas7dysNJjR6PIkb1jVAoIejGsoq6jIv/+Zz3sXz4wQO4UkFM2Gq/c7mopuRv8MulFtQ==',key_name='tempest-keypair-1639753774',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:46:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7782019f67b04982a58ed5272dc4cbb5',ramdisk_id='',reservation_id='r-0dgirqv3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-819739955',owner_user_name='tempest-TaggedBootDevicesTest_v242-819739955-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:46:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e5234d2ffe4dc898d22be4bd648c47',uuid=4f8101aa-2078-4f0e-becb-62636c747c60,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0912c834-ed73-4f3a-9419-2c08d6094b93", "address": "fa:16:3e:6f:18:a2", "network": {"id": "92cd3f98-b66a-42aa-a5fa-47916885d4d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1332848290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912c834-ed", "ovs_interfaceid": "0912c834-ed73-4f3a-9419-2c08d6094b93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converting VIF {"id": "0912c834-ed73-4f3a-9419-2c08d6094b93", "address": "fa:16:3e:6f:18:a2", "network": {"id": "92cd3f98-b66a-42aa-a5fa-47916885d4d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1332848290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912c834-ed", "ovs_interfaceid": "0912c834-ed73-4f3a-9419-2c08d6094b93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:18:a2,bridge_name='br-int',has_traffic_filtering=True,id=0912c834-ed73-4f3a-9419-2c08d6094b93,network=Network(92cd3f98-b66a-42aa-a5fa-47916885d4d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0912c834-ed') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_vif [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:18:a2,bridge_name='br-int',has_traffic_filtering=True,id=0912c834-ed73-4f3a-9419-2c08d6094b93,network=Network(92cd3f98-b66a-42aa-a5fa-47916885d4d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0912c834-ed') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0912c834-ed, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:10 user nova-compute[71498]: INFO os_vif [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:18:a2,bridge_name='br-int',has_traffic_filtering=True,id=0912c834-ed73-4f3a-9419-2c08d6094b93,network=Network(92cd3f98-b66a-42aa-a5fa-47916885d4d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0912c834-ed')
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:46:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1084378513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1084378513',id=22,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYcWoVO7ZIi629hlkoHGAWtZdBozaG+O8MlSk2AwbH3DI+89IdiX5w/s5MTTIPas7dysNJjR6PIkb1jVAoIejGsoq6jIv/+Zz3sXz4wQO4UkFM2Gq/c7mopuRv8MulFtQ==',key_name='tempest-keypair-1639753774',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:46:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7782019f67b04982a58ed5272dc4cbb5',ramdisk_id='',reservation_id='r-0dgirqv3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-819739955',owner_user_name='tempest-TaggedBootDevicesTest_v242-819739955-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:46:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e5234d2ffe4dc898d22be4bd648c47',uuid=4f8101aa-2078-4f0e-becb-62636c747c60,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e9a3669-2ccb-49fc-a153-dfcee715ad41", "address": "fa:16:3e:c6:76:24", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e9a3669-2c", "ovs_interfaceid": "4e9a3669-2ccb-49fc-a153-dfcee715ad41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converting VIF {"id": "4e9a3669-2ccb-49fc-a153-dfcee715ad41", "address": "fa:16:3e:c6:76:24", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e9a3669-2c", "ovs_interfaceid": "4e9a3669-2ccb-49fc-a153-dfcee715ad41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:76:24,bridge_name='br-int',has_traffic_filtering=True,id=4e9a3669-2ccb-49fc-a153-dfcee715ad41,network=Network(3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4e9a3669-2c') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_vif [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:76:24,bridge_name='br-int',has_traffic_filtering=True,id=4e9a3669-2ccb-49fc-a153-dfcee715ad41,network=Network(3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4e9a3669-2c') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e9a3669-2c, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:10 user nova-compute[71498]: INFO os_vif [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:76:24,bridge_name='br-int',has_traffic_filtering=True,id=4e9a3669-2ccb-49fc-a153-dfcee715ad41,network=Network(3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4e9a3669-2c')
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:46:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1084378513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1084378513',id=22,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYcWoVO7ZIi629hlkoHGAWtZdBozaG+O8MlSk2AwbH3DI+89IdiX5w/s5MTTIPas7dysNJjR6PIkb1jVAoIejGsoq6jIv/+Zz3sXz4wQO4UkFM2Gq/c7mopuRv8MulFtQ==',key_name='tempest-keypair-1639753774',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:46:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7782019f67b04982a58ed5272dc4cbb5',ramdisk_id='',reservation_id='r-0dgirqv3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-819739955',owner_user_name='tempest-TaggedBootDevicesTest_v242-819739955-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:46:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e5234d2ffe4dc898d22be4bd648c47',uuid=4f8101aa-2078-4f0e-becb-62636c747c60,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a", "address": "fa:16:3e:b5:e1:f6", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c1d9b5-b9", "ovs_interfaceid": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converting VIF {"id": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a", "address": "fa:16:3e:b5:e1:f6", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c1d9b5-b9", "ovs_interfaceid": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:e1:f6,bridge_name='br-int',has_traffic_filtering=True,id=b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a,network=Network(3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb1c1d9b5-b9') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_vif [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:e1:f6,bridge_name='br-int',has_traffic_filtering=True,id=b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a,network=Network(3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb1c1d9b5-b9') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1c1d9b5-b9, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:10 user nova-compute[71498]: INFO os_vif [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:e1:f6,bridge_name='br-int',has_traffic_filtering=True,id=b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a,network=Network(3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb1c1d9b5-b9')
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:46:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1084378513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1084378513',id=22,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYcWoVO7ZIi629hlkoHGAWtZdBozaG+O8MlSk2AwbH3DI+89IdiX5w/s5MTTIPas7dysNJjR6PIkb1jVAoIejGsoq6jIv/+Zz3sXz4wQO4UkFM2Gq/c7mopuRv8MulFtQ==',key_name='tempest-keypair-1639753774',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:46:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7782019f67b04982a58ed5272dc4cbb5',ramdisk_id='',reservation_id='r-0dgirqv3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-819739955',owner_user_name='tempest-TaggedBootDevicesTest_v242-819739955-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:46:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e5234d2ffe4dc898d22be4bd648c47',uuid=4f8101aa-2078-4f0e-becb-62636c747c60,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6532dff7-2168-407f-be9b-bdbea1b6edd4", "address": "fa:16:3e:03:01:eb", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6532dff7-21", "ovs_interfaceid": "6532dff7-2168-407f-be9b-bdbea1b6edd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converting VIF {"id": "6532dff7-2168-407f-be9b-bdbea1b6edd4", "address": "fa:16:3e:03:01:eb", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6532dff7-21", "ovs_interfaceid": "6532dff7-2168-407f-be9b-bdbea1b6edd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:01:eb,bridge_name='br-int',has_traffic_filtering=True,id=6532dff7-2168-407f-be9b-bdbea1b6edd4,network=Network(3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6532dff7-21') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_vif [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:01:eb,bridge_name='br-int',has_traffic_filtering=True,id=6532dff7-2168-407f-be9b-bdbea1b6edd4,network=Network(3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6532dff7-21') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6532dff7-21, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:10 user nova-compute[71498]: INFO os_vif [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:01:eb,bridge_name='br-int',has_traffic_filtering=True,id=6532dff7-2168-407f-be9b-bdbea1b6edd4,network=Network(3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6532dff7-21')
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:46:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1084378513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1084378513',id=22,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYcWoVO7ZIi629hlkoHGAWtZdBozaG+O8MlSk2AwbH3DI+89IdiX5w/s5MTTIPas7dysNJjR6PIkb1jVAoIejGsoq6jIv/+Zz3sXz4wQO4UkFM2Gq/c7mopuRv8MulFtQ==',key_name='tempest-keypair-1639753774',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:46:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7782019f67b04982a58ed5272dc4cbb5',ramdisk_id='',reservation_id='r-0dgirqv3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-819739955',owner_user_name='tempest-TaggedBootDevicesTest_v242-819739955-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:46:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e5234d2ffe4dc898d22be4bd648c47',uuid=4f8101aa-2078-4f0e-becb-62636c747c60,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f12d4d92-cf6a-4908-a203-d32ad80cb617", "address": "fa:16:3e:45:3e:13", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12d4d92-cf", "ovs_interfaceid": "f12d4d92-cf6a-4908-a203-d32ad80cb617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converting VIF {"id": "f12d4d92-cf6a-4908-a203-d32ad80cb617", "address": "fa:16:3e:45:3e:13", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12d4d92-cf", "ovs_interfaceid": "f12d4d92-cf6a-4908-a203-d32ad80cb617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:3e:13,bridge_name='br-int',has_traffic_filtering=True,id=f12d4d92-cf6a-4908-a203-d32ad80cb617,network=Network(3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf12d4d92-cf') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_vif [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:3e:13,bridge_name='br-int',has_traffic_filtering=True,id=f12d4d92-cf6a-4908-a203-d32ad80cb617,network=Network(3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf12d4d92-cf') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf12d4d92-cf, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:10 user nova-compute[71498]: INFO os_vif [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:3e:13,bridge_name='br-int',has_traffic_filtering=True,id=f12d4d92-cf6a-4908-a203-d32ad80cb617,network=Network(3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf12d4d92-cf')
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:46:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1084378513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1084378513',id=22,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYcWoVO7ZIi629hlkoHGAWtZdBozaG+O8MlSk2AwbH3DI+89IdiX5w/s5MTTIPas7dysNJjR6PIkb1jVAoIejGsoq6jIv/+Zz3sXz4wQO4UkFM2Gq/c7mopuRv8MulFtQ==',key_name='tempest-keypair-1639753774',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:46:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7782019f67b04982a58ed5272dc4cbb5',ramdisk_id='',reservation_id='r-0dgirqv3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-819739955',owner_user_name='tempest-TaggedBootDevicesTest_v242-819739955-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:46:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e5234d2ffe4dc898d22be4bd648c47',uuid=4f8101aa-2078-4f0e-becb-62636c747c60,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6517ba71-e7ec-4e68-8860-714bb4711368", "address": "fa:16:3e:f2:29:a3", "network": {"id": "7b28d758-6a84-4044-814b-714f0f210494", "bridge": "br-int", "label": "tempest-device-tagging-net2-2125292444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6517ba71-e7", "ovs_interfaceid": "6517ba71-e7ec-4e68-8860-714bb4711368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converting VIF {"id": "6517ba71-e7ec-4e68-8860-714bb4711368", "address": "fa:16:3e:f2:29:a3", "network": {"id": "7b28d758-6a84-4044-814b-714f0f210494", "bridge": "br-int", "label": "tempest-device-tagging-net2-2125292444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6517ba71-e7", "ovs_interfaceid": "6517ba71-e7ec-4e68-8860-714bb4711368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:29:a3,bridge_name='br-int',has_traffic_filtering=True,id=6517ba71-e7ec-4e68-8860-714bb4711368,network=Network(7b28d758-6a84-4044-814b-714f0f210494),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6517ba71-e7') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_vif [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:29:a3,bridge_name='br-int',has_traffic_filtering=True,id=6517ba71-e7ec-4e68-8860-714bb4711368,network=Network(7b28d758-6a84-4044-814b-714f0f210494),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6517ba71-e7') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6517ba71-e7, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:10 user nova-compute[71498]: INFO os_vif [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:29:a3,bridge_name='br-int',has_traffic_filtering=True,id=6517ba71-e7ec-4e68-8860-714bb4711368,network=Network(7b28d758-6a84-4044-814b-714f0f210494),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6517ba71-e7')
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T01:46:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1084378513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1084378513',id=22,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYcWoVO7ZIi629hlkoHGAWtZdBozaG+O8MlSk2AwbH3DI+89IdiX5w/s5MTTIPas7dysNJjR6PIkb1jVAoIejGsoq6jIv/+Zz3sXz4wQO4UkFM2Gq/c7mopuRv8MulFtQ==',key_name='tempest-keypair-1639753774',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:46:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7782019f67b04982a58ed5272dc4cbb5',ramdisk_id='',reservation_id='r-0dgirqv3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-819739955',owner_user_name='tempest-TaggedBootDevicesTest_v242-819739955-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:46:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e5234d2ffe4dc898d22be4bd648c47',uuid=4f8101aa-2078-4f0e-becb-62636c747c60,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9894ad9b-db8c-4729-bd7b-ebb28b91af2b", "address": "fa:16:3e:e0:e1:5b", "network": {"id": "7b28d758-6a84-4044-814b-714f0f210494", "bridge": "br-int", "label": "tempest-device-tagging-net2-2125292444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9894ad9b-db", "ovs_interfaceid": "9894ad9b-db8c-4729-bd7b-ebb28b91af2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converting VIF {"id": "9894ad9b-db8c-4729-bd7b-ebb28b91af2b", "address": "fa:16:3e:e0:e1:5b", "network": {"id": "7b28d758-6a84-4044-814b-714f0f210494", "bridge": "br-int", "label": "tempest-device-tagging-net2-2125292444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9894ad9b-db", "ovs_interfaceid": "9894ad9b-db8c-4729-bd7b-ebb28b91af2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e1:5b,bridge_name='br-int',has_traffic_filtering=True,id=9894ad9b-db8c-4729-bd7b-ebb28b91af2b,network=Network(7b28d758-6a84-4044-814b-714f0f210494),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9894ad9b-db') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_vif [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e1:5b,bridge_name='br-int',has_traffic_filtering=True,id=9894ad9b-db8c-4729-bd7b-ebb28b91af2b,network=Network(7b28d758-6a84-4044-814b-714f0f210494),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9894ad9b-db') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9894ad9b-db, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:10 user nova-compute[71498]: INFO os_vif [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e1:5b,bridge_name='br-int',has_traffic_filtering=True,id=9894ad9b-db8c-4729-bd7b-ebb28b91af2b,network=Network(7b28d758-6a84-4044-814b-714f0f210494),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9894ad9b-db')
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pnIKHyQa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:48:10 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1a3399-5393-48e2-a7f6-ecef1e3ca7f1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:48:10 user nova-compute[71498]: No targets found.
Apr 14 01:48:10 user nova-compute[71498]: iSNS:
Apr 14 01:48:10 user nova-compute[71498]: No targets found.
Apr 14 01:48:10 user nova-compute[71498]: STATIC:
Apr 14 01:48:10 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8
Apr 14 01:48:10 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:48:10 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:48:10 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d
Apr 14 01:48:10 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:48:10 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:48:10 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b
Apr 14 01:48:10 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:48:10 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:48:10 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e
Apr 14 01:48:10 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:48:10 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:48:10 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22
Apr 14 01:48:10 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:48:10 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:48:10 user nova-compute[71498]: FIRMWARE:
Apr 14 01:48:10 user nova-compute[71498]: No targets found.
Apr 14 01:48:10 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:48:10 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:48:10 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce0bb64-51fa-4bdf-a857-b56a891d5cf7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd925fc9-4452-4e57-9ead-739b580ffc52]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:48:10 user nova-compute[71498]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)
Apr 14 01:48:10 user nova-compute[71498]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)
Apr 14 01:48:10 user nova-compute[71498]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)
Apr 14 01:48:10 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:48:10 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:48:10 user nova-compute[71498]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 (non-flash)
Apr 14 01:48:10 user nova-compute[71498]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)
Apr 14 01:48:10 user nova-compute[71498]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)
Apr 14 01:48:10 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:48:10 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51e4188040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8'): ({'sdd'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Removing single pathed devices sdd {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc07e5ba-cdb3-4dff-9002-734ef9ff4e93]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe4c581-35be-4a2a-8070-bbcdd5c79d9a]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Flushing IO for device /dev/sdd {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bedbffe-4717-4aae-8242-6edbc91a5276]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[329b8cc9-a4ee-4d10-8df7-a880375454fe]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] SCSI volumes sdd have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8051984-7e06-4159-98df-6474ce3b6b88]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.compute.manager [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-plugged-0912c834-ed73-4f3a-9419-2c08d6094b93 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] Acquiring lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.compute.manager [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] No waiting events found dispatching network-vif-plugged-0912c834-ed73-4f3a-9419-2c08d6094b93 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:48:10 user nova-compute[71498]: WARNING nova.compute.manager [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received unexpected event network-vif-plugged-0912c834-ed73-4f3a-9419-2c08d6094b93 for instance with vm_state active and task_state deleting.
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.compute.manager [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-unplugged-6532dff7-2168-407f-be9b-bdbea1b6edd4 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] Acquiring lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.compute.manager [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] No waiting events found dispatching network-vif-unplugged-6532dff7-2168-407f-be9b-bdbea1b6edd4 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.compute.manager [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-unplugged-6532dff7-2168-407f-be9b-bdbea1b6edd4 for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.compute.manager [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-plugged-6532dff7-2168-407f-be9b-bdbea1b6edd4 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] Acquiring lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.compute.manager [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] No waiting events found dispatching network-vif-plugged-6532dff7-2168-407f-be9b-bdbea1b6edd4 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:48:10 user nova-compute[71498]: WARNING nova.compute.manager [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received unexpected event network-vif-plugged-6532dff7-2168-407f-be9b-bdbea1b6edd4 for instance with vm_state active and task_state deleting.
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.compute.manager [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-unplugged-9894ad9b-db8c-4729-bd7b-ebb28b91af2b {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] Acquiring lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.compute.manager [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] No waiting events found dispatching network-vif-unplugged-9894ad9b-db8c-4729-bd7b-ebb28b91af2b {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.compute.manager [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-unplugged-9894ad9b-db8c-4729-bd7b-ebb28b91af2b for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.compute.manager [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-plugged-9894ad9b-db8c-4729-bd7b-ebb28b91af2b {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] Acquiring lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.compute.manager [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] No waiting events found dispatching network-vif-plugged-9894ad9b-db8c-4729-bd7b-ebb28b91af2b {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:48:10 user nova-compute[71498]: WARNING nova.compute.manager [req-d1e58ff1-4a34-487a-a387-787dccdf07dc req-b9940500-ec30-4221-94bf-c622464476ed service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received unexpected event network-vif-plugged-9894ad9b-db8c-4729-bd7b-ebb28b91af2b for instance with vm_state active and task_state deleting.
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9d3722-5e9a-42a4-81bf-8afe173a960a]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8, portal: 172.16.0.220,3260]
Apr 14 01:48:10 user nova-compute[71498]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8, portal: 172.16.0.220,3260] successful.
Apr 14 01:48:10 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dccc3a21-0674-4347-842b-3d0354dfdfa8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fbc4f3-199a-4662-a5bd-20e0b66258d6]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] <== disconnect_volume: return (347ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lUEoPgwk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:48:10 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[665fbb00-46cc-49ae-8348-f492ca2f20a4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:48:10 user nova-compute[71498]: No targets found.
Apr 14 01:48:10 user nova-compute[71498]: iSNS:
Apr 14 01:48:10 user nova-compute[71498]: No targets found.
Apr 14 01:48:10 user nova-compute[71498]: STATIC:
Apr 14 01:48:10 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d
Apr 14 01:48:10 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:48:10 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:48:10 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b
Apr 14 01:48:10 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:48:10 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:48:10 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e
Apr 14 01:48:10 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:48:10 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:48:10 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22
Apr 14 01:48:10 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:48:10 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:48:10 user nova-compute[71498]: FIRMWARE:
Apr 14 01:48:10 user nova-compute[71498]: No targets found.
Apr 14 01:48:10 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:48:10 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:48:10 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[27202847-7c4c-4ca8-9f0b-dd4e6c86b2e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[480f10be-1806-4be8-a9ba-c76d87652e60]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:48:10 user nova-compute[71498]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)
Apr 14 01:48:10 user nova-compute[71498]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)
Apr 14 01:48:10 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:48:10 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:48:10 user nova-compute[71498]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b (non-flash)
Apr 14 01:48:10 user nova-compute[71498]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)
Apr 14 01:48:10 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:48:10 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51e4188280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b'): ({'sdf'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Removing single pathed devices sdf {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[37994560-8ece-4d1b-b450-215b67d7c588]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ac01ce-2624-4411-ac71-f81fe701d911]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Flushing IO for device /dev/sdf {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fabf1c-304b-4add-aeb1-745fba94b192]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.035s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bd798c-b1f7-4965-9caa-8d927fcd2be6]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] SCSI volumes sdf have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.compute.manager [req-27a65057-6850-4dd0-9cc4-89fbd8bffde7 req-0c4186e8-dff3-4471-8623-7a66789ae0e7 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-plugged-b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-27a65057-6850-4dd0-9cc4-89fbd8bffde7 req-0c4186e8-dff3-4471-8623-7a66789ae0e7 service nova] Acquiring lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-27a65057-6850-4dd0-9cc4-89fbd8bffde7 req-0c4186e8-dff3-4471-8623-7a66789ae0e7 service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-27a65057-6850-4dd0-9cc4-89fbd8bffde7 req-0c4186e8-dff3-4471-8623-7a66789ae0e7 service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.compute.manager [req-27a65057-6850-4dd0-9cc4-89fbd8bffde7 req-0c4186e8-dff3-4471-8623-7a66789ae0e7 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] No waiting events found dispatching network-vif-plugged-b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:48:10 user nova-compute[71498]: WARNING nova.compute.manager [req-27a65057-6850-4dd0-9cc4-89fbd8bffde7 req-0c4186e8-dff3-4471-8623-7a66789ae0e7 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received unexpected event network-vif-plugged-b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a for instance with vm_state active and task_state deleting.
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.compute.manager [req-27a65057-6850-4dd0-9cc4-89fbd8bffde7 req-0c4186e8-dff3-4471-8623-7a66789ae0e7 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-unplugged-f12d4d92-cf6a-4908-a203-d32ad80cb617 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-27a65057-6850-4dd0-9cc4-89fbd8bffde7 req-0c4186e8-dff3-4471-8623-7a66789ae0e7 service nova] Acquiring lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-27a65057-6850-4dd0-9cc4-89fbd8bffde7 req-0c4186e8-dff3-4471-8623-7a66789ae0e7 service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-27a65057-6850-4dd0-9cc4-89fbd8bffde7 req-0c4186e8-dff3-4471-8623-7a66789ae0e7 service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.compute.manager [req-27a65057-6850-4dd0-9cc4-89fbd8bffde7 req-0c4186e8-dff3-4471-8623-7a66789ae0e7 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] No waiting events found dispatching network-vif-unplugged-f12d4d92-cf6a-4908-a203-d32ad80cb617 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.compute.manager [req-27a65057-6850-4dd0-9cc4-89fbd8bffde7 req-0c4186e8-dff3-4471-8623-7a66789ae0e7 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-unplugged-f12d4d92-cf6a-4908-a203-d32ad80cb617 for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.compute.manager [req-27a65057-6850-4dd0-9cc4-89fbd8bffde7 req-0c4186e8-dff3-4471-8623-7a66789ae0e7 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-plugged-f12d4d92-cf6a-4908-a203-d32ad80cb617 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-27a65057-6850-4dd0-9cc4-89fbd8bffde7 req-0c4186e8-dff3-4471-8623-7a66789ae0e7 service nova] Acquiring lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-27a65057-6850-4dd0-9cc4-89fbd8bffde7 req-0c4186e8-dff3-4471-8623-7a66789ae0e7 service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-27a65057-6850-4dd0-9cc4-89fbd8bffde7 req-0c4186e8-dff3-4471-8623-7a66789ae0e7 service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG nova.compute.manager [req-27a65057-6850-4dd0-9cc4-89fbd8bffde7 req-0c4186e8-dff3-4471-8623-7a66789ae0e7 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] No waiting events found dispatching network-vif-plugged-f12d4d92-cf6a-4908-a203-d32ad80cb617 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:48:10 user nova-compute[71498]: WARNING nova.compute.manager [req-27a65057-6850-4dd0-9cc4-89fbd8bffde7 req-0c4186e8-dff3-4471-8623-7a66789ae0e7 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received unexpected event network-vif-plugged-f12d4d92-cf6a-4908-a203-d32ad80cb617 for instance with vm_state active and task_state deleting.
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[57846bdb-1a2c-4eec-a7cb-f151579da3e9]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:48:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbc3de3-c7b5-455d-a95e-f2a0d92e7aa4]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b, portal: 172.16.0.220,3260]
Apr 14 01:48:11 user nova-compute[71498]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b, portal: 172.16.0.220,3260] successful.
Apr 14 01:48:11 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f01988fc-537f-4359-9b58-2a3f4752251b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[931c8741-d8a6-40ad-bcc4-78bd5ee713a1]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] <== disconnect_volume: return (322ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wdltqivh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:48:11 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:48:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3ab34f-645a-4e71-bc97-a4250e31a319]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:48:11 user nova-compute[71498]: No targets found.
Apr 14 01:48:11 user nova-compute[71498]: iSNS:
Apr 14 01:48:11 user nova-compute[71498]: No targets found.
Apr 14 01:48:11 user nova-compute[71498]: STATIC:
Apr 14 01:48:11 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d
Apr 14 01:48:11 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:48:11 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:48:11 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e
Apr 14 01:48:11 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:48:11 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:48:11 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22
Apr 14 01:48:11 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:48:11 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:48:11 user nova-compute[71498]: FIRMWARE:
Apr 14 01:48:11 user nova-compute[71498]: No targets found.
Apr 14 01:48:11 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:48:11 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:48:11 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0155f812-ace5-4b0c-8f3b-1bbcb6d92a4a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0049a8b-9da7-4792-8d64-3ea9f74cd792]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:48:11 user nova-compute[71498]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)
Apr 14 01:48:11 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:48:11 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:48:11 user nova-compute[71498]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d (non-flash)
Apr 14 01:48:11 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:48:11 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51e41897e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d'): ({'sdg'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Removing single pathed devices sdg {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6b9258-8cff-49f0-bd0c-bc10e7a0b14e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd63b63-88ac-46b1-a17c-c20f380cdfac]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Flushing IO for device /dev/sdg {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0babe7-c4f8-4fd4-bec8-d88b1df4b2c5]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b910ee4c-f173-4364-98e1-2f9b2888a014]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] SCSI volumes sdg have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7fe664-ff93-4de0-bb77-00b4556db379]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff98cf68-5520-4631-b524-2b15bf36b260]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d, portal: 172.16.0.220,3260]
Apr 14 01:48:11 user nova-compute[71498]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d, portal: 172.16.0.220,3260] successful.
Apr 14 01:48:11 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6f77e9-ea6d-4653-9cd8-5944d88d743d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e8f0ba-1e05-4373-a75a-ac1abb0e3110]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] <== disconnect_volume: return (294ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:48:11 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Deleting instance files /opt/stack/data/nova/instances/4f8101aa-2078-4f0e-becb-62636c747c60_del
Apr 14 01:48:11 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Deletion of /opt/stack/data/nova/instances/4f8101aa-2078-4f0e-becb-62636c747c60_del complete
Apr 14 01:48:11 user nova-compute[71498]: INFO nova.compute.manager [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Took 3.16 seconds to destroy the instance on the hypervisor.
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG nova.compute.manager [req-771f8abf-0e0b-4496-a924-19888fe804ee req-fb19868b-56b1-4563-be65-930a821e3579 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-plugged-6517ba71-e7ec-4e68-8860-714bb4711368 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-771f8abf-0e0b-4496-a924-19888fe804ee req-fb19868b-56b1-4563-be65-930a821e3579 service nova] Acquiring lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-771f8abf-0e0b-4496-a924-19888fe804ee req-fb19868b-56b1-4563-be65-930a821e3579 service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-771f8abf-0e0b-4496-a924-19888fe804ee req-fb19868b-56b1-4563-be65-930a821e3579 service nova] Lock "4f8101aa-2078-4f0e-becb-62636c747c60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:48:11 user nova-compute[71498]: DEBUG nova.compute.manager [req-771f8abf-0e0b-4496-a924-19888fe804ee req-fb19868b-56b1-4563-be65-930a821e3579 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] No waiting events found dispatching network-vif-plugged-6517ba71-e7ec-4e68-8860-714bb4711368 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:48:11 user nova-compute[71498]: WARNING nova.compute.manager [req-771f8abf-0e0b-4496-a924-19888fe804ee req-fb19868b-56b1-4563-be65-930a821e3579 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received unexpected event network-vif-plugged-6517ba71-e7ec-4e68-8860-714bb4711368 for instance with vm_state active and task_state deleting.
Apr 14 01:48:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:13 user nova-compute[71498]: DEBUG nova.compute.manager [req-6814535f-e509-495a-b582-fb7b1e6a1d3c req-c5f09d87-897c-4916-b17a-28088c2a8e6b service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-deleted-6532dff7-2168-407f-be9b-bdbea1b6edd4 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:48:13 user nova-compute[71498]: INFO nova.compute.manager [req-6814535f-e509-495a-b582-fb7b1e6a1d3c req-c5f09d87-897c-4916-b17a-28088c2a8e6b service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Neutron deleted interface 6532dff7-2168-407f-be9b-bdbea1b6edd4; detaching it from the instance and deleting it from the info cache
Apr 14 01:48:13 user nova-compute[71498]: DEBUG nova.network.neutron [req-6814535f-e509-495a-b582-fb7b1e6a1d3c req-c5f09d87-897c-4916-b17a-28088c2a8e6b service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Updating instance_info_cache with network_info: [{"id": "0912c834-ed73-4f3a-9419-2c08d6094b93", "address": "fa:16:3e:6f:18:a2", "network": {"id": "92cd3f98-b66a-42aa-a5fa-47916885d4d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1332848290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912c834-ed", "ovs_interfaceid": "0912c834-ed73-4f3a-9419-2c08d6094b93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e9a3669-2ccb-49fc-a153-dfcee715ad41", "address": "fa:16:3e:c6:76:24", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e9a3669-2c", "ovs_interfaceid": "4e9a3669-2ccb-49fc-a153-dfcee715ad41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a", "address": "fa:16:3e:b5:e1:f6", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c1d9b5-b9", "ovs_interfaceid": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f12d4d92-cf6a-4908-a203-d32ad80cb617", "address": "fa:16:3e:45:3e:13", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12d4d92-cf", "ovs_interfaceid": "f12d4d92-cf6a-4908-a203-d32ad80cb617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6517ba71-e7ec-4e68-8860-714bb4711368", "address": "fa:16:3e:f2:29:a3", "network": {"id": "7b28d758-6a84-4044-814b-714f0f210494", "bridge": "br-int", "label": "tempest-device-tagging-net2-2125292444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6517ba71-e7", "ovs_interfaceid": "6517ba71-e7ec-4e68-8860-714bb4711368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9894ad9b-db8c-4729-bd7b-ebb28b91af2b", "address": "fa:16:3e:e0:e1:5b", "network": {"id": "7b28d758-6a84-4044-814b-714f0f210494", "bridge": "br-int", "label": "tempest-device-tagging-net2-2125292444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9894ad9b-db", "ovs_interfaceid": "9894ad9b-db8c-4729-bd7b-ebb28b91af2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:48:13 user nova-compute[71498]: DEBUG nova.compute.manager [req-6814535f-e509-495a-b582-fb7b1e6a1d3c req-c5f09d87-897c-4916-b17a-28088c2a8e6b service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Detach interface failed, port_id=6532dff7-2168-407f-be9b-bdbea1b6edd4, reason: Instance 4f8101aa-2078-4f0e-becb-62636c747c60 could not be found. {{(pid=71498) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 01:48:15 user nova-compute[71498]: DEBUG nova.compute.manager [req-de3a7ebd-ea9b-40ad-8bb0-fd4a696309ed req-297d4218-38b5-498d-8265-67f23f0e1bb2 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-deleted-9894ad9b-db8c-4729-bd7b-ebb28b91af2b {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:48:15 user nova-compute[71498]: INFO nova.compute.manager [req-de3a7ebd-ea9b-40ad-8bb0-fd4a696309ed req-297d4218-38b5-498d-8265-67f23f0e1bb2 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Neutron deleted interface 9894ad9b-db8c-4729-bd7b-ebb28b91af2b; detaching it from the instance and deleting it from the info cache
Apr 14 01:48:15 user nova-compute[71498]: DEBUG nova.network.neutron [req-de3a7ebd-ea9b-40ad-8bb0-fd4a696309ed req-297d4218-38b5-498d-8265-67f23f0e1bb2 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Updating instance_info_cache with network_info: [{"id": "0912c834-ed73-4f3a-9419-2c08d6094b93", "address": "fa:16:3e:6f:18:a2", "network": {"id": "92cd3f98-b66a-42aa-a5fa-47916885d4d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1332848290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912c834-ed", "ovs_interfaceid": "0912c834-ed73-4f3a-9419-2c08d6094b93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e9a3669-2ccb-49fc-a153-dfcee715ad41", "address": "fa:16:3e:c6:76:24", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e9a3669-2c", "ovs_interfaceid": "4e9a3669-2ccb-49fc-a153-dfcee715ad41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a", "address": "fa:16:3e:b5:e1:f6", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c1d9b5-b9", "ovs_interfaceid": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f12d4d92-cf6a-4908-a203-d32ad80cb617", "address": "fa:16:3e:45:3e:13", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12d4d92-cf", "ovs_interfaceid": "f12d4d92-cf6a-4908-a203-d32ad80cb617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6517ba71-e7ec-4e68-8860-714bb4711368", "address": "fa:16:3e:f2:29:a3", "network": {"id": "7b28d758-6a84-4044-814b-714f0f210494", "bridge": "br-int", "label": "tempest-device-tagging-net2-2125292444", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6517ba71-e7", "ovs_interfaceid": "6517ba71-e7ec-4e68-8860-714bb4711368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:48:15 user nova-compute[71498]: DEBUG nova.compute.manager [req-de3a7ebd-ea9b-40ad-8bb0-fd4a696309ed req-297d4218-38b5-498d-8265-67f23f0e1bb2 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Detach interface failed, port_id=9894ad9b-db8c-4729-bd7b-ebb28b91af2b, reason: Instance 4f8101aa-2078-4f0e-becb-62636c747c60 could not be found. {{(pid=71498) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 01:48:15 user nova-compute[71498]: DEBUG nova.compute.manager [req-de3a7ebd-ea9b-40ad-8bb0-fd4a696309ed req-297d4218-38b5-498d-8265-67f23f0e1bb2 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-deleted-6517ba71-e7ec-4e68-8860-714bb4711368 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:48:15 user nova-compute[71498]: INFO nova.compute.manager [req-de3a7ebd-ea9b-40ad-8bb0-fd4a696309ed req-297d4218-38b5-498d-8265-67f23f0e1bb2 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Neutron deleted interface 6517ba71-e7ec-4e68-8860-714bb4711368; detaching it from the instance and deleting it from the info cache
Apr 14 01:48:15 user nova-compute[71498]: DEBUG nova.network.neutron [req-de3a7ebd-ea9b-40ad-8bb0-fd4a696309ed req-297d4218-38b5-498d-8265-67f23f0e1bb2 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Updating instance_info_cache with network_info: [{"id": "0912c834-ed73-4f3a-9419-2c08d6094b93", "address": "fa:16:3e:6f:18:a2", "network": {"id": "92cd3f98-b66a-42aa-a5fa-47916885d4d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1332848290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912c834-ed", "ovs_interfaceid": "0912c834-ed73-4f3a-9419-2c08d6094b93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e9a3669-2ccb-49fc-a153-dfcee715ad41", "address": "fa:16:3e:c6:76:24", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e9a3669-2c", "ovs_interfaceid": "4e9a3669-2ccb-49fc-a153-dfcee715ad41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a", "address": "fa:16:3e:b5:e1:f6", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c1d9b5-b9", "ovs_interfaceid": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f12d4d92-cf6a-4908-a203-d32ad80cb617", "address": "fa:16:3e:45:3e:13", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf12d4d92-cf", "ovs_interfaceid": "f12d4d92-cf6a-4908-a203-d32ad80cb617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:48:15 user nova-compute[71498]: DEBUG nova.compute.manager [req-de3a7ebd-ea9b-40ad-8bb0-fd4a696309ed req-297d4218-38b5-498d-8265-67f23f0e1bb2 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Detach interface failed, port_id=6517ba71-e7ec-4e68-8860-714bb4711368, reason: Instance 4f8101aa-2078-4f0e-becb-62636c747c60 could not be found. {{(pid=71498) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 01:48:15 user nova-compute[71498]: DEBUG nova.compute.manager [req-de3a7ebd-ea9b-40ad-8bb0-fd4a696309ed req-297d4218-38b5-498d-8265-67f23f0e1bb2 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-deleted-f12d4d92-cf6a-4908-a203-d32ad80cb617 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:48:15 user nova-compute[71498]: INFO nova.compute.manager [req-de3a7ebd-ea9b-40ad-8bb0-fd4a696309ed req-297d4218-38b5-498d-8265-67f23f0e1bb2 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Neutron deleted interface f12d4d92-cf6a-4908-a203-d32ad80cb617; detaching it from the instance and deleting it from the info cache
Apr 14 01:48:15 user nova-compute[71498]: DEBUG nova.network.neutron [req-de3a7ebd-ea9b-40ad-8bb0-fd4a696309ed req-297d4218-38b5-498d-8265-67f23f0e1bb2 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Updating instance_info_cache with network_info: [{"id": "0912c834-ed73-4f3a-9419-2c08d6094b93", "address": "fa:16:3e:6f:18:a2", "network": {"id": "92cd3f98-b66a-42aa-a5fa-47916885d4d3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1332848290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0912c834-ed", "ovs_interfaceid": "0912c834-ed73-4f3a-9419-2c08d6094b93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4e9a3669-2ccb-49fc-a153-dfcee715ad41", "address": "fa:16:3e:c6:76:24", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e9a3669-2c", "ovs_interfaceid": "4e9a3669-2ccb-49fc-a153-dfcee715ad41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a", "address": "fa:16:3e:b5:e1:f6", "network": {"id": "3d9ba69c-f39f-44da-b7ca-5e0ec230b9d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-729794263", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.203", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7782019f67b04982a58ed5272dc4cbb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1c1d9b5-b9", "ovs_interfaceid": "b1c1d9b5-b990-4b1a-b8e8-18aea84c3b7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:48:15 user nova-compute[71498]: DEBUG nova.compute.manager [req-de3a7ebd-ea9b-40ad-8bb0-fd4a696309ed req-297d4218-38b5-498d-8265-67f23f0e1bb2 service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Detach interface failed, port_id=f12d4d92-cf6a-4908-a203-d32ad80cb617, reason: Instance 4f8101aa-2078-4f0e-becb-62636c747c60 could not be found. {{(pid=71498) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 01:48:15 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:48:15 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Took 3.86 seconds to deallocate network for instance.
Apr 14 01:48:15 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:17 user nova-compute[71498]: DEBUG nova.compute.manager [req-38bafb60-8400-4211-b0d6-8f305b2bd90f req-bdf7cea2-3db5-4b4e-ae23-70f8d05e198e service nova] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Received event network-vif-deleted-0912c834-ed73-4f3a-9419-2c08d6094b93 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:48:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:17 user nova-compute[71498]: INFO nova.compute.manager [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Took 2.54 seconds to detach 3 volumes for instance.
Apr 14 01:48:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:48:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:48:18 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:48:18 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:48:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.294s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:48:18 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Deleted allocations for instance 4f8101aa-2078-4f0e-becb-62636c747c60
Apr 14 01:48:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a42dd672-ed47-45bd-a168-9263ab872d59 tempest-TaggedBootDevicesTest_v242-819739955 tempest-TaggedBootDevicesTest_v242-819739955-project-member] Lock "4f8101aa-2078-4f0e-becb-62636c747c60" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.046s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:48:19 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681436884.0658011, 3a3fb53f-7b4a-48d3-85ab-418bad435c07 => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:48:19 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] VM Stopped (Lifecycle Event)
Apr 14 01:48:19 user nova-compute[71498]: DEBUG nova.compute.manager [None req-b701f305-f438-423c-876b-dea245c3bea7 None None] [instance: 3a3fb53f-7b4a-48d3-85ab-418bad435c07] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:48:20 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:24 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681436889.9974246, 4f8101aa-2078-4f0e-becb-62636c747c60 => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:48:25 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] VM Stopped (Lifecycle Event)
Apr 14 01:48:25 user nova-compute[71498]: DEBUG nova.compute.manager [None req-f9d82bb4-5bf4-4240-926d-604ac41a3eee None None] [instance: 4f8101aa-2078-4f0e-becb-62636c747c60] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:48:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:31 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:48:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:48:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:48:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:48:31 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 01:48:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:48:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:32 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:48:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:34 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:48:34 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:48:34 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=7877MB free_disk=26.380184173583984GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 01:48:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:48:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:48:34 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance da60f4f1-2474-453f-8f84-c95daf02431a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:48:34 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:48:34 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:48:34 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance a19a1c08-5454-481b-bb5a-70c39ead9afc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:48:34 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance fa29c144-0ff9-4efb-a574-f521d18f08fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:48:34 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:48:34 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 74311da6-d6b8-4aea-b6ce-97db8da53800 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:48:34 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 1ccf53b5-9199-4812-a635-4f4f22fb5d28 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:48:34 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 01:48:34 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 01:48:34 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:48:34 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:48:34 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 01:48:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.399s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:48:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:48:35 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:48:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 01:48:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-73fd9bc1-af0f-41e9-adea-d73323b4a76c" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:48:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-73fd9bc1-af0f-41e9-adea-d73323b4a76c" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:48:35 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 01:48:36 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Updating instance_info_cache with network_info: [{"id": "4146457e-4b16-4c22-afd2-ffae8a58c0c5", "address": "fa:16:3e:4c:4f:e1", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4146457e-4b", "ovs_interfaceid": "4146457e-4b16-4c22-afd2-ffae8a58c0c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:48:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-73fd9bc1-af0f-41e9-adea-d73323b4a76c" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:48:36 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 01:48:36 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:48:36 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:48:37 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:48:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:38 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:48:38 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:48:39 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:48:39 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:48:39 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 01:48:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:41 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:48:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:45 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:48:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "74311da6-d6b8-4aea-b6ce-97db8da53800" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:48:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:48:53 user nova-compute[71498]: DEBUG nova.objects.instance [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lazy-loading 'flavor' on Instance uuid 74311da6-d6b8-4aea-b6ce-97db8da53800 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:48:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:48:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "74311da6-d6b8-4aea-b6ce-97db8da53800" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:48:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:48:53 user nova-compute[71498]: INFO nova.compute.manager [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Attaching volume e59663b0-f628-4a16-8c39-38b28a9a8530 to /dev/vdb
Apr 14 01:48:53 user nova-compute[71498]: DEBUG os_brick.utils [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:48:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:53 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9caa8169-db4b-4941-a309-fe6f8334e5b1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:53 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d3d5d4-ad90-4ed0-a067-5208ef85ab97]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:53 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f610fe-c8ac-4ef0-bb0f-4f92102b857b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:53 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[74809920-b70b-48f4-b9e4-f67e04dd16a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:48:53 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:48:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:48:53 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:48:53 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c0ab04-44f8-494a-aea7-f537ab02f0d1]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:53 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:48:53 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:48:53 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:48:53 user nova-compute[71498]: DEBUG os_brick.utils [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:48:53 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Updating existing volume attachment record: dc2dbd9a-2e58-44f5-b930-85fc5cf5bb48 {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:48:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFBPsMOy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:48:58 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:48:58 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:48:58 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:48:58 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:48:58 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:48:58 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ac6930-954a-48fd-af38-c50a6b64022c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:48:58 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33e4287-0bad-444c-b900-582561919d6e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530] added
Apr 14 01:48:58 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbb63be-af85-411b-9a5d-b27597bf60df]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31d96c9-9180-4fba-b2fd-f34002197791]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qFBPsMOy {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qFBPsMOy" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b52962-0069-4999-83f4-f933a2564183]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qFBPsMOy'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bca23f-8243-4337-b6e1-7bb3f662455a]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c5a007-b39d-4b81-8e3d-db96959fbf5e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:48:58 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:48:58 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:48:58 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:48:58 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c24700-df28-405c-9f2a-e2dc04fb0767]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530, portal: 172.16.0.220,3260]
Apr 14 01:48:58 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530, portal: 172.16.0.220,3260] successful.
Apr 14 01:48:58 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[712bff4c-2e3d-4107-87d4-1e654130bc60]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3597f21c-931d-4b06-8bcb-300bc86dbc6c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:48:58 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:48:58 user nova-compute[71498]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 (non-flash)
Apr 14 01:48:58 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:48:58 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:48:58 user nova-compute[71498]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 (non-flash)
Apr 14 01:48:58 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e9e7de-687a-4ce4-bcd2-541a2e4b6d7c]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:48:58 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFBPsMOy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:48:59 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:48:59 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23239623162383664', 'path': '/dev/sdc'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:48:59 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239623162383664', 'path': '/dev/sdc'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:48:59 user nova-compute[71498]: DEBUG nova.objects.instance [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lazy-loading 'flavor' on Instance uuid 74311da6-d6b8-4aea-b6ce-97db8da53800 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:48:59 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 01:48:59 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:48:59 user nova-compute[71498]:   <source dev="/dev/sdc"/>
Apr 14 01:48:59 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:48:59 user nova-compute[71498]:   <serial>e59663b0-f628-4a16-8c39-38b28a9a8530</serial>
Apr 14 01:48:59 user nova-compute[71498]: </disk>
Apr 14 01:48:59 user nova-compute[71498]:  {{(pid=71498) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 01:49:00 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:49:00 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:49:00 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] No VIF found with MAC fa:16:3e:c7:d7:5e, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:49:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b2323ad3-7cda-4cfb-b63a-8695a28c8e1c tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.598s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:00 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "74311da6-d6b8-4aea-b6ce-97db8da53800" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:02 user nova-compute[71498]: INFO nova.compute.manager [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Detaching volume e59663b0-f628-4a16-8c39-38b28a9a8530
Apr 14 01:49:02 user nova-compute[71498]: INFO nova.virt.block_device [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Attempting to driver detach volume e59663b0-f628-4a16-8c39-38b28a9a8530 from mountpoint /dev/vdb
Apr 14 01:49:02 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Attempting to detach device vdb from instance 74311da6-d6b8-4aea-b6ce-97db8da53800 from the persistent domain config. {{(pid=71498) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 01:49:02 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:49:02 user nova-compute[71498]:   <source dev="/dev/sdc"/>
Apr 14 01:49:02 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:49:02 user nova-compute[71498]:   <serial>e59663b0-f628-4a16-8c39-38b28a9a8530</serial>
Apr 14 01:49:02 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 01:49:02 user nova-compute[71498]: </disk>
Apr 14 01:49:02 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:49:02 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Successfully detached device vdb from instance 74311da6-d6b8-4aea-b6ce-97db8da53800 from the persistent domain config.
Apr 14 01:49:02 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 74311da6-d6b8-4aea-b6ce-97db8da53800 from the live domain config. {{(pid=71498) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 01:49:02 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:49:02 user nova-compute[71498]:   <source dev="/dev/sdc"/>
Apr 14 01:49:02 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:49:02 user nova-compute[71498]:   <serial>e59663b0-f628-4a16-8c39-38b28a9a8530</serial>
Apr 14 01:49:02 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 01:49:02 user nova-compute[71498]: </disk>
Apr 14 01:49:02 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Received event <DeviceRemovedEvent: 1681436942.6100638, 74311da6-d6b8-4aea-b6ce-97db8da53800 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71498) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 74311da6-d6b8-4aea-b6ce-97db8da53800 {{(pid=71498) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 01:49:02 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Successfully detached device vdb from instance 74311da6-d6b8-4aea-b6ce-97db8da53800 from the live domain config.
Apr 14 01:49:02 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qFBPsMOy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:49:02 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:49:02 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8666cf2-865d-46d1-9fef-2455fabaebb6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:49:02 user nova-compute[71498]: No targets found.
Apr 14 01:49:02 user nova-compute[71498]: iSNS:
Apr 14 01:49:02 user nova-compute[71498]: No targets found.
Apr 14 01:49:02 user nova-compute[71498]: STATIC:
Apr 14 01:49:02 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530
Apr 14 01:49:02 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:49:02 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:49:02 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e
Apr 14 01:49:02 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:49:02 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:49:02 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22
Apr 14 01:49:02 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:49:02 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:49:02 user nova-compute[71498]: FIRMWARE:
Apr 14 01:49:02 user nova-compute[71498]: No targets found.
Apr 14 01:49:02 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:49:02 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:49:02 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b60b60-f447-4bad-bb5c-959a76dde394]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ca8646-87ec-435c-8402-f0e56da1631d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:49:02 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:49:02 user nova-compute[71498]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 (non-flash)
Apr 14 01:49:02 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:49:02 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:49:02 user nova-compute[71498]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 (non-flash)
Apr 14 01:49:02 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51e418a050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530'): ({'sdc'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Removing single pathed devices sdc {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[536b77c3-56b3-4429-83dd-83d29a516ffb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a900350f-d543-4af5-9141-a57365f31fb4]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Flushing IO for device /dev/sdc {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[566aee0f-12e6-4ec2-9659-3d961814c234]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[19080cdc-436e-47f1-938e-7b0978322c13]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] SCSI volumes sdc have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7ddb09-8e79-4d8c-b4af-795602d65349]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01691b9-7eba-479e-a94a-6d0687911e9c]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530, portal: 172.16.0.220,3260]
Apr 14 01:49:02 user nova-compute[71498]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530, portal: 172.16.0.220,3260] successful.
Apr 14 01:49:02 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59663b0-f628-4a16-8c39-38b28a9a8530 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca5aae1-8d74-483c-9e8e-39ca930461f4]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] <== disconnect_volume: return (311ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:49:02 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:49:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:03 user nova-compute[71498]: DEBUG nova.objects.instance [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lazy-loading 'flavor' on Instance uuid 74311da6-d6b8-4aea-b6ce-97db8da53800 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:49:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-967ff7f8-4180-4dff-a09f-da17bf15f532 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.820s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:05 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:06 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:09 user nova-compute[71498]: DEBUG nova.compute.manager [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 01:49:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:09 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:49:09 user nova-compute[71498]: INFO nova.compute.claims [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Claim successful on node user
Apr 14 01:49:10 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:49:10 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:49:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.432s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:10 user nova-compute[71498]: DEBUG nova.compute.manager [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 01:49:10 user nova-compute[71498]: DEBUG nova.compute.manager [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 01:49:10 user nova-compute[71498]: DEBUG nova.network.neutron [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:49:10 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 01:49:10 user nova-compute[71498]: DEBUG nova.compute.manager [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 01:49:10 user nova-compute[71498]: DEBUG nova.policy [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:49:10 user nova-compute[71498]: DEBUG nova.compute.manager [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 01:49:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:49:10 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Creating image(s)
Apr 14 01:49:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "/opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "/opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "/opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.143s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.153s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk 1073741824" returned: 0 in 0.050s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.138s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:10 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Checking if we can resize image /opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 01:49:10 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:11 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Cannot resize image /opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 01:49:11 user nova-compute[71498]: DEBUG nova.objects.instance [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lazy-loading 'migration_context' on Instance uuid 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:49:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 01:49:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Ensure instance console log exists: /opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:49:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:11 user nova-compute[71498]: DEBUG nova.network.neutron [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Successfully created port: db433bb1-8c59-4e6b-ae87-f6fab836df0f {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:49:11 user nova-compute[71498]: DEBUG nova.network.neutron [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Successfully updated port: db433bb1-8c59-4e6b-ae87-f6fab836df0f {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:49:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "refresh_cache-18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:49:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquired lock "refresh_cache-18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:49:11 user nova-compute[71498]: DEBUG nova.network.neutron [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG nova.compute.manager [req-80a16f1a-6c16-4406-9195-d0c84835a36b req-cf53242e-38f0-4a18-9783-a61df6c63f6e service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Received event network-changed-db433bb1-8c59-4e6b-ae87-f6fab836df0f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG nova.compute.manager [req-80a16f1a-6c16-4406-9195-d0c84835a36b req-cf53242e-38f0-4a18-9783-a61df6c63f6e service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Refreshing instance network info cache due to event network-changed-db433bb1-8c59-4e6b-ae87-f6fab836df0f. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-80a16f1a-6c16-4406-9195-d0c84835a36b req-cf53242e-38f0-4a18-9783-a61df6c63f6e service nova] Acquiring lock "refresh_cache-18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG nova.network.neutron [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG nova.network.neutron [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Updating instance_info_cache with network_info: [{"id": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "address": "fa:16:3e:d5:f1:51", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb433bb1-8c", "ovs_interfaceid": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Releasing lock "refresh_cache-18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG nova.compute.manager [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Instance network_info: |[{"id": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "address": "fa:16:3e:d5:f1:51", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb433bb1-8c", "ovs_interfaceid": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-80a16f1a-6c16-4406-9195-d0c84835a36b req-cf53242e-38f0-4a18-9783-a61df6c63f6e service nova] Acquired lock "refresh_cache-18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG nova.network.neutron [req-80a16f1a-6c16-4406-9195-d0c84835a36b req-cf53242e-38f0-4a18-9783-a61df6c63f6e service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Refreshing network info cache for port db433bb1-8c59-4e6b-ae87-f6fab836df0f {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Start _get_guest_xml network_info=[{"id": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "address": "fa:16:3e:d5:f1:51", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb433bb1-8c", "ovs_interfaceid": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:49:12 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:49:12 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:49:12 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:49:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1301145911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1301145911',id=24,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPK5vWQCKiGuvwej8MZ61wsOrdvHzkY8KKRb64YirQyItNzZ+qUyi3rsN2xXflr+RBnZBMnmrlu6xsd3Isj7tFk7wOqGbcQSauLFOHMBPmHHo5KdwuxT7vQvU/ChwXXgmw==',key_name='tempest-keypair-1472759355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6d05ca328d64f2aa1d19550475edba3',ramdisk_id='',reservation_id='r-dkqwl1kl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2042065984',owner_user_name='tempest-AttachVolumeShelveTestJSON-2042065984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:49:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a5da3e233c74524a953ce0d4e074077',uuid=18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "address": "fa:16:3e:d5:f1:51", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb433bb1-8c", "ovs_interfaceid": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Converting VIF {"id": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "address": "fa:16:3e:d5:f1:51", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb433bb1-8c", "ovs_interfaceid": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f1:51,bridge_name='br-int',has_traffic_filtering=True,id=db433bb1-8c59-4e6b-ae87-f6fab836df0f,network=Network(a7b6c0bc-d2de-4431-821b-c2917738e556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb433bb1-8c') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG nova.objects.instance [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lazy-loading 'pci_devices' on Instance uuid 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:49:12 user nova-compute[71498]:   <uuid>18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80</uuid>
Apr 14 01:49:12 user nova-compute[71498]:   <name>instance-00000018</name>
Apr 14 01:49:12 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:49:12 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:49:12 user nova-compute[71498]:   <metadata>
Apr 14 01:49:12 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:49:12 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:49:12 user nova-compute[71498]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1301145911</nova:name>
Apr 14 01:49:12 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:49:12</nova:creationTime>
Apr 14 01:49:12 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:49:12 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:49:12 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:49:12 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:49:12 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:49:12 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:49:12 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:49:12 user nova-compute[71498]:       <nova:owner>
Apr 14 01:49:12 user nova-compute[71498]:         <nova:user uuid="2a5da3e233c74524a953ce0d4e074077">tempest-AttachVolumeShelveTestJSON-2042065984-project-member</nova:user>
Apr 14 01:49:12 user nova-compute[71498]:         <nova:project uuid="a6d05ca328d64f2aa1d19550475edba3">tempest-AttachVolumeShelveTestJSON-2042065984</nova:project>
Apr 14 01:49:12 user nova-compute[71498]:       </nova:owner>
Apr 14 01:49:12 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:49:12 user nova-compute[71498]:       <nova:ports>
Apr 14 01:49:12 user nova-compute[71498]:         <nova:port uuid="db433bb1-8c59-4e6b-ae87-f6fab836df0f">
Apr 14 01:49:12 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 01:49:12 user nova-compute[71498]:         </nova:port>
Apr 14 01:49:12 user nova-compute[71498]:       </nova:ports>
Apr 14 01:49:12 user nova-compute[71498]:     </nova:instance>
Apr 14 01:49:12 user nova-compute[71498]:   </metadata>
Apr 14 01:49:12 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:49:12 user nova-compute[71498]:     <system>
Apr 14 01:49:12 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:49:12 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:49:12 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:49:12 user nova-compute[71498]:       <entry name="serial">18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80</entry>
Apr 14 01:49:12 user nova-compute[71498]:       <entry name="uuid">18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80</entry>
Apr 14 01:49:12 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:49:12 user nova-compute[71498]:     </system>
Apr 14 01:49:12 user nova-compute[71498]:   </sysinfo>
Apr 14 01:49:12 user nova-compute[71498]:   <os>
Apr 14 01:49:12 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:49:12 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:49:12 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:49:12 user nova-compute[71498]:   </os>
Apr 14 01:49:12 user nova-compute[71498]:   <features>
Apr 14 01:49:12 user nova-compute[71498]:     <acpi/>
Apr 14 01:49:12 user nova-compute[71498]:     <apic/>
Apr 14 01:49:12 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:49:12 user nova-compute[71498]:   </features>
Apr 14 01:49:12 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:49:12 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:49:12 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:49:12 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:49:12 user nova-compute[71498]:   </clock>
Apr 14 01:49:12 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:49:12 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:49:12 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:49:12 user nova-compute[71498]:   </cpu>
Apr 14 01:49:12 user nova-compute[71498]:   <devices>
Apr 14 01:49:12 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:49:12 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:49:12 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk"/>
Apr 14 01:49:12 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:49:12 user nova-compute[71498]:     </disk>
Apr 14 01:49:12 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:49:12 user nova-compute[71498]:       <mac address="fa:16:3e:d5:f1:51"/>
Apr 14 01:49:12 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:49:12 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:49:12 user nova-compute[71498]:       <target dev="tapdb433bb1-8c"/>
Apr 14 01:49:12 user nova-compute[71498]:     </interface>
Apr 14 01:49:12 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:49:12 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/console.log" append="off"/>
Apr 14 01:49:12 user nova-compute[71498]:     </serial>
Apr 14 01:49:12 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:49:12 user nova-compute[71498]:     <video>
Apr 14 01:49:12 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:49:12 user nova-compute[71498]:     </video>
Apr 14 01:49:12 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:49:12 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:49:12 user nova-compute[71498]:     </rng>
Apr 14 01:49:12 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:49:12 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:49:12 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:49:12 user nova-compute[71498]:     </memballoon>
Apr 14 01:49:12 user nova-compute[71498]:   </devices>
Apr 14 01:49:12 user nova-compute[71498]: </domain>
Apr 14 01:49:12 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:49:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1301145911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1301145911',id=24,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPK5vWQCKiGuvwej8MZ61wsOrdvHzkY8KKRb64YirQyItNzZ+qUyi3rsN2xXflr+RBnZBMnmrlu6xsd3Isj7tFk7wOqGbcQSauLFOHMBPmHHo5KdwuxT7vQvU/ChwXXgmw==',key_name='tempest-keypair-1472759355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6d05ca328d64f2aa1d19550475edba3',ramdisk_id='',reservation_id='r-dkqwl1kl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2042065984',owner_user_name='tempest-AttachVolumeShelveTestJSON-2042065984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:49:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a5da3e233c74524a953ce0d4e074077',uuid=18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "address": "fa:16:3e:d5:f1:51", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb433bb1-8c", "ovs_interfaceid": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Converting VIF {"id": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "address": "fa:16:3e:d5:f1:51", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb433bb1-8c", "ovs_interfaceid": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f1:51,bridge_name='br-int',has_traffic_filtering=True,id=db433bb1-8c59-4e6b-ae87-f6fab836df0f,network=Network(a7b6c0bc-d2de-4431-821b-c2917738e556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb433bb1-8c') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG os_vif [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f1:51,bridge_name='br-int',has_traffic_filtering=True,id=db433bb1-8c59-4e6b-ae87-f6fab836df0f,network=Network(a7b6c0bc-d2de-4431-821b-c2917738e556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb433bb1-8c') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb433bb1-8c, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdb433bb1-8c, col_values=(('external_ids', {'iface-id': 'db433bb1-8c59-4e6b-ae87-f6fab836df0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:f1:51', 'vm-uuid': '18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:12 user nova-compute[71498]: INFO os_vif [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f1:51,bridge_name='br-int',has_traffic_filtering=True,id=db433bb1-8c59-4e6b-ae87-f6fab836df0f,network=Network(a7b6c0bc-d2de-4431-821b-c2917738e556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb433bb1-8c')
Apr 14 01:49:12 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] No VIF found with MAC fa:16:3e:d5:f1:51, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG nova.objects.instance [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lazy-loading 'flavor' on Instance uuid 73cc8ede-babd-4281-bf1d-c5a3f8bad440 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG nova.network.neutron [req-80a16f1a-6c16-4406-9195-d0c84835a36b req-cf53242e-38f0-4a18-9783-a61df6c63f6e service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Updated VIF entry in instance network info cache for port db433bb1-8c59-4e6b-ae87-f6fab836df0f. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG nova.network.neutron [req-80a16f1a-6c16-4406-9195-d0c84835a36b req-cf53242e-38f0-4a18-9783-a61df6c63f6e service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Updating instance_info_cache with network_info: [{"id": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "address": "fa:16:3e:d5:f1:51", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb433bb1-8c", "ovs_interfaceid": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-80a16f1a-6c16-4406-9195-d0c84835a36b req-cf53242e-38f0-4a18-9783-a61df6c63f6e service nova] Releasing lock "refresh_cache-18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:49:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:13 user nova-compute[71498]: INFO nova.compute.manager [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Attaching volume b1446339-0ce8-401e-b2e0-c4811b486a1a to /dev/vdb
Apr 14 01:49:13 user nova-compute[71498]: DEBUG os_brick.utils [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:49:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:13 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4d299c-4c92-4a89-a14f-c9a5dd1c12c3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:13 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6b92f8-731c-4bcc-a08b-8dc45d79f2c2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:13 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[896b04a0-9731-467f-8b94-dce76764c24c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:13 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f1f3bc-42e2-4a40-a5bf-e4e47044581c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:49:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:49:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:49:13 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:49:13 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6437a692-146d-4b01-9b14-3eba55ebc659]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:49:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:49:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:49:13 user nova-compute[71498]: DEBUG os_brick.utils [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:49:13 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Updating existing volume attachment record: 8d453907-24d9-4a0e-ac93-462f74f5ae5a {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:49:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:14 user nova-compute[71498]: DEBUG nova.compute.manager [req-a109b482-293a-4a5c-874a-16547687c9d6 req-82a2e824-e3b2-4322-af35-53f1241551dd service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Received event network-vif-plugged-db433bb1-8c59-4e6b-ae87-f6fab836df0f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:49:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a109b482-293a-4a5c-874a-16547687c9d6 req-82a2e824-e3b2-4322-af35-53f1241551dd service nova] Acquiring lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a109b482-293a-4a5c-874a-16547687c9d6 req-82a2e824-e3b2-4322-af35-53f1241551dd service nova] Lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a109b482-293a-4a5c-874a-16547687c9d6 req-82a2e824-e3b2-4322-af35-53f1241551dd service nova] Lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:14 user nova-compute[71498]: DEBUG nova.compute.manager [req-a109b482-293a-4a5c-874a-16547687c9d6 req-82a2e824-e3b2-4322-af35-53f1241551dd service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] No waiting events found dispatching network-vif-plugged-db433bb1-8c59-4e6b-ae87-f6fab836df0f {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:49:14 user nova-compute[71498]: WARNING nova.compute.manager [req-a109b482-293a-4a5c-874a-16547687c9d6 req-82a2e824-e3b2-4322-af35-53f1241551dd service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Received unexpected event network-vif-plugged-db433bb1-8c59-4e6b-ae87-f6fab836df0f for instance with vm_state building and task_state spawning.
Apr 14 01:49:14 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:14 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:14 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:15 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436955.9914, 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:49:15 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] VM Resumed (Lifecycle Event)
Apr 14 01:49:15 user nova-compute[71498]: DEBUG nova.compute.manager [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:49:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:49:16 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Instance spawned successfully.
Apr 14 01:49:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:49:16 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:49:16 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:49:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:49:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:49:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:49:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:49:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:49:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:49:16 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:49:16 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436955.9929113, 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:49:16 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] VM Started (Lifecycle Event)
Apr 14 01:49:16 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:49:16 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:49:16 user nova-compute[71498]: DEBUG nova.compute.manager [req-b6bd9c9d-3857-4ac2-853e-befa654b046b req-b62d871a-afa8-4c6c-8f15-3293fbac0275 service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Received event network-vif-plugged-db433bb1-8c59-4e6b-ae87-f6fab836df0f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:49:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b6bd9c9d-3857-4ac2-853e-befa654b046b req-b62d871a-afa8-4c6c-8f15-3293fbac0275 service nova] Acquiring lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b6bd9c9d-3857-4ac2-853e-befa654b046b req-b62d871a-afa8-4c6c-8f15-3293fbac0275 service nova] Lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b6bd9c9d-3857-4ac2-853e-befa654b046b req-b62d871a-afa8-4c6c-8f15-3293fbac0275 service nova] Lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:16 user nova-compute[71498]: DEBUG nova.compute.manager [req-b6bd9c9d-3857-4ac2-853e-befa654b046b req-b62d871a-afa8-4c6c-8f15-3293fbac0275 service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] No waiting events found dispatching network-vif-plugged-db433bb1-8c59-4e6b-ae87-f6fab836df0f {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:49:16 user nova-compute[71498]: WARNING nova.compute.manager [req-b6bd9c9d-3857-4ac2-853e-befa654b046b req-b62d871a-afa8-4c6c-8f15-3293fbac0275 service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Received unexpected event network-vif-plugged-db433bb1-8c59-4e6b-ae87-f6fab836df0f for instance with vm_state building and task_state spawning.
Apr 14 01:49:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:16 user nova-compute[71498]: INFO nova.compute.manager [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Took 5.78 seconds to spawn the instance on the hypervisor.
Apr 14 01:49:16 user nova-compute[71498]: DEBUG nova.compute.manager [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:49:16 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:49:16 user nova-compute[71498]: INFO nova.compute.manager [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Took 6.55 seconds to build instance.
Apr 14 01:49:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b23ab57b-588e-4350-94c9-63b53ab9b906 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.660s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbmBcKyr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:49:17 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:49:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:49:17 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:49:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:49:17 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:49:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cffe987-a786-48f8-8f34-1d16d0f5a1c0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:49:17 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c58460-b4b9-44eb-8a63-df2537b18a3a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a] added
Apr 14 01:49:17 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c069427d-3b17-4cf6-b137-c83f150e85b6]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[792cd112-5d19-422e-a897-0445ce1c02eb]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MbmBcKyr {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MbmBcKyr" returned: 0 in 0.025s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[03484d0f-2bf9-445d-a290-2e07e96ee4bf]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MbmBcKyr'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[017c937d-cdbe-4904-9ed4-bad969e7a5d5]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[06362d6b-e9a8-44d1-aee3-7aecb9e8759f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:49:17 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:49:17 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:49:17 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:49:17 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6a2823-da7e-436b-864b-4ae4b28c9a6a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a, portal: 172.16.0.220,3260]
Apr 14 01:49:17 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a, portal: 172.16.0.220,3260] successful.
Apr 14 01:49:17 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[345134e5-6e16-4c49-95ec-46d2c3a8c3fc]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:49:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:18 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1a10bb-057b-4bdc-932f-6f65d84f2a58]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:18 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:49:18 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:49:18 user nova-compute[71498]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)
Apr 14 01:49:18 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:49:18 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:49:18 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:49:18 user nova-compute[71498]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)
Apr 14 01:49:18 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:49:18 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:49:18 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:49:18 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:49:18 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:49:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:18 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ef9749-8deb-446d-93a1-c872b972c65f]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:18 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:49:18 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbmBcKyr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:49:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "ae82789e-1bed-419b-a580-68ff7ed03ef2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "ae82789e-1bed-419b-a580-68ff7ed03ef2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:18 user nova-compute[71498]: DEBUG nova.compute.manager [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 01:49:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:18 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:49:18 user nova-compute[71498]: INFO nova.compute.claims [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Claim successful on node user
Apr 14 01:49:18 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:49:18 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:49:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.547s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:18 user nova-compute[71498]: DEBUG nova.compute.manager [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 01:49:18 user nova-compute[71498]: DEBUG nova.compute.manager [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 01:49:18 user nova-compute[71498]: DEBUG nova.network.neutron [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:49:18 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 01:49:18 user nova-compute[71498]: DEBUG nova.compute.manager [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG nova.compute.manager [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:49:19 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Creating image(s)
Apr 14 01:49:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "/opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "/opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG nova.policy [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] <== connect_volume: return (1419ms) {'type': 'block', 'scsi_wwn': '23936353864386236', 'path': '/dev/sdc'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936353864386236', 'path': '/dev/sdc'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG nova.objects.instance [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lazy-loading 'flavor' on Instance uuid 73cc8ede-babd-4281-bf1d-c5a3f8bad440 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 01:49:19 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:49:19 user nova-compute[71498]:   <source dev="/dev/sdc"/>
Apr 14 01:49:19 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:49:19 user nova-compute[71498]:   <serial>b1446339-0ce8-401e-b2e0-c4811b486a1a</serial>
Apr 14 01:49:19 user nova-compute[71498]: </disk>
Apr 14 01:49:19 user nova-compute[71498]:  {{(pid=71498) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.180s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.149s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk 1073741824" returned: 0 in 0.057s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.184s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] No VIF found with MAC fa:16:3e:b2:d1:94, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Cannot resize image /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG nova.objects.instance [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lazy-loading 'migration_context' on Instance uuid ae82789e-1bed-419b-a580-68ff7ed03ef2 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Ensure instance console log exists: /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-703922de-5c24-4d27-80f8-76a0e86b90bb tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.910s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:20 user nova-compute[71498]: DEBUG nova.network.neutron [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Successfully created port: 1c1e2ef8-d508-4d18-b4a4-69251ae763d0 {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.network.neutron [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Successfully updated port: 1c1e2ef8-d508-4d18-b4a4-69251ae763d0 {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "refresh_cache-ae82789e-1bed-419b-a580-68ff7ed03ef2" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquired lock "refresh_cache-ae82789e-1bed-419b-a580-68ff7ed03ef2" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.network.neutron [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:49:21 user nova-compute[71498]: INFO nova.compute.manager [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Rebuilding instance
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.compute.manager [req-b1252657-1eae-41db-b9f9-2a522116119b req-2df923eb-0248-4466-b1b7-59e7c45e0df0 service nova] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Received event network-changed-1c1e2ef8-d508-4d18-b4a4-69251ae763d0 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.compute.manager [req-b1252657-1eae-41db-b9f9-2a522116119b req-2df923eb-0248-4466-b1b7-59e7c45e0df0 service nova] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Refreshing instance network info cache due to event network-changed-1c1e2ef8-d508-4d18-b4a4-69251ae763d0. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b1252657-1eae-41db-b9f9-2a522116119b req-2df923eb-0248-4466-b1b7-59e7c45e0df0 service nova] Acquiring lock "refresh_cache-ae82789e-1bed-419b-a580-68ff7ed03ef2" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.network.neutron [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.objects.instance [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lazy-loading 'trusted_certs' on Instance uuid 73cc8ede-babd-4281-bf1d-c5a3f8bad440 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.compute.manager [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e9be81ce-9ccc-4557-9763-33984b2c6573" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e9be81ce-9ccc-4557-9763-33984b2c6573" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.objects.instance [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lazy-loading 'pci_requests' on Instance uuid 73cc8ede-babd-4281-bf1d-c5a3f8bad440 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.objects.instance [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lazy-loading 'pci_devices' on Instance uuid 73cc8ede-babd-4281-bf1d-c5a3f8bad440 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.compute.manager [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.objects.instance [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lazy-loading 'resources' on Instance uuid 73cc8ede-babd-4281-bf1d-c5a3f8bad440 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.objects.instance [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lazy-loading 'migration_context' on Instance uuid 73cc8ede-babd-4281-bf1d-c5a3f8bad440 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.objects.instance [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71498) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:49:21 user nova-compute[71498]: INFO nova.compute.claims [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Claim successful on node user
Apr 14 01:49:21 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.network.neutron [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Updating instance_info_cache with network_info: [{"id": "1c1e2ef8-d508-4d18-b4a4-69251ae763d0", "address": "fa:16:3e:d5:d6:0c", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c1e2ef8-d5", "ovs_interfaceid": "1c1e2ef8-d508-4d18-b4a4-69251ae763d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Releasing lock "refresh_cache-ae82789e-1bed-419b-a580-68ff7ed03ef2" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.compute.manager [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Instance network_info: |[{"id": "1c1e2ef8-d508-4d18-b4a4-69251ae763d0", "address": "fa:16:3e:d5:d6:0c", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c1e2ef8-d5", "ovs_interfaceid": "1c1e2ef8-d508-4d18-b4a4-69251ae763d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b1252657-1eae-41db-b9f9-2a522116119b req-2df923eb-0248-4466-b1b7-59e7c45e0df0 service nova] Acquired lock "refresh_cache-ae82789e-1bed-419b-a580-68ff7ed03ef2" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.network.neutron [req-b1252657-1eae-41db-b9f9-2a522116119b req-2df923eb-0248-4466-b1b7-59e7c45e0df0 service nova] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Refreshing network info cache for port 1c1e2ef8-d508-4d18-b4a4-69251ae763d0 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Start _get_guest_xml network_info=[{"id": "1c1e2ef8-d508-4d18-b4a4-69251ae763d0", "address": "fa:16:3e:d5:d6:0c", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c1e2ef8-d5", "ovs_interfaceid": "1c1e2ef8-d508-4d18-b4a4-69251ae763d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:49:21 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:49:21 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:49:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-82990348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-82990348',id=25,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='219c39c8299e46368012a947fdfbe5fd',ramdisk_id='',reservation_id='r-zpjyjljy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-85797606',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:49:19Z,user_data=None,user_id='7ed01a83531f4c6bb18a4593284baf05',uuid=ae82789e-1bed-419b-a580-68ff7ed03ef2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c1e2ef8-d508-4d18-b4a4-69251ae763d0", "address": "fa:16:3e:d5:d6:0c", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c1e2ef8-d5", "ovs_interfaceid": "1c1e2ef8-d508-4d18-b4a4-69251ae763d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Converting VIF {"id": "1c1e2ef8-d508-4d18-b4a4-69251ae763d0", "address": "fa:16:3e:d5:d6:0c", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c1e2ef8-d5", "ovs_interfaceid": "1c1e2ef8-d508-4d18-b4a4-69251ae763d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:d6:0c,bridge_name='br-int',has_traffic_filtering=True,id=1c1e2ef8-d508-4d18-b4a4-69251ae763d0,network=Network(365cbeec-3756-4258-a135-04112bdda4b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c1e2ef8-d5') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.objects.instance [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lazy-loading 'pci_devices' on Instance uuid ae82789e-1bed-419b-a580-68ff7ed03ef2 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:49:21 user nova-compute[71498]:   <uuid>ae82789e-1bed-419b-a580-68ff7ed03ef2</uuid>
Apr 14 01:49:21 user nova-compute[71498]:   <name>instance-00000019</name>
Apr 14 01:49:21 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:49:21 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:49:21 user nova-compute[71498]:   <metadata>
Apr 14 01:49:21 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:49:21 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:49:21 user nova-compute[71498]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-82990348</nova:name>
Apr 14 01:49:21 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:49:21</nova:creationTime>
Apr 14 01:49:21 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:49:21 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:49:21 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:49:21 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:49:21 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:49:21 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:49:21 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:49:21 user nova-compute[71498]:       <nova:owner>
Apr 14 01:49:21 user nova-compute[71498]:         <nova:user uuid="7ed01a83531f4c6bb18a4593284baf05">tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member</nova:user>
Apr 14 01:49:21 user nova-compute[71498]:         <nova:project uuid="219c39c8299e46368012a947fdfbe5fd">tempest-ServerBootFromVolumeStableRescueTest-85797606</nova:project>
Apr 14 01:49:21 user nova-compute[71498]:       </nova:owner>
Apr 14 01:49:21 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:49:21 user nova-compute[71498]:       <nova:ports>
Apr 14 01:49:21 user nova-compute[71498]:         <nova:port uuid="1c1e2ef8-d508-4d18-b4a4-69251ae763d0">
Apr 14 01:49:21 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 01:49:21 user nova-compute[71498]:         </nova:port>
Apr 14 01:49:21 user nova-compute[71498]:       </nova:ports>
Apr 14 01:49:21 user nova-compute[71498]:     </nova:instance>
Apr 14 01:49:21 user nova-compute[71498]:   </metadata>
Apr 14 01:49:21 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:49:21 user nova-compute[71498]:     <system>
Apr 14 01:49:21 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:49:21 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:49:21 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:49:21 user nova-compute[71498]:       <entry name="serial">ae82789e-1bed-419b-a580-68ff7ed03ef2</entry>
Apr 14 01:49:21 user nova-compute[71498]:       <entry name="uuid">ae82789e-1bed-419b-a580-68ff7ed03ef2</entry>
Apr 14 01:49:21 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:49:21 user nova-compute[71498]:     </system>
Apr 14 01:49:21 user nova-compute[71498]:   </sysinfo>
Apr 14 01:49:21 user nova-compute[71498]:   <os>
Apr 14 01:49:21 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:49:21 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:49:21 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:49:21 user nova-compute[71498]:   </os>
Apr 14 01:49:21 user nova-compute[71498]:   <features>
Apr 14 01:49:21 user nova-compute[71498]:     <acpi/>
Apr 14 01:49:21 user nova-compute[71498]:     <apic/>
Apr 14 01:49:21 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:49:21 user nova-compute[71498]:   </features>
Apr 14 01:49:21 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:49:21 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:49:21 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:49:21 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:49:21 user nova-compute[71498]:   </clock>
Apr 14 01:49:21 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:49:21 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:49:21 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:49:21 user nova-compute[71498]:   </cpu>
Apr 14 01:49:21 user nova-compute[71498]:   <devices>
Apr 14 01:49:21 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:49:21 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:49:21 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk"/>
Apr 14 01:49:21 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:49:21 user nova-compute[71498]:     </disk>
Apr 14 01:49:21 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:49:21 user nova-compute[71498]:       <mac address="fa:16:3e:d5:d6:0c"/>
Apr 14 01:49:21 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:49:21 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:49:21 user nova-compute[71498]:       <target dev="tap1c1e2ef8-d5"/>
Apr 14 01:49:21 user nova-compute[71498]:     </interface>
Apr 14 01:49:21 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:49:21 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/console.log" append="off"/>
Apr 14 01:49:21 user nova-compute[71498]:     </serial>
Apr 14 01:49:21 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:49:21 user nova-compute[71498]:     <video>
Apr 14 01:49:21 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:49:21 user nova-compute[71498]:     </video>
Apr 14 01:49:21 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:49:21 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:49:21 user nova-compute[71498]:     </rng>
Apr 14 01:49:21 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:49:21 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:49:21 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:49:21 user nova-compute[71498]:     </memballoon>
Apr 14 01:49:21 user nova-compute[71498]:   </devices>
Apr 14 01:49:21 user nova-compute[71498]: </domain>
Apr 14 01:49:21 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:49:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-82990348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-82990348',id=25,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='219c39c8299e46368012a947fdfbe5fd',ramdisk_id='',reservation_id='r-zpjyjljy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-85797606',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:49:19Z,user_data=None,user_id='7ed01a83531f4c6bb18a4593284baf05',uuid=ae82789e-1bed-419b-a580-68ff7ed03ef2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c1e2ef8-d508-4d18-b4a4-69251ae763d0", "address": "fa:16:3e:d5:d6:0c", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c1e2ef8-d5", "ovs_interfaceid": "1c1e2ef8-d508-4d18-b4a4-69251ae763d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Converting VIF {"id": "1c1e2ef8-d508-4d18-b4a4-69251ae763d0", "address": "fa:16:3e:d5:d6:0c", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c1e2ef8-d5", "ovs_interfaceid": "1c1e2ef8-d508-4d18-b4a4-69251ae763d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:d6:0c,bridge_name='br-int',has_traffic_filtering=True,id=1c1e2ef8-d508-4d18-b4a4-69251ae763d0,network=Network(365cbeec-3756-4258-a135-04112bdda4b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c1e2ef8-d5') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG os_vif [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:d6:0c,bridge_name='br-int',has_traffic_filtering=True,id=1c1e2ef8-d508-4d18-b4a4-69251ae763d0,network=Network(365cbeec-3756-4258-a135-04112bdda4b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c1e2ef8-d5') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c1e2ef8-d5, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1c1e2ef8-d5, col_values=(('external_ids', {'iface-id': '1c1e2ef8-d508-4d18-b4a4-69251ae763d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:d6:0c', 'vm-uuid': 'ae82789e-1bed-419b-a580-68ff7ed03ef2'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:49:21 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:21 user nova-compute[71498]: INFO os_vif [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:d6:0c,bridge_name='br-int',has_traffic_filtering=True,id=1c1e2ef8-d508-4d18-b4a4-69251ae763d0,network=Network(365cbeec-3756-4258-a135-04112bdda4b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c1e2ef8-d5')
Apr 14 01:49:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:49:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] No VIF found with MAC fa:16:3e:d5:d6:0c, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:49:22 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:49:22 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:49:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.644s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:22 user nova-compute[71498]: DEBUG nova.compute.manager [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 01:49:22 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 01:49:22 user nova-compute[71498]: DEBUG nova.compute.manager [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 01:49:22 user nova-compute[71498]: DEBUG nova.network.neutron [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:49:22 user nova-compute[71498]: DEBUG nova.compute.manager [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 01:49:22 user nova-compute[71498]: DEBUG nova.policy [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50e3354ac1a84c59a7dee8e1ae6e771a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f4117a4adb4aa3b42951cf1fc84237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:49:22 user nova-compute[71498]: DEBUG nova.network.neutron [req-b1252657-1eae-41db-b9f9-2a522116119b req-2df923eb-0248-4466-b1b7-59e7c45e0df0 service nova] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Updated VIF entry in instance network info cache for port 1c1e2ef8-d508-4d18-b4a4-69251ae763d0. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:49:22 user nova-compute[71498]: DEBUG nova.network.neutron [req-b1252657-1eae-41db-b9f9-2a522116119b req-2df923eb-0248-4466-b1b7-59e7c45e0df0 service nova] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Updating instance_info_cache with network_info: [{"id": "1c1e2ef8-d508-4d18-b4a4-69251ae763d0", "address": "fa:16:3e:d5:d6:0c", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c1e2ef8-d5", "ovs_interfaceid": "1c1e2ef8-d508-4d18-b4a4-69251ae763d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:49:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b1252657-1eae-41db-b9f9-2a522116119b req-2df923eb-0248-4466-b1b7-59e7c45e0df0 service nova] Releasing lock "refresh_cache-ae82789e-1bed-419b-a580-68ff7ed03ef2" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:49:22 user nova-compute[71498]: INFO nova.virt.block_device [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Booting with volume snapshot 8c494dc1-9b6c-456f-9b65-71233f5e3f85 at /dev/vda
Apr 14 01:49:22 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Instance destroyed successfully.
Apr 14 01:49:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:22 user nova-compute[71498]: INFO nova.compute.manager [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Detaching volume b1446339-0ce8-401e-b2e0-c4811b486a1a
Apr 14 01:49:22 user nova-compute[71498]: INFO nova.virt.block_device [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Attempting to driver detach volume b1446339-0ce8-401e-b2e0-c4811b486a1a from mountpoint /dev/vdb
Apr 14 01:49:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Attempting to detach device vdb from instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 from the persistent domain config. {{(pid=71498) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 01:49:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 01:49:22 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:49:22 user nova-compute[71498]:   <source dev="/dev/sdc"/>
Apr 14 01:49:22 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:49:22 user nova-compute[71498]:   <serial>b1446339-0ce8-401e-b2e0-c4811b486a1a</serial>
Apr 14 01:49:22 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 01:49:22 user nova-compute[71498]: </disk>
Apr 14 01:49:22 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:49:22 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Successfully detached device vdb from instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 from the persistent domain config.
Apr 14 01:49:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:49:22 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbmBcKyr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:49:22 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 01:49:22 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:49:22 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:49:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:22 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ba939e-ee38-4f81-b178-42ee27fcf795]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:22 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:49:22 user nova-compute[71498]: No targets found.
Apr 14 01:49:22 user nova-compute[71498]: iSNS:
Apr 14 01:49:22 user nova-compute[71498]: No targets found.
Apr 14 01:49:22 user nova-compute[71498]: STATIC:
Apr 14 01:49:22 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a
Apr 14 01:49:22 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:49:22 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:49:22 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e
Apr 14 01:49:22 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:49:22 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:49:22 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22
Apr 14 01:49:22 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:49:22 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:49:22 user nova-compute[71498]: FIRMWARE:
Apr 14 01:49:22 user nova-compute[71498]: No targets found.
Apr 14 01:49:22 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:49:22 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:49:22 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:49:22 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:49:22 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:49:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a54a667-892e-4f11-835d-1d2311a2bfd2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d5c59c-4472-4797-b73e-20bec5d77e7e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:49:23 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:49:23 user nova-compute[71498]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)
Apr 14 01:49:23 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:49:23 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:49:23 user nova-compute[71498]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)
Apr 14 01:49:23 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51f42ad240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a'): ({'sdc'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Removing single pathed devices sdc {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb55ce3f-3753-4f38-b563-7ccb7f07cf2d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6867461-1224-454b-9f5e-753fde3546a2]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Flushing IO for device /dev/sdc {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[85269e46-782f-4baf-9b00-82e6b9ef9c08]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fdf6fa-7c8b-410b-a455-a4e1eede500a]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] SCSI volumes sdc have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a45db9-b040-4ba5-aa8d-8484c72f53aa]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG nova.network.neutron [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Successfully created port: 9e97257c-885b-434b-97cd-fe0f3ee85a43 {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9b3749-f1f8-453f-b8ce-84924914f1b5]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a, portal: 172.16.0.220,3260]
Apr 14 01:49:23 user nova-compute[71498]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a, portal: 172.16.0.220,3260] successful.
Apr 14 01:49:23 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50c3ed3-e90c-44a4-bf93-fca542ff2fee]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] <== disconnect_volume: return (375ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG nova.compute.manager [req-314a3f81-29f4-4bdf-bacb-3bf0ae4ea911 req-87cffe63-08bd-42b3-8f08-e78102fc8a20 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Received event network-vif-unplugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-314a3f81-29f4-4bdf-bacb-3bf0ae4ea911 req-87cffe63-08bd-42b3-8f08-e78102fc8a20 service nova] Acquiring lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-314a3f81-29f4-4bdf-bacb-3bf0ae4ea911 req-87cffe63-08bd-42b3-8f08-e78102fc8a20 service nova] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-314a3f81-29f4-4bdf-bacb-3bf0ae4ea911 req-87cffe63-08bd-42b3-8f08-e78102fc8a20 service nova] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG nova.compute.manager [req-314a3f81-29f4-4bdf-bacb-3bf0ae4ea911 req-87cffe63-08bd-42b3-8f08-e78102fc8a20 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] No waiting events found dispatching network-vif-unplugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:49:23 user nova-compute[71498]: WARNING nova.compute.manager [req-314a3f81-29f4-4bdf-bacb-3bf0ae4ea911 req-87cffe63-08bd-42b3-8f08-e78102fc8a20 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Received unexpected event network-vif-unplugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 for instance with vm_state active and task_state rebuilding.
Apr 14 01:49:23 user nova-compute[71498]: DEBUG nova.compute.manager [req-314a3f81-29f4-4bdf-bacb-3bf0ae4ea911 req-87cffe63-08bd-42b3-8f08-e78102fc8a20 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Received event network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-314a3f81-29f4-4bdf-bacb-3bf0ae4ea911 req-87cffe63-08bd-42b3-8f08-e78102fc8a20 service nova] Acquiring lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-314a3f81-29f4-4bdf-bacb-3bf0ae4ea911 req-87cffe63-08bd-42b3-8f08-e78102fc8a20 service nova] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-314a3f81-29f4-4bdf-bacb-3bf0ae4ea911 req-87cffe63-08bd-42b3-8f08-e78102fc8a20 service nova] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG nova.compute.manager [req-314a3f81-29f4-4bdf-bacb-3bf0ae4ea911 req-87cffe63-08bd-42b3-8f08-e78102fc8a20 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] No waiting events found dispatching network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:49:23 user nova-compute[71498]: WARNING nova.compute.manager [req-314a3f81-29f4-4bdf-bacb-3bf0ae4ea911 req-87cffe63-08bd-42b3-8f08-e78102fc8a20 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Received unexpected event network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 for instance with vm_state active and task_state rebuilding.
Apr 14 01:49:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG nova.compute.manager [req-7e07b89d-6f00-4489-9ae8-87301ab99d07 req-85dc7f90-d8e4-4970-97a0-97d3faa9fff1 service nova] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Received event network-vif-plugged-1c1e2ef8-d508-4d18-b4a4-69251ae763d0 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7e07b89d-6f00-4489-9ae8-87301ab99d07 req-85dc7f90-d8e4-4970-97a0-97d3faa9fff1 service nova] Acquiring lock "ae82789e-1bed-419b-a580-68ff7ed03ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7e07b89d-6f00-4489-9ae8-87301ab99d07 req-85dc7f90-d8e4-4970-97a0-97d3faa9fff1 service nova] Lock "ae82789e-1bed-419b-a580-68ff7ed03ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7e07b89d-6f00-4489-9ae8-87301ab99d07 req-85dc7f90-d8e4-4970-97a0-97d3faa9fff1 service nova] Lock "ae82789e-1bed-419b-a580-68ff7ed03ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG nova.compute.manager [req-7e07b89d-6f00-4489-9ae8-87301ab99d07 req-85dc7f90-d8e4-4970-97a0-97d3faa9fff1 service nova] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] No waiting events found dispatching network-vif-plugged-1c1e2ef8-d508-4d18-b4a4-69251ae763d0 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:49:24 user nova-compute[71498]: WARNING nova.compute.manager [req-7e07b89d-6f00-4489-9ae8-87301ab99d07 req-85dc7f90-d8e4-4970-97a0-97d3faa9fff1 service nova] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Received unexpected event network-vif-plugged-1c1e2ef8-d508-4d18-b4a4-69251ae763d0 for instance with vm_state building and task_state spawning.
Apr 14 01:49:24 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Instance destroyed successfully.
Apr 14 01:49:24 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:45:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-889087873',display_name='tempest-ServerActionsTestJSON-server-311342760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-889087873',id=20,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7iIvlhM+wCditCRaonOriLx8WWyehY8kYxTUZ36Z1Q4VGm2JnuefQ18D+1ncnGXJXgbpg/EWHmDPRQFx9TQ2PBQ5aNgSGRUcq/Ovi+zGjOYQDNVYkQyEvsulSNtijWoQ==',key_name='tempest-keypair-165395776',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:45:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2ed4ed4ab2fd4c14b3e2afe343fd7256',ramdisk_id='',reservation_id='r-1656hccc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-2035821517',owner_user_name='tempest-ServerActionsTestJSON-2035821517-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:49:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78ccd1a1ec1b486981d850881734fe02',uuid=73cc8ede-babd-4281-bf1d-c5a3f8bad440,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converting VIF {"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:d1:94,bridge_name='br-int',has_traffic_filtering=True,id=84d281bf-164e-48f3-a3ee-ca796d9a48e7,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d281bf-16') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG os_vif [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:d1:94,bridge_name='br-int',has_traffic_filtering=True,id=84d281bf-164e-48f3-a3ee-ca796d9a48e7,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d281bf-16') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84d281bf-16, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:24 user nova-compute[71498]: INFO os_vif [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:d1:94,bridge_name='br-int',has_traffic_filtering=True,id=84d281bf-164e-48f3-a3ee-ca796d9a48e7,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d281bf-16')
Apr 14 01:49:24 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbmBcKyr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:49:24 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 01:49:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dd309e-cff9-4281-851b-06f8120dc7e0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:49:24 user nova-compute[71498]: No targets found.
Apr 14 01:49:24 user nova-compute[71498]: iSNS:
Apr 14 01:49:24 user nova-compute[71498]: No targets found.
Apr 14 01:49:24 user nova-compute[71498]: STATIC:
Apr 14 01:49:24 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e
Apr 14 01:49:24 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:49:24 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:49:24 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22
Apr 14 01:49:24 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:49:24 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:49:24 user nova-compute[71498]: FIRMWARE:
Apr 14 01:49:24 user nova-compute[71498]: No targets found.
Apr 14 01:49:24 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:49:24 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:49:24 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4598fc3-1724-4253-8de8-0c74799c8b88]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c43535f-56e3-4c54-89d9-b934e1f6d3aa]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:49:24 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:49:24 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:49:24 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:49:24 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51e42523b0>, {}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Disconnecting from: [] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.091s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] <== disconnect_volume: return (93ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:49:24 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Deleting instance files /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440_del
Apr 14 01:49:24 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Deletion of /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440_del complete
Apr 14 01:49:24 user nova-compute[71498]: DEBUG nova.network.neutron [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Successfully updated port: 9e97257c-885b-434b-97cd-fe0f3ee85a43 {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "refresh_cache-e9be81ce-9ccc-4557-9763-33984b2c6573" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquired lock "refresh_cache-e9be81ce-9ccc-4557-9763-33984b2c6573" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG nova.network.neutron [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:49:24 user nova-compute[71498]: INFO nova.virt.block_device [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Booting with volume b1446339-0ce8-401e-b2e0-c4811b486a1a at /dev/vdb
Apr 14 01:49:24 user nova-compute[71498]: DEBUG os_brick.utils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG nova.network.neutron [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0d4651-d3a4-4fed-9e7e-d7b8322a5560]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7db67df-2b07-4979-a8dd-c3ee8ca8e43b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[73648527-a348-4cc5-af2d-6b115cfb71b0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8ed38e-5fde-4cc0-9a61-85feaa672583]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:49:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:49:25 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:49:25 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[939f0aae-ecc3-48c8-8401-8ee830636e98]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:25 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:49:25 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:49:25 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:49:25 user nova-compute[71498]: DEBUG os_brick.utils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:49:25 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Updating existing volume attachment record: 3ce0e3a5-4206-4f9e-b8f7-44479c48a4ef {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:49:25 user nova-compute[71498]: DEBUG nova.network.neutron [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Updating instance_info_cache with network_info: [{"id": "9e97257c-885b-434b-97cd-fe0f3ee85a43", "address": "fa:16:3e:ef:c7:86", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e97257c-88", "ovs_interfaceid": "9e97257c-885b-434b-97cd-fe0f3ee85a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:49:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Releasing lock "refresh_cache-e9be81ce-9ccc-4557-9763-33984b2c6573" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:49:25 user nova-compute[71498]: DEBUG nova.compute.manager [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Instance network_info: |[{"id": "9e97257c-885b-434b-97cd-fe0f3ee85a43", "address": "fa:16:3e:ef:c7:86", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e97257c-88", "ovs_interfaceid": "9e97257c-885b-434b-97cd-fe0f3ee85a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 01:49:26 user nova-compute[71498]: DEBUG nova.compute.manager [req-697ce4f5-3186-45a0-ba1f-e3b12d16ba0e req-1ac308ca-60a0-48e0-917d-5fa5ed3d961e service nova] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Received event network-changed-9e97257c-885b-434b-97cd-fe0f3ee85a43 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:49:26 user nova-compute[71498]: DEBUG nova.compute.manager [req-697ce4f5-3186-45a0-ba1f-e3b12d16ba0e req-1ac308ca-60a0-48e0-917d-5fa5ed3d961e service nova] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Refreshing instance network info cache due to event network-changed-9e97257c-885b-434b-97cd-fe0f3ee85a43. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:49:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-697ce4f5-3186-45a0-ba1f-e3b12d16ba0e req-1ac308ca-60a0-48e0-917d-5fa5ed3d961e service nova] Acquiring lock "refresh_cache-e9be81ce-9ccc-4557-9763-33984b2c6573" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:49:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-697ce4f5-3186-45a0-ba1f-e3b12d16ba0e req-1ac308ca-60a0-48e0-917d-5fa5ed3d961e service nova] Acquired lock "refresh_cache-e9be81ce-9ccc-4557-9763-33984b2c6573" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:49:26 user nova-compute[71498]: DEBUG nova.network.neutron [req-697ce4f5-3186-45a0-ba1f-e3b12d16ba0e req-1ac308ca-60a0-48e0-917d-5fa5ed3d961e service nova] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Refreshing network info cache for port 9e97257c-885b-434b-97cd-fe0f3ee85a43 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:49:26 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436966.412513, ae82789e-1bed-419b-a580-68ff7ed03ef2 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:49:26 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] VM Resumed (Lifecycle Event)
Apr 14 01:49:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:49:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:49:26 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Instance spawned successfully.
Apr 14 01:49:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:49:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:49:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:49:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:49:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:49:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:49:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:49:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:49:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:49:26 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:49:26 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436966.4145503, ae82789e-1bed-419b-a580-68ff7ed03ef2 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:49:26 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] VM Started (Lifecycle Event)
Apr 14 01:49:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:49:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:49:26 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:49:26 user nova-compute[71498]: INFO nova.compute.manager [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Took 7.55 seconds to spawn the instance on the hypervisor.
Apr 14 01:49:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:49:26 user nova-compute[71498]: INFO nova.compute.manager [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Took 8.48 seconds to build instance.
Apr 14 01:49:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ab8f360e-bff1-432b-8c79-3d4d9227a7f3 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "ae82789e-1bed-419b-a580-68ff7ed03ef2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.586s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:27 user nova-compute[71498]: DEBUG nova.network.neutron [req-697ce4f5-3186-45a0-ba1f-e3b12d16ba0e req-1ac308ca-60a0-48e0-917d-5fa5ed3d961e service nova] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Updated VIF entry in instance network info cache for port 9e97257c-885b-434b-97cd-fe0f3ee85a43. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:49:27 user nova-compute[71498]: DEBUG nova.network.neutron [req-697ce4f5-3186-45a0-ba1f-e3b12d16ba0e req-1ac308ca-60a0-48e0-917d-5fa5ed3d961e service nova] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Updating instance_info_cache with network_info: [{"id": "9e97257c-885b-434b-97cd-fe0f3ee85a43", "address": "fa:16:3e:ef:c7:86", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e97257c-88", "ovs_interfaceid": "9e97257c-885b-434b-97cd-fe0f3ee85a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:49:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-697ce4f5-3186-45a0-ba1f-e3b12d16ba0e req-1ac308ca-60a0-48e0-917d-5fa5ed3d961e service nova] Releasing lock "refresh_cache-e9be81ce-9ccc-4557-9763-33984b2c6573" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:49:27 user nova-compute[71498]: DEBUG nova.compute.manager [req-697ce4f5-3186-45a0-ba1f-e3b12d16ba0e req-1ac308ca-60a0-48e0-917d-5fa5ed3d961e service nova] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Received event network-vif-plugged-1c1e2ef8-d508-4d18-b4a4-69251ae763d0 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:49:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-697ce4f5-3186-45a0-ba1f-e3b12d16ba0e req-1ac308ca-60a0-48e0-917d-5fa5ed3d961e service nova] Acquiring lock "ae82789e-1bed-419b-a580-68ff7ed03ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-697ce4f5-3186-45a0-ba1f-e3b12d16ba0e req-1ac308ca-60a0-48e0-917d-5fa5ed3d961e service nova] Lock "ae82789e-1bed-419b-a580-68ff7ed03ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-697ce4f5-3186-45a0-ba1f-e3b12d16ba0e req-1ac308ca-60a0-48e0-917d-5fa5ed3d961e service nova] Lock "ae82789e-1bed-419b-a580-68ff7ed03ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:27 user nova-compute[71498]: DEBUG nova.compute.manager [req-697ce4f5-3186-45a0-ba1f-e3b12d16ba0e req-1ac308ca-60a0-48e0-917d-5fa5ed3d961e service nova] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] No waiting events found dispatching network-vif-plugged-1c1e2ef8-d508-4d18-b4a4-69251ae763d0 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:49:27 user nova-compute[71498]: WARNING nova.compute.manager [req-697ce4f5-3186-45a0-ba1f-e3b12d16ba0e req-1ac308ca-60a0-48e0-917d-5fa5ed3d961e service nova] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Received unexpected event network-vif-plugged-1c1e2ef8-d508-4d18-b4a4-69251ae763d0 for instance with vm_state building and task_state spawning.
Apr 14 01:49:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5f8d1caf-4c50-4374-a727-8e01f083d6d2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "da60f4f1-2474-453f-8f84-c95daf02431a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5f8d1caf-4c50-4374-a727-8e01f083d6d2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "da60f4f1-2474-453f-8f84-c95daf02431a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5f8d1caf-4c50-4374-a727-8e01f083d6d2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "da60f4f1-2474-453f-8f84-c95daf02431a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5f8d1caf-4c50-4374-a727-8e01f083d6d2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "da60f4f1-2474-453f-8f84-c95daf02431a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5f8d1caf-4c50-4374-a727-8e01f083d6d2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "da60f4f1-2474-453f-8f84-c95daf02431a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:27 user nova-compute[71498]: INFO nova.compute.manager [None req-5f8d1caf-4c50-4374-a727-8e01f083d6d2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Terminating instance
Apr 14 01:49:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-5f8d1caf-4c50-4374-a727-8e01f083d6d2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 01:49:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG nova.compute.manager [req-d8a16da9-33f4-4117-9a0a-3bf7c6b0c16f req-e858bcaf-ec4a-4ba9-9ae1-44104247da6f service nova] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Received event network-vif-unplugged-b8356c3e-ccfb-44ae-8020-af80bcb28a43 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d8a16da9-33f4-4117-9a0a-3bf7c6b0c16f req-e858bcaf-ec4a-4ba9-9ae1-44104247da6f service nova] Acquiring lock "da60f4f1-2474-453f-8f84-c95daf02431a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d8a16da9-33f4-4117-9a0a-3bf7c6b0c16f req-e858bcaf-ec4a-4ba9-9ae1-44104247da6f service nova] Lock "da60f4f1-2474-453f-8f84-c95daf02431a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d8a16da9-33f4-4117-9a0a-3bf7c6b0c16f req-e858bcaf-ec4a-4ba9-9ae1-44104247da6f service nova] Lock "da60f4f1-2474-453f-8f84-c95daf02431a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG nova.compute.manager [req-d8a16da9-33f4-4117-9a0a-3bf7c6b0c16f req-e858bcaf-ec4a-4ba9-9ae1-44104247da6f service nova] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] No waiting events found dispatching network-vif-unplugged-b8356c3e-ccfb-44ae-8020-af80bcb28a43 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG nova.compute.manager [req-d8a16da9-33f4-4117-9a0a-3bf7c6b0c16f req-e858bcaf-ec4a-4ba9-9ae1-44104247da6f service nova] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Received event network-vif-unplugged-b8356c3e-ccfb-44ae-8020-af80bcb28a43 for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:49:28 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Instance destroyed successfully.
Apr 14 01:49:28 user nova-compute[71498]: DEBUG nova.objects.instance [None req-5f8d1caf-4c50-4374-a727-8e01f083d6d2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lazy-loading 'resources' on Instance uuid da60f4f1-2474-453f-8f84-c95daf02431a {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-5f8d1caf-4c50-4374-a727-8e01f083d6d2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:40:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-107707434',display_name='tempest-ServersNegativeTestJSON-server-107707434',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-107707434',id=1,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:41:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='907f632263e04bf2a6c8ff1bae77a5c7',ramdisk_id='',reservation_id='r-bai38l24',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1259366012',owner_user_name='tempest-ServersNegativeTestJSON-1259366012-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:41:05Z,user_data=None,user_id='236828e284154097a25f59eaedf47c29',uuid=da60f4f1-2474-453f-8f84-c95daf02431a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8356c3e-ccfb-44ae-8020-af80bcb28a43", "address": "fa:16:3e:ad:43:af", "network": {"id": "93155729-11d3-4eff-bbd2-8860a881e233", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047423124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "907f632263e04bf2a6c8ff1bae77a5c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8356c3e-cc", "ovs_interfaceid": "b8356c3e-ccfb-44ae-8020-af80bcb28a43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-5f8d1caf-4c50-4374-a727-8e01f083d6d2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Converting VIF {"id": "b8356c3e-ccfb-44ae-8020-af80bcb28a43", "address": "fa:16:3e:ad:43:af", "network": {"id": "93155729-11d3-4eff-bbd2-8860a881e233", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047423124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "907f632263e04bf2a6c8ff1bae77a5c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8356c3e-cc", "ovs_interfaceid": "b8356c3e-ccfb-44ae-8020-af80bcb28a43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-5f8d1caf-4c50-4374-a727-8e01f083d6d2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:43:af,bridge_name='br-int',has_traffic_filtering=True,id=b8356c3e-ccfb-44ae-8020-af80bcb28a43,network=Network(93155729-11d3-4eff-bbd2-8860a881e233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8356c3e-cc') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG os_vif [None req-5f8d1caf-4c50-4374-a727-8e01f083d6d2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:43:af,bridge_name='br-int',has_traffic_filtering=True,id=b8356c3e-ccfb-44ae-8020-af80bcb28a43,network=Network(93155729-11d3-4eff-bbd2-8860a881e233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8356c3e-cc') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8356c3e-cc, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:28 user nova-compute[71498]: INFO os_vif [None req-5f8d1caf-4c50-4374-a727-8e01f083d6d2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:43:af,bridge_name='br-int',has_traffic_filtering=True,id=b8356c3e-ccfb-44ae-8020-af80bcb28a43,network=Network(93155729-11d3-4eff-bbd2-8860a881e233),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8356c3e-cc')
Apr 14 01:49:28 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-5f8d1caf-4c50-4374-a727-8e01f083d6d2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Deleting instance files /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a_del
Apr 14 01:49:28 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-5f8d1caf-4c50-4374-a727-8e01f083d6d2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Deletion of /opt/stack/data/nova/instances/da60f4f1-2474-453f-8f84-c95daf02431a_del complete
Apr 14 01:49:28 user nova-compute[71498]: INFO nova.compute.manager [None req-5f8d1caf-4c50-4374-a727-8e01f083d6d2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 14 01:49:28 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-5f8d1caf-4c50-4374-a727-8e01f083d6d2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG os_brick.utils [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb3f4eb-d58f-4d48-92eb-f2bd0dbf2156]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4c6107-de06-47fc-a7c6-e8aa886ca9f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3443ea52-5f2c-4eb5-8705-739d912c6be7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9e5b99-f232-4d47-8293-4b56f8431f01]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:49:28 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:49:28 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ba6ecc-f13a-4d34-957f-1420dc6915eb]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG os_brick.utils [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:49:28 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Updating existing volume attachment record: 89becd1c-3c20-46ef-8267-7db080ef09a2 {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:49:29 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:49:29 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Took 0.53 seconds to deallocate network for instance.
Apr 14 01:49:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5f8d1caf-4c50-4374-a727-8e01f083d6d2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5f8d1caf-4c50-4374-a727-8e01f083d6d2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:29 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-5f8d1caf-4c50-4374-a727-8e01f083d6d2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:49:29 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-5f8d1caf-4c50-4374-a727-8e01f083d6d2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:49:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5f8d1caf-4c50-4374-a727-8e01f083d6d2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.469s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:29 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-5f8d1caf-4c50-4374-a727-8e01f083d6d2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Deleted allocations for instance da60f4f1-2474-453f-8f84-c95daf02431a
Apr 14 01:49:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5f8d1caf-4c50-4374-a727-8e01f083d6d2 tempest-ServersNegativeTestJSON-1259366012 tempest-ServersNegativeTestJSON-1259366012-project-member] Lock "da60f4f1-2474-453f-8f84-c95daf02431a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.108s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:49:30 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Creating image(s)
Apr 14 01:49:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "/opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "/opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "/opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:30 user nova-compute[71498]: DEBUG nova.compute.manager [req-ee7c4ab5-1a8f-48ef-baa2-d1ac0a5c68a4 req-0e9cbc8e-9ce1-48ca-8012-4b55ab6b9ab3 service nova] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Received event network-vif-plugged-b8356c3e-ccfb-44ae-8020-af80bcb28a43 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:49:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ee7c4ab5-1a8f-48ef-baa2-d1ac0a5c68a4 req-0e9cbc8e-9ce1-48ca-8012-4b55ab6b9ab3 service nova] Acquiring lock "da60f4f1-2474-453f-8f84-c95daf02431a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ee7c4ab5-1a8f-48ef-baa2-d1ac0a5c68a4 req-0e9cbc8e-9ce1-48ca-8012-4b55ab6b9ab3 service nova] Lock "da60f4f1-2474-453f-8f84-c95daf02431a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ee7c4ab5-1a8f-48ef-baa2-d1ac0a5c68a4 req-0e9cbc8e-9ce1-48ca-8012-4b55ab6b9ab3 service nova] Lock "da60f4f1-2474-453f-8f84-c95daf02431a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:30 user nova-compute[71498]: DEBUG nova.compute.manager [req-ee7c4ab5-1a8f-48ef-baa2-d1ac0a5c68a4 req-0e9cbc8e-9ce1-48ca-8012-4b55ab6b9ab3 service nova] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] No waiting events found dispatching network-vif-plugged-b8356c3e-ccfb-44ae-8020-af80bcb28a43 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:49:30 user nova-compute[71498]: WARNING nova.compute.manager [req-ee7c4ab5-1a8f-48ef-baa2-d1ac0a5c68a4 req-0e9cbc8e-9ce1-48ca-8012-4b55ab6b9ab3 service nova] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Received unexpected event network-vif-plugged-b8356c3e-ccfb-44ae-8020-af80bcb28a43 for instance with vm_state deleted and task_state None.
Apr 14 01:49:30 user nova-compute[71498]: DEBUG nova.compute.manager [req-ee7c4ab5-1a8f-48ef-baa2-d1ac0a5c68a4 req-0e9cbc8e-9ce1-48ca-8012-4b55ab6b9ab3 service nova] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Received event network-vif-deleted-b8356c3e-ccfb-44ae-8020-af80bcb28a43 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:49:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.145s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.253s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk 1073741824" returned: 0 in 0.065s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.327s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.156s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Checking if we can resize image /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Cannot resize image /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Ensure instance console log exists: /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Start _get_guest_xml network_info=[{"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3ce0e3a5-4206-4f9e-b8f7-44479c48a4ef', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbmBcKyr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '73cc8ede-babd-4281-bf1d-c5a3f8bad440', 'attached_at': '', 'detached_at': '', 'volume_id': 'b1446339-0ce8-401e-b2e0-c4811b486a1a', 'serial': 'b1446339-0ce8-401e-b2e0-c4811b486a1a'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:49:31 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 14 01:49:31 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 14 01:49:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG nova.objects.instance [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lazy-loading 'vcpu_model' on Instance uuid 73cc8ede-babd-4281-bf1d-c5a3f8bad440 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbmBcKyr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:49:31 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 01:49:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:49:31 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 01:49:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:49:31 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb9a6d2-efd8-4b84-a878-a7b063f130b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:49:31 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf797ece-cb1c-4e14-adf1-d9b7f8ac1d27]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a] added
Apr 14 01:49:31 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d09476-aba1-4e41-86db-ed9f7cf75d8a]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[077e3302-fde1-4eea-89c7-d1943ec37552]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MbmBcKyr {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MbmBcKyr" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4333161e-0de0-43cb-8fc4-6a16c2e76441]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MbmBcKyr'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac507cc5-ac01-4302-8d80-b54d7e0f3045]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf4b7fc-24dd-4409-ad05-5337e2f3d4bd]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:49:31 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:49:31 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:49:31 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:49:31 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[04239d92-a50e-4e52-bd2e-3b30241dd4a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a, portal: 172.16.0.220,3260]
Apr 14 01:49:31 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a, portal: 172.16.0.220,3260] successful.
Apr 14 01:49:31 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5986524c-aafd-408c-bef5-803ff5404114]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b26de17-dfb9-41dd-8440-c21fd10b82eb]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:49:31 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:49:31 user nova-compute[71498]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)
Apr 14 01:49:31 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:49:31 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:49:31 user nova-compute[71498]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)
Apr 14 01:49:31 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4440d6b-a0e8-45ca-9ab2-4ad8abc19c52]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:49:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbmBcKyr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:49:32 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:49:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:32 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 01:49:32 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:49:32 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23936353864386236', 'path': '/dev/sdc'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:49:32 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936353864386236', 'path': '/dev/sdc'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:49:32 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T01:45:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-889087873',display_name='tempest-ServerActionsTestJSON-server-311342760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-889087873',id=20,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7iIvlhM+wCditCRaonOriLx8WWyehY8kYxTUZ36Z1Q4VGm2JnuefQ18D+1ncnGXJXgbpg/EWHmDPRQFx9TQ2PBQ5aNgSGRUcq/Ovi+zGjOYQDNVYkQyEvsulSNtijWoQ==',key_name='tempest-keypair-165395776',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:45:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2ed4ed4ab2fd4c14b3e2afe343fd7256',ramdisk_id='',reservation_id='r-1656hccc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-2035821517',owner_user_name='tempest-ServerActionsTestJSON-2035821517-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:49:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78ccd1a1ec1b486981d850881734fe02',uuid=73cc8ede-babd-4281-bf1d-c5a3f8bad440,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:49:32 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converting VIF {"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:49:32 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:d1:94,bridge_name='br-int',has_traffic_filtering=True,id=84d281bf-164e-48f3-a3ee-ca796d9a48e7,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d281bf-16') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:49:32 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:49:32 user nova-compute[71498]:   <uuid>73cc8ede-babd-4281-bf1d-c5a3f8bad440</uuid>
Apr 14 01:49:32 user nova-compute[71498]:   <name>instance-00000014</name>
Apr 14 01:49:32 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:49:32 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:49:32 user nova-compute[71498]:   <metadata>
Apr 14 01:49:32 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:49:32 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:49:32 user nova-compute[71498]:       <nova:name>tempest-ServerActionsTestJSON-server-311342760</nova:name>
Apr 14 01:49:32 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:49:31</nova:creationTime>
Apr 14 01:49:32 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:49:32 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:49:32 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:49:32 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:49:32 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:49:32 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:49:32 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:49:32 user nova-compute[71498]:       <nova:owner>
Apr 14 01:49:32 user nova-compute[71498]:         <nova:user uuid="78ccd1a1ec1b486981d850881734fe02">tempest-ServerActionsTestJSON-2035821517-project-member</nova:user>
Apr 14 01:49:32 user nova-compute[71498]:         <nova:project uuid="2ed4ed4ab2fd4c14b3e2afe343fd7256">tempest-ServerActionsTestJSON-2035821517</nova:project>
Apr 14 01:49:32 user nova-compute[71498]:       </nova:owner>
Apr 14 01:49:32 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:49:32 user nova-compute[71498]:       <nova:ports>
Apr 14 01:49:32 user nova-compute[71498]:         <nova:port uuid="84d281bf-164e-48f3-a3ee-ca796d9a48e7">
Apr 14 01:49:32 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 01:49:32 user nova-compute[71498]:         </nova:port>
Apr 14 01:49:32 user nova-compute[71498]:       </nova:ports>
Apr 14 01:49:32 user nova-compute[71498]:     </nova:instance>
Apr 14 01:49:32 user nova-compute[71498]:   </metadata>
Apr 14 01:49:32 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:49:32 user nova-compute[71498]:     <system>
Apr 14 01:49:32 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:49:32 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:49:32 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:49:32 user nova-compute[71498]:       <entry name="serial">73cc8ede-babd-4281-bf1d-c5a3f8bad440</entry>
Apr 14 01:49:32 user nova-compute[71498]:       <entry name="uuid">73cc8ede-babd-4281-bf1d-c5a3f8bad440</entry>
Apr 14 01:49:32 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:49:32 user nova-compute[71498]:     </system>
Apr 14 01:49:32 user nova-compute[71498]:   </sysinfo>
Apr 14 01:49:32 user nova-compute[71498]:   <os>
Apr 14 01:49:32 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:49:32 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:49:32 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:49:32 user nova-compute[71498]:   </os>
Apr 14 01:49:32 user nova-compute[71498]:   <features>
Apr 14 01:49:32 user nova-compute[71498]:     <acpi/>
Apr 14 01:49:32 user nova-compute[71498]:     <apic/>
Apr 14 01:49:32 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:49:32 user nova-compute[71498]:   </features>
Apr 14 01:49:32 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:49:32 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:49:32 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:49:32 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:49:32 user nova-compute[71498]:   </clock>
Apr 14 01:49:32 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:49:32 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:49:32 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:49:32 user nova-compute[71498]:   </cpu>
Apr 14 01:49:32 user nova-compute[71498]:   <devices>
Apr 14 01:49:32 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:49:32 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:49:32 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk"/>
Apr 14 01:49:32 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:49:32 user nova-compute[71498]:     </disk>
Apr 14 01:49:32 user nova-compute[71498]:     <disk type="block" device="disk">
Apr 14 01:49:32 user nova-compute[71498]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:49:32 user nova-compute[71498]:       <source dev="/dev/sdc"/>
Apr 14 01:49:32 user nova-compute[71498]:       <target dev="vdb" bus="virtio"/>
Apr 14 01:49:32 user nova-compute[71498]:       <serial>b1446339-0ce8-401e-b2e0-c4811b486a1a</serial>
Apr 14 01:49:32 user nova-compute[71498]:     </disk>
Apr 14 01:49:32 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:49:32 user nova-compute[71498]:       <mac address="fa:16:3e:b2:d1:94"/>
Apr 14 01:49:32 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:49:32 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:49:32 user nova-compute[71498]:       <target dev="tap84d281bf-16"/>
Apr 14 01:49:32 user nova-compute[71498]:     </interface>
Apr 14 01:49:32 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:49:32 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/console.log" append="off"/>
Apr 14 01:49:32 user nova-compute[71498]:     </serial>
Apr 14 01:49:32 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:49:32 user nova-compute[71498]:     <video>
Apr 14 01:49:32 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:49:32 user nova-compute[71498]:     </video>
Apr 14 01:49:32 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:49:32 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:49:32 user nova-compute[71498]:     </rng>
Apr 14 01:49:32 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:49:32 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:49:32 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:49:32 user nova-compute[71498]:     </memballoon>
Apr 14 01:49:32 user nova-compute[71498]:   </devices>
Apr 14 01:49:32 user nova-compute[71498]: </domain>
Apr 14 01:49:32 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:49:32 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T01:45:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-889087873',display_name='tempest-ServerActionsTestJSON-server-311342760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-889087873',id=20,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7iIvlhM+wCditCRaonOriLx8WWyehY8kYxTUZ36Z1Q4VGm2JnuefQ18D+1ncnGXJXgbpg/EWHmDPRQFx9TQ2PBQ5aNgSGRUcq/Ovi+zGjOYQDNVYkQyEvsulSNtijWoQ==',key_name='tempest-keypair-165395776',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:45:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2ed4ed4ab2fd4c14b3e2afe343fd7256',ramdisk_id='',reservation_id='r-1656hccc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-2035821517',owner_user_name='tempest-ServerActionsTestJSON-2035821517-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:49:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78ccd1a1ec1b486981d850881734fe02',uuid=73cc8ede-babd-4281-bf1d-c5a3f8bad440,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:49:32 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converting VIF {"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:49:32 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:d1:94,bridge_name='br-int',has_traffic_filtering=True,id=84d281bf-164e-48f3-a3ee-ca796d9a48e7,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d281bf-16') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:49:32 user nova-compute[71498]: DEBUG os_vif [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:d1:94,bridge_name='br-int',has_traffic_filtering=True,id=84d281bf-164e-48f3-a3ee-ca796d9a48e7,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d281bf-16') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:49:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:49:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:49:32 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:49:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84d281bf-16, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:49:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap84d281bf-16, col_values=(('external_ids', {'iface-id': '84d281bf-164e-48f3-a3ee-ca796d9a48e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:d1:94', 'vm-uuid': '73cc8ede-babd-4281-bf1d-c5a3f8bad440'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:49:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:49:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:32 user nova-compute[71498]: INFO os_vif [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:d1:94,bridge_name='br-int',has_traffic_filtering=True,id=84d281bf-164e-48f3-a3ee-ca796d9a48e7,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d281bf-16')
Apr 14 01:49:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:32 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:49:32 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:49:32 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] No VIF found with MAC fa:16:3e:b2:d1:94, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:49:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:33 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:49:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG nova.compute.manager [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:49:34 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Creating image(s)
Apr 14 01:49:34 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Did not create local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Ensure instance console log exists: /opt/stack/data/nova/instances/e9be81ce-9ccc-4557-9763-33984b2c6573/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Start _get_guest_xml network_info=[{"id": "9e97257c-885b-434b-97cd-fe0f3ee85a43", "address": "fa:16:3e:ef:c7:86", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e97257c-88", "ovs_interfaceid": "9e97257c-885b-434b-97cd-fe0f3ee85a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-14T01:49:18Z,direct_url=<?>,disk_format='qcow2',id=bdcaffbf-53d5-4766-b9e2-130897a929c1,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1833990483',owner='c1f4117a4adb4aa3b42951cf1fc84237',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-14T01:49:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '89becd1c-3c20-46ef-8267-7db080ef09a2', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WOKSIlVx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e9be81ce-9ccc-4557-9763-33984b2c6573', 'attached_at': '', 'detached_at': '', 'volume_id': 'cc92e1f9-d41a-47d9-abab-eca949db9d8e', 'serial': 'cc92e1f9-d41a-47d9-abab-eca949db9d8e'}, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:49:34 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:49:34 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:49:34 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-14T01:49:18Z,direct_url=<?>,disk_format='qcow2',id=bdcaffbf-53d5-4766-b9e2-130897a929c1,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1833990483',owner='c1f4117a4adb4aa3b42951cf1fc84237',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-14T01:49:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WOKSIlVx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:49:34 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:49:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:49:34 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:49:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:49:34 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:49:34 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac0a318-9a02-48e0-8edd-42e183c5f0dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:49:34 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.036s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[913a86ae-27fc-405b-b72d-d9faa05eb4a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e] added
Apr 14 01:49:34 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4e44ac-2c01-4c10-a75e-4ffefc938921]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[924186dd-42fc-46aa-b66a-a8cfacb98a86]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WOKSIlVx {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WOKSIlVx" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1337046-7e52-43d4-9738-4d9864778b52]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WOKSIlVx'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[20420a80-5324-4a7e-a28b-cdc754e5eba8]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a124ea-a948-4e6a-a321-a506b85f4997]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:49:34 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:49:34 user nova-compute[71498]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)
Apr 14 01:49:34 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:49:34 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:49:34 user nova-compute[71498]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)
Apr 14 01:49:34 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG nova.compute.manager [req-7f97260c-46ff-4685-b750-107ef693d1bd req-1f834622-a2c2-4ee8-818c-0f67af9919ab service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Received event network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7f97260c-46ff-4685-b750-107ef693d1bd req-1f834622-a2c2-4ee8-818c-0f67af9919ab service nova] Acquiring lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7f97260c-46ff-4685-b750-107ef693d1bd req-1f834622-a2c2-4ee8-818c-0f67af9919ab service nova] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7f97260c-46ff-4685-b750-107ef693d1bd req-1f834622-a2c2-4ee8-818c-0f67af9919ab service nova] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG nova.compute.manager [req-7f97260c-46ff-4685-b750-107ef693d1bd req-1f834622-a2c2-4ee8-818c-0f67af9919ab service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] No waiting events found dispatching network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:49:34 user nova-compute[71498]: WARNING nova.compute.manager [req-7f97260c-46ff-4685-b750-107ef693d1bd req-1f834622-a2c2-4ee8-818c-0f67af9919ab service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Received unexpected event network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 for instance with vm_state active and task_state rebuild_spawning.
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9361336-679d-4c51-97e1-5f6aa8afa794]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e, portal: 172.16.0.220,3260]
Apr 14 01:49:34 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e, portal: 172.16.0.220,3260] successful.
Apr 14 01:49:34 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d583ec27-1139-497a-af87-70da8b85b7aa]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[87603997-c227-4374-93c0-61dbf90bc317]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:49:34 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:49:34 user nova-compute[71498]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)
Apr 14 01:49:34 user nova-compute[71498]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e (non-flash)
Apr 14 01:49:34 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:49:34 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:49:34 user nova-compute[71498]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)
Apr 14 01:49:34 user nova-compute[71498]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e (non-flash)
Apr 14 01:49:34 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.471s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e055a09e-873d-4de0-8bb2-8c60e45b227f]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:35 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:49:35 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WOKSIlVx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:49:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.743s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] <== connect_volume: return (2745ms) {'type': 'block', 'scsi_wwn': '23532303063663439', 'path': '/dev/sdd'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532303063663439', 'path': '/dev/sdd'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Removed pending event for 73cc8ede-babd-4281-bf1d-c5a3f8bad440 due to event {{(pid=71498) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436976.8121994, 73cc8ede-babd-4281-bf1d-c5a3f8bad440 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:49:37 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] VM Resumed (Lifecycle Event)
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.compute.manager [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.compute.manager [req-2abd32ea-e005-49a5-9b1e-f084e8d88397 req-73b75ce6-b221-4fbf-9ffb-331a09eb7f2d service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Received event network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-2abd32ea-e005-49a5-9b1e-f084e8d88397 req-73b75ce6-b221-4fbf-9ffb-331a09eb7f2d service nova] Acquiring lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-2abd32ea-e005-49a5-9b1e-f084e8d88397 req-73b75ce6-b221-4fbf-9ffb-331a09eb7f2d service nova] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-2abd32ea-e005-49a5-9b1e-f084e8d88397 req-73b75ce6-b221-4fbf-9ffb-331a09eb7f2d service nova] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.compute.manager [req-2abd32ea-e005-49a5-9b1e-f084e8d88397 req-73b75ce6-b221-4fbf-9ffb-331a09eb7f2d service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] No waiting events found dispatching network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:49:37 user nova-compute[71498]: WARNING nova.compute.manager [req-2abd32ea-e005-49a5-9b1e-f084e8d88397 req-73b75ce6-b221-4fbf-9ffb-331a09eb7f2d service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Received unexpected event network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 for instance with vm_state active and task_state rebuild_spawning.
Apr 14 01:49:37 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:49:37 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=8039MB free_disk=26.375598907470703GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:37 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Instance spawned successfully.
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:49:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-957339692',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-957339692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-957339692',id=26,image_ref='bdcaffbf-53d5-4766-b9e2-130897a929c1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1f4117a4adb4aa3b42951cf1fc84237',ramdisk_id='',reservation_id='r-qvh0t9s7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-224521177',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-224521177-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-224521177',owner_user_name='tempest-TestVolumeBootPattern-224521177-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:49:23Z,user_data=None,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',uuid=e9be81ce-9ccc-4557-9763-33984b2c6573,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e97257c-885b-434b-97cd-fe0f3ee85a43", "address": "fa:16:3e:ef:c7:86", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e97257c-88", "ovs_interfaceid": "9e97257c-885b-434b-97cd-fe0f3ee85a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converting VIF {"id": "9e97257c-885b-434b-97cd-fe0f3ee85a43", "address": "fa:16:3e:ef:c7:86", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e97257c-88", "ovs_interfaceid": "9e97257c-885b-434b-97cd-fe0f3ee85a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c7:86,bridge_name='br-int',has_traffic_filtering=True,id=9e97257c-885b-434b-97cd-fe0f3ee85a43,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e97257c-88') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.objects.instance [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lazy-loading 'pci_devices' on Instance uuid e9be81ce-9ccc-4557-9763-33984b2c6573 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:49:37 user nova-compute[71498]:   <uuid>e9be81ce-9ccc-4557-9763-33984b2c6573</uuid>
Apr 14 01:49:37 user nova-compute[71498]:   <name>instance-0000001a</name>
Apr 14 01:49:37 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:49:37 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:49:37 user nova-compute[71498]:   <metadata>
Apr 14 01:49:37 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:49:37 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:49:37 user nova-compute[71498]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-957339692</nova:name>
Apr 14 01:49:37 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:49:34</nova:creationTime>
Apr 14 01:49:37 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:49:37 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:49:37 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:49:37 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:49:37 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:49:37 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:49:37 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:49:37 user nova-compute[71498]:       <nova:owner>
Apr 14 01:49:37 user nova-compute[71498]:         <nova:user uuid="50e3354ac1a84c59a7dee8e1ae6e771a">tempest-TestVolumeBootPattern-224521177-project-member</nova:user>
Apr 14 01:49:37 user nova-compute[71498]:         <nova:project uuid="c1f4117a4adb4aa3b42951cf1fc84237">tempest-TestVolumeBootPattern-224521177</nova:project>
Apr 14 01:49:37 user nova-compute[71498]:       </nova:owner>
Apr 14 01:49:37 user nova-compute[71498]:       <nova:root type="image" uuid="bdcaffbf-53d5-4766-b9e2-130897a929c1"/>
Apr 14 01:49:37 user nova-compute[71498]:       <nova:ports>
Apr 14 01:49:37 user nova-compute[71498]:         <nova:port uuid="9e97257c-885b-434b-97cd-fe0f3ee85a43">
Apr 14 01:49:37 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 01:49:37 user nova-compute[71498]:         </nova:port>
Apr 14 01:49:37 user nova-compute[71498]:       </nova:ports>
Apr 14 01:49:37 user nova-compute[71498]:     </nova:instance>
Apr 14 01:49:37 user nova-compute[71498]:   </metadata>
Apr 14 01:49:37 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:49:37 user nova-compute[71498]:     <system>
Apr 14 01:49:37 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:49:37 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:49:37 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:49:37 user nova-compute[71498]:       <entry name="serial">e9be81ce-9ccc-4557-9763-33984b2c6573</entry>
Apr 14 01:49:37 user nova-compute[71498]:       <entry name="uuid">e9be81ce-9ccc-4557-9763-33984b2c6573</entry>
Apr 14 01:49:37 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:49:37 user nova-compute[71498]:     </system>
Apr 14 01:49:37 user nova-compute[71498]:   </sysinfo>
Apr 14 01:49:37 user nova-compute[71498]:   <os>
Apr 14 01:49:37 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:49:37 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:49:37 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:49:37 user nova-compute[71498]:   </os>
Apr 14 01:49:37 user nova-compute[71498]:   <features>
Apr 14 01:49:37 user nova-compute[71498]:     <acpi/>
Apr 14 01:49:37 user nova-compute[71498]:     <apic/>
Apr 14 01:49:37 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:49:37 user nova-compute[71498]:   </features>
Apr 14 01:49:37 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:49:37 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:49:37 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:49:37 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:49:37 user nova-compute[71498]:   </clock>
Apr 14 01:49:37 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:49:37 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:49:37 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:49:37 user nova-compute[71498]:   </cpu>
Apr 14 01:49:37 user nova-compute[71498]:   <devices>
Apr 14 01:49:37 user nova-compute[71498]:     <disk type="block" device="disk">
Apr 14 01:49:37 user nova-compute[71498]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:49:37 user nova-compute[71498]:       <source dev="/dev/sdd"/>
Apr 14 01:49:37 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:49:37 user nova-compute[71498]:       <serial>cc92e1f9-d41a-47d9-abab-eca949db9d8e</serial>
Apr 14 01:49:37 user nova-compute[71498]:     </disk>
Apr 14 01:49:37 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:49:37 user nova-compute[71498]:       <mac address="fa:16:3e:ef:c7:86"/>
Apr 14 01:49:37 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:49:37 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:49:37 user nova-compute[71498]:       <target dev="tap9e97257c-88"/>
Apr 14 01:49:37 user nova-compute[71498]:     </interface>
Apr 14 01:49:37 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:49:37 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/e9be81ce-9ccc-4557-9763-33984b2c6573/console.log" append="off"/>
Apr 14 01:49:37 user nova-compute[71498]:     </serial>
Apr 14 01:49:37 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:49:37 user nova-compute[71498]:     <video>
Apr 14 01:49:37 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:49:37 user nova-compute[71498]:     </video>
Apr 14 01:49:37 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:49:37 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:49:37 user nova-compute[71498]:     </rng>
Apr 14 01:49:37 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:49:37 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:49:37 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:49:37 user nova-compute[71498]:     </memballoon>
Apr 14 01:49:37 user nova-compute[71498]:   </devices>
Apr 14 01:49:37 user nova-compute[71498]: </domain>
Apr 14 01:49:37 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:49:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-957339692',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-957339692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-957339692',id=26,image_ref='bdcaffbf-53d5-4766-b9e2-130897a929c1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1f4117a4adb4aa3b42951cf1fc84237',ramdisk_id='',reservation_id='r-qvh0t9s7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-224521177',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-224521177-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-224521177',owner_user_name='tempest-TestVolumeBootPattern-224521177-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:49:23Z,user_data=None,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',uuid=e9be81ce-9ccc-4557-9763-33984b2c6573,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e97257c-885b-434b-97cd-fe0f3ee85a43", "address": "fa:16:3e:ef:c7:86", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e97257c-88", "ovs_interfaceid": "9e97257c-885b-434b-97cd-fe0f3ee85a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converting VIF {"id": "9e97257c-885b-434b-97cd-fe0f3ee85a43", "address": "fa:16:3e:ef:c7:86", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e97257c-88", "ovs_interfaceid": "9e97257c-885b-434b-97cd-fe0f3ee85a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c7:86,bridge_name='br-int',has_traffic_filtering=True,id=9e97257c-885b-434b-97cd-fe0f3ee85a43,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e97257c-88') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG os_vif [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c7:86,bridge_name='br-int',has_traffic_filtering=True,id=9e97257c-885b-434b-97cd-fe0f3ee85a43,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e97257c-88') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:49:37 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436976.8133888, 73cc8ede-babd-4281-bf1d-c5a3f8bad440 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:49:37 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] VM Started (Lifecycle Event)
Apr 14 01:49:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e97257c-88, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9e97257c-88, col_values=(('external_ids', {'iface-id': '9e97257c-885b-434b-97cd-fe0f3ee85a43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:c7:86', 'vm-uuid': 'e9be81ce-9ccc-4557-9763-33984b2c6573'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:37 user nova-compute[71498]: INFO os_vif [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c7:86,bridge_name='br-int',has_traffic_filtering=True,id=9e97257c-885b-434b-97cd-fe0f3ee85a43,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e97257c-88')
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance a19a1c08-5454-481b-bb5a-70c39ead9afc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance fa29c144-0ff9-4efb-a574-f521d18f08fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 74311da6-d6b8-4aea-b6ce-97db8da53800 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 1ccf53b5-9199-4812-a635-4f4f22fb5d28 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance ae82789e-1bed-419b-a580-68ff7ed03ef2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance e9be81ce-9ccc-4557-9763-33984b2c6573 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 01:49:37 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.compute.manager [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] No VIF found with MAC fa:16:3e:ef:c7:86, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.683s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.377s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:37 user nova-compute[71498]: DEBUG nova.objects.instance [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71498) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 14 01:49:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-daaaa0fd-0e70-4e99-b811-2a43521cc6bd tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.100s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:39 user nova-compute[71498]: DEBUG nova.compute.manager [req-097b37db-e64e-4687-b1b3-918f413780af req-ac256929-21d5-490c-82b4-045329bba3cd service nova] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Received event network-vif-plugged-9e97257c-885b-434b-97cd-fe0f3ee85a43 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:49:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-097b37db-e64e-4687-b1b3-918f413780af req-ac256929-21d5-490c-82b4-045329bba3cd service nova] Acquiring lock "e9be81ce-9ccc-4557-9763-33984b2c6573-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-097b37db-e64e-4687-b1b3-918f413780af req-ac256929-21d5-490c-82b4-045329bba3cd service nova] Lock "e9be81ce-9ccc-4557-9763-33984b2c6573-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-097b37db-e64e-4687-b1b3-918f413780af req-ac256929-21d5-490c-82b4-045329bba3cd service nova] Lock "e9be81ce-9ccc-4557-9763-33984b2c6573-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:39 user nova-compute[71498]: DEBUG nova.compute.manager [req-097b37db-e64e-4687-b1b3-918f413780af req-ac256929-21d5-490c-82b4-045329bba3cd service nova] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] No waiting events found dispatching network-vif-plugged-9e97257c-885b-434b-97cd-fe0f3ee85a43 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:49:39 user nova-compute[71498]: WARNING nova.compute.manager [req-097b37db-e64e-4687-b1b3-918f413780af req-ac256929-21d5-490c-82b4-045329bba3cd service nova] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Received unexpected event network-vif-plugged-9e97257c-885b-434b-97cd-fe0f3ee85a43 for instance with vm_state building and task_state spawning.
Apr 14 01:49:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:39 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:49:39 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:49:39 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 01:49:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-a19a1c08-5454-481b-bb5a-70c39ead9afc" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:49:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-a19a1c08-5454-481b-bb5a-70c39ead9afc" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:49:40 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 01:49:40 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Updating instance_info_cache with network_info: [{"id": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "address": "fa:16:3e:1f:54:6c", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b00fd21-ee", "ovs_interfaceid": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:49:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-a19a1c08-5454-481b-bb5a-70c39ead9afc" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:49:40 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 01:49:40 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:49:40 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:49:40 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:49:40 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:49:40 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:49:40 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 01:49:41 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436981.1862419, e9be81ce-9ccc-4557-9763-33984b2c6573 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:49:41 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] VM Resumed (Lifecycle Event)
Apr 14 01:49:41 user nova-compute[71498]: DEBUG nova.compute.manager [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:49:41 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:49:41 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Instance spawned successfully.
Apr 14 01:49:41 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:49:41 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:49:41 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:49:41 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:49:41 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:49:41 user nova-compute[71498]: DEBUG nova.compute.manager [req-5ad30821-0ee2-4962-bab5-f77ca520f5f1 req-b778f365-f1ed-4206-97d7-05ac81604ab4 service nova] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Received event network-vif-plugged-9e97257c-885b-434b-97cd-fe0f3ee85a43 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:49:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5ad30821-0ee2-4962-bab5-f77ca520f5f1 req-b778f365-f1ed-4206-97d7-05ac81604ab4 service nova] Acquiring lock "e9be81ce-9ccc-4557-9763-33984b2c6573-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5ad30821-0ee2-4962-bab5-f77ca520f5f1 req-b778f365-f1ed-4206-97d7-05ac81604ab4 service nova] Lock "e9be81ce-9ccc-4557-9763-33984b2c6573-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5ad30821-0ee2-4962-bab5-f77ca520f5f1 req-b778f365-f1ed-4206-97d7-05ac81604ab4 service nova] Lock "e9be81ce-9ccc-4557-9763-33984b2c6573-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:41 user nova-compute[71498]: DEBUG nova.compute.manager [req-5ad30821-0ee2-4962-bab5-f77ca520f5f1 req-b778f365-f1ed-4206-97d7-05ac81604ab4 service nova] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] No waiting events found dispatching network-vif-plugged-9e97257c-885b-434b-97cd-fe0f3ee85a43 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:49:41 user nova-compute[71498]: WARNING nova.compute.manager [req-5ad30821-0ee2-4962-bab5-f77ca520f5f1 req-b778f365-f1ed-4206-97d7-05ac81604ab4 service nova] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Received unexpected event network-vif-plugged-9e97257c-885b-434b-97cd-fe0f3ee85a43 for instance with vm_state building and task_state spawning.
Apr 14 01:49:41 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:49:41 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436981.187615, e9be81ce-9ccc-4557-9763-33984b2c6573 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:49:41 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] VM Started (Lifecycle Event)
Apr 14 01:49:41 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:49:41 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:49:41 user nova-compute[71498]: INFO nova.compute.manager [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Took 6.92 seconds to spawn the instance on the hypervisor.
Apr 14 01:49:41 user nova-compute[71498]: DEBUG nova.compute.manager [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:49:41 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:49:41 user nova-compute[71498]: INFO nova.compute.manager [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Took 19.80 seconds to build instance.
Apr 14 01:49:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-57b08cf2-1d43-4b6f-b985-b3ec0daefa66 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e9be81ce-9ccc-4557-9763-33984b2c6573" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.923s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:42 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:49:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:43 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681436968.425595, da60f4f1-2474-453f-8f84-c95daf02431a => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:49:43 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] VM Stopped (Lifecycle Event)
Apr 14 01:49:43 user nova-compute[71498]: DEBUG nova.compute.manager [None req-b44fb118-d1f7-400f-aaac-22b6fe6cdd8c None None] [instance: da60f4f1-2474-453f-8f84-c95daf02431a] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:49:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:52 user nova-compute[71498]: INFO nova.compute.manager [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Rescuing
Apr 14 01:49:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "refresh_cache-a19a1c08-5454-481b-bb5a-70c39ead9afc" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:49:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquired lock "refresh_cache-a19a1c08-5454-481b-bb5a-70c39ead9afc" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:49:52 user nova-compute[71498]: DEBUG nova.network.neutron [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:49:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:53 user nova-compute[71498]: DEBUG nova.network.neutron [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Updating instance_info_cache with network_info: [{"id": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "address": "fa:16:3e:1f:54:6c", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b00fd21-ee", "ovs_interfaceid": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:49:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Releasing lock "refresh_cache-a19a1c08-5454-481b-bb5a-70c39ead9afc" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:49:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:53 user nova-compute[71498]: DEBUG nova.compute.manager [req-b6f58f5d-e03c-4258-8290-285752f16bf3 req-37fc53c8-fcdf-469a-bf3b-d806031d678f service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Received event network-vif-unplugged-2b00fd21-ee22-48c1-beb5-66e60de9876a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:49:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b6f58f5d-e03c-4258-8290-285752f16bf3 req-37fc53c8-fcdf-469a-bf3b-d806031d678f service nova] Acquiring lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b6f58f5d-e03c-4258-8290-285752f16bf3 req-37fc53c8-fcdf-469a-bf3b-d806031d678f service nova] Lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b6f58f5d-e03c-4258-8290-285752f16bf3 req-37fc53c8-fcdf-469a-bf3b-d806031d678f service nova] Lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:53 user nova-compute[71498]: DEBUG nova.compute.manager [req-b6f58f5d-e03c-4258-8290-285752f16bf3 req-37fc53c8-fcdf-469a-bf3b-d806031d678f service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] No waiting events found dispatching network-vif-unplugged-2b00fd21-ee22-48c1-beb5-66e60de9876a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:49:53 user nova-compute[71498]: WARNING nova.compute.manager [req-b6f58f5d-e03c-4258-8290-285752f16bf3 req-37fc53c8-fcdf-469a-bf3b-d806031d678f service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Received unexpected event network-vif-unplugged-2b00fd21-ee22-48c1-beb5-66e60de9876a for instance with vm_state active and task_state rescuing.
Apr 14 01:49:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:53 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Instance destroyed successfully.
Apr 14 01:49:53 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Attempting rescue
Apr 14 01:49:53 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71498) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 01:49:53 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Instance directory exists: not creating {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 01:49:53 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Creating image(s)
Apr 14 01:49:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "/opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "/opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "/opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:53 user nova-compute[71498]: DEBUG nova.objects.instance [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'trusted_certs' on Instance uuid a19a1c08-5454-481b-bb5a-70c39ead9afc {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:49:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.151s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk.rescue {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk.rescue" returned: 0 in 0.050s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:53 user nova-compute[71498]: DEBUG nova.objects.instance [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'migration_context' on Instance uuid a19a1c08-5454-481b-bb5a-70c39ead9afc {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:49:53 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 01:49:53 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Start _get_guest_xml network_info=[{"id": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "address": "fa:16:3e:1f:54:6c", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "vif_mac": "fa:16:3e:1f:54:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b00fd21-ee", "ovs_interfaceid": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:49:53 user nova-compute[71498]: DEBUG nova.objects.instance [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'resources' on Instance uuid a19a1c08-5454-481b-bb5a-70c39ead9afc {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:49:54 user nova-compute[71498]: DEBUG nova.objects.instance [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'numa_topology' on Instance uuid a19a1c08-5454-481b-bb5a-70c39ead9afc {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:49:54 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:49:54 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:49:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:49:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:49:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:49:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:49:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:49:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:49:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:49:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:49:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:49:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:49:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:49:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:49:54 user nova-compute[71498]: DEBUG nova.objects.instance [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'vcpu_model' on Instance uuid a19a1c08-5454-481b-bb5a-70c39ead9afc {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:49:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-611036692',display_name='tempest-ServerRescueNegativeTestJSON-server-611036692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-611036692',id=18,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:45:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d3de04739384e3ea3a475fee28be3c0',ramdisk_id='',reservation_id='r-nnoryzj4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1453869246',owner_user_name='tempest-ServerRescueNegativeTestJSON-1453869246-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:45:17Z,user_data=None,user_id='eeb5f26be86e43b3b61fff98fdc83cf3',uuid=a19a1c08-5454-481b-bb5a-70c39ead9afc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "address": "fa:16:3e:1f:54:6c", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "vif_mac": "fa:16:3e:1f:54:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b00fd21-ee", "ovs_interfaceid": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:49:54 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Converting VIF {"id": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "address": "fa:16:3e:1f:54:6c", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "vif_mac": "fa:16:3e:1f:54:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b00fd21-ee", "ovs_interfaceid": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:49:54 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:54:6c,bridge_name='br-int',has_traffic_filtering=True,id=2b00fd21-ee22-48c1-beb5-66e60de9876a,network=Network(2c4fba9e-0217-4e37-af1c-065b3f0cd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b00fd21-ee') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:49:54 user nova-compute[71498]: DEBUG nova.objects.instance [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'pci_devices' on Instance uuid a19a1c08-5454-481b-bb5a-70c39ead9afc {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:49:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:49:54 user nova-compute[71498]:   <uuid>a19a1c08-5454-481b-bb5a-70c39ead9afc</uuid>
Apr 14 01:49:54 user nova-compute[71498]:   <name>instance-00000012</name>
Apr 14 01:49:54 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:49:54 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:49:54 user nova-compute[71498]:   <metadata>
Apr 14 01:49:54 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:49:54 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:49:54 user nova-compute[71498]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-611036692</nova:name>
Apr 14 01:49:54 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:49:54</nova:creationTime>
Apr 14 01:49:54 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:49:54 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:49:54 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:49:54 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:49:54 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:49:54 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:49:54 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:49:54 user nova-compute[71498]:       <nova:owner>
Apr 14 01:49:54 user nova-compute[71498]:         <nova:user uuid="eeb5f26be86e43b3b61fff98fdc83cf3">tempest-ServerRescueNegativeTestJSON-1453869246-project-member</nova:user>
Apr 14 01:49:54 user nova-compute[71498]:         <nova:project uuid="6d3de04739384e3ea3a475fee28be3c0">tempest-ServerRescueNegativeTestJSON-1453869246</nova:project>
Apr 14 01:49:54 user nova-compute[71498]:       </nova:owner>
Apr 14 01:49:54 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:49:54 user nova-compute[71498]:       <nova:ports>
Apr 14 01:49:54 user nova-compute[71498]:         <nova:port uuid="2b00fd21-ee22-48c1-beb5-66e60de9876a">
Apr 14 01:49:54 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 01:49:54 user nova-compute[71498]:         </nova:port>
Apr 14 01:49:54 user nova-compute[71498]:       </nova:ports>
Apr 14 01:49:54 user nova-compute[71498]:     </nova:instance>
Apr 14 01:49:54 user nova-compute[71498]:   </metadata>
Apr 14 01:49:54 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:49:54 user nova-compute[71498]:     <system>
Apr 14 01:49:54 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:49:54 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:49:54 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:49:54 user nova-compute[71498]:       <entry name="serial">a19a1c08-5454-481b-bb5a-70c39ead9afc</entry>
Apr 14 01:49:54 user nova-compute[71498]:       <entry name="uuid">a19a1c08-5454-481b-bb5a-70c39ead9afc</entry>
Apr 14 01:49:54 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:49:54 user nova-compute[71498]:     </system>
Apr 14 01:49:54 user nova-compute[71498]:   </sysinfo>
Apr 14 01:49:54 user nova-compute[71498]:   <os>
Apr 14 01:49:54 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:49:54 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:49:54 user nova-compute[71498]:   </os>
Apr 14 01:49:54 user nova-compute[71498]:   <features>
Apr 14 01:49:54 user nova-compute[71498]:     <acpi/>
Apr 14 01:49:54 user nova-compute[71498]:     <apic/>
Apr 14 01:49:54 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:49:54 user nova-compute[71498]:   </features>
Apr 14 01:49:54 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:49:54 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:49:54 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:49:54 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:49:54 user nova-compute[71498]:   </clock>
Apr 14 01:49:54 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:49:54 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:49:54 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:49:54 user nova-compute[71498]:   </cpu>
Apr 14 01:49:54 user nova-compute[71498]:   <devices>
Apr 14 01:49:54 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:49:54 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:49:54 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk.rescue"/>
Apr 14 01:49:54 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:49:54 user nova-compute[71498]:     </disk>
Apr 14 01:49:54 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:49:54 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:49:54 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk"/>
Apr 14 01:49:54 user nova-compute[71498]:       <target dev="vdb" bus="virtio"/>
Apr 14 01:49:54 user nova-compute[71498]:     </disk>
Apr 14 01:49:54 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:49:54 user nova-compute[71498]:       <mac address="fa:16:3e:1f:54:6c"/>
Apr 14 01:49:54 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:49:54 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:49:54 user nova-compute[71498]:       <target dev="tap2b00fd21-ee"/>
Apr 14 01:49:54 user nova-compute[71498]:     </interface>
Apr 14 01:49:54 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:49:54 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/console.log" append="off"/>
Apr 14 01:49:54 user nova-compute[71498]:     </serial>
Apr 14 01:49:54 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:49:54 user nova-compute[71498]:     <video>
Apr 14 01:49:54 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:49:54 user nova-compute[71498]:     </video>
Apr 14 01:49:54 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:49:54 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:49:54 user nova-compute[71498]:     </rng>
Apr 14 01:49:54 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:49:54 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:49:54 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:49:54 user nova-compute[71498]:     </memballoon>
Apr 14 01:49:54 user nova-compute[71498]:   </devices>
Apr 14 01:49:54 user nova-compute[71498]: </domain>
Apr 14 01:49:54 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:49:54 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Instance destroyed successfully.
Apr 14 01:49:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:49:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:49:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] No VIF found with MAC fa:16:3e:1f:54:6c, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:49:55 user nova-compute[71498]: DEBUG nova.compute.manager [req-18bdef2a-5a6c-46d6-950c-35ecf4285636 req-716c4f66-5e82-40d5-9425-ae2401acc669 service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Received event network-vif-plugged-2b00fd21-ee22-48c1-beb5-66e60de9876a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:49:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-18bdef2a-5a6c-46d6-950c-35ecf4285636 req-716c4f66-5e82-40d5-9425-ae2401acc669 service nova] Acquiring lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-18bdef2a-5a6c-46d6-950c-35ecf4285636 req-716c4f66-5e82-40d5-9425-ae2401acc669 service nova] Lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-18bdef2a-5a6c-46d6-950c-35ecf4285636 req-716c4f66-5e82-40d5-9425-ae2401acc669 service nova] Lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:55 user nova-compute[71498]: DEBUG nova.compute.manager [req-18bdef2a-5a6c-46d6-950c-35ecf4285636 req-716c4f66-5e82-40d5-9425-ae2401acc669 service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] No waiting events found dispatching network-vif-plugged-2b00fd21-ee22-48c1-beb5-66e60de9876a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:49:55 user nova-compute[71498]: WARNING nova.compute.manager [req-18bdef2a-5a6c-46d6-950c-35ecf4285636 req-716c4f66-5e82-40d5-9425-ae2401acc669 service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Received unexpected event network-vif-plugged-2b00fd21-ee22-48c1-beb5-66e60de9876a for instance with vm_state active and task_state rescuing.
Apr 14 01:49:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "74311da6-d6b8-4aea-b6ce-97db8da53800" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:56 user nova-compute[71498]: DEBUG nova.objects.instance [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lazy-loading 'flavor' on Instance uuid 74311da6-d6b8-4aea-b6ce-97db8da53800 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:49:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "74311da6-d6b8-4aea-b6ce-97db8da53800" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:56 user nova-compute[71498]: INFO nova.compute.manager [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Attaching volume 4044000e-5f2c-4303-b69d-07287f59fbcb to /dev/vdb
Apr 14 01:49:56 user nova-compute[71498]: DEBUG os_brick.utils [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:49:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:56 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c7f863-532c-45e5-adee-384af8e5759a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:56 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[69194ddb-00d0-4983-9db5-3d5eddf1dcc2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:49:56 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d1a75f-c862-49e9-ab56-78a26e51784c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:56 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[95739a95-4056-4ab9-bdbe-b40131870a4c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:49:56 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:49:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:49:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:49:56 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:49:56 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[251175cc-08b9-4eaf-b50d-10b55081db7a]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:49:56 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:49:56 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:49:56 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:49:56 user nova-compute[71498]: DEBUG os_brick.utils [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:49:56 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Updating existing volume attachment record: 967263ef-a6dc-4107-a299-c43bda15b494 {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:49:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:57 user nova-compute[71498]: DEBUG nova.compute.manager [req-24db834a-449e-4f34-8d56-dd826d63b4ee req-e0bef5f4-051f-4385-901a-8ba6a518aa32 service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Received event network-vif-plugged-2b00fd21-ee22-48c1-beb5-66e60de9876a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:49:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-24db834a-449e-4f34-8d56-dd826d63b4ee req-e0bef5f4-051f-4385-901a-8ba6a518aa32 service nova] Acquiring lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-24db834a-449e-4f34-8d56-dd826d63b4ee req-e0bef5f4-051f-4385-901a-8ba6a518aa32 service nova] Lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-24db834a-449e-4f34-8d56-dd826d63b4ee req-e0bef5f4-051f-4385-901a-8ba6a518aa32 service nova] Lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:57 user nova-compute[71498]: DEBUG nova.compute.manager [req-24db834a-449e-4f34-8d56-dd826d63b4ee req-e0bef5f4-051f-4385-901a-8ba6a518aa32 service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] No waiting events found dispatching network-vif-plugged-2b00fd21-ee22-48c1-beb5-66e60de9876a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:49:57 user nova-compute[71498]: WARNING nova.compute.manager [req-24db834a-449e-4f34-8d56-dd826d63b4ee req-e0bef5f4-051f-4385-901a-8ba6a518aa32 service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Received unexpected event network-vif-plugged-2b00fd21-ee22-48c1-beb5-66e60de9876a for instance with vm_state active and task_state rescuing.
Apr 14 01:49:57 user nova-compute[71498]: DEBUG nova.compute.manager [req-24db834a-449e-4f34-8d56-dd826d63b4ee req-e0bef5f4-051f-4385-901a-8ba6a518aa32 service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Received event network-vif-plugged-2b00fd21-ee22-48c1-beb5-66e60de9876a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:49:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-24db834a-449e-4f34-8d56-dd826d63b4ee req-e0bef5f4-051f-4385-901a-8ba6a518aa32 service nova] Acquiring lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:49:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-24db834a-449e-4f34-8d56-dd826d63b4ee req-e0bef5f4-051f-4385-901a-8ba6a518aa32 service nova] Lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:49:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-24db834a-449e-4f34-8d56-dd826d63b4ee req-e0bef5f4-051f-4385-901a-8ba6a518aa32 service nova] Lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:49:57 user nova-compute[71498]: DEBUG nova.compute.manager [req-24db834a-449e-4f34-8d56-dd826d63b4ee req-e0bef5f4-051f-4385-901a-8ba6a518aa32 service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] No waiting events found dispatching network-vif-plugged-2b00fd21-ee22-48c1-beb5-66e60de9876a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:49:57 user nova-compute[71498]: WARNING nova.compute.manager [req-24db834a-449e-4f34-8d56-dd826d63b4ee req-e0bef5f4-051f-4385-901a-8ba6a518aa32 service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Received unexpected event network-vif-plugged-2b00fd21-ee22-48c1-beb5-66e60de9876a for instance with vm_state active and task_state rescuing.
Apr 14 01:49:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:49:57 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Removed pending event for a19a1c08-5454-481b-bb5a-70c39ead9afc due to event {{(pid=71498) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 01:49:57 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436997.9109051, a19a1c08-5454-481b-bb5a-70c39ead9afc => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:49:57 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] VM Resumed (Lifecycle Event)
Apr 14 01:49:57 user nova-compute[71498]: DEBUG nova.compute.manager [None req-830735cf-8aaa-4b03-a226-b03394e4c9d3 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:49:57 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:49:57 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:49:57 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 01:49:57 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681436997.9130557, a19a1c08-5454-481b-bb5a-70c39ead9afc => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:49:57 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] VM Started (Lifecycle Event)
Apr 14 01:49:57 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:49:57 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BOyRmVdS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:50:01 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:50:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:50:01 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:50:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:50:01 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:50:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7162a5af-6d4c-4e9c-8e9d-8ea0ba0f5f8d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:50:01 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[049c4d75-bf8d-457d-860d-5379480790c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb] added
Apr 14 01:50:01 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d2ccc8-b78e-479f-801c-2c2d60dcce1c]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a08bd4-7ef6-495f-9aff-86ba58069023]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BOyRmVdS {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BOyRmVdS" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea363f7-2416-4fe9-b9fc-c4d955f4df54]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BOyRmVdS'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[680ee917-1965-410b-89d2-43dec7827b54]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e96f21c-3ea0-4c4d-ba81-58481b26ccfd]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:50:01 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:50:01 user nova-compute[71498]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)
Apr 14 01:50:01 user nova-compute[71498]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e (non-flash)
Apr 14 01:50:01 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:50:01 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:50:01 user nova-compute[71498]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)
Apr 14 01:50:01 user nova-compute[71498]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e (non-flash)
Apr 14 01:50:01 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8b92aa-28a6-439d-a106-458e5a5a9cc4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb, portal: 172.16.0.220,3260]
Apr 14 01:50:01 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb, portal: 172.16.0.220,3260] successful.
Apr 14 01:50:01 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7498abff-9066-4ca0-8593-43352929b956]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[270206dd-2c3b-446c-bd34-1e84632edb9c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:50:01 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:50:01 user nova-compute[71498]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)
Apr 14 01:50:01 user nova-compute[71498]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e (non-flash)
Apr 14 01:50:01 user nova-compute[71498]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb (non-flash)
Apr 14 01:50:01 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:50:01 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:50:01 user nova-compute[71498]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)
Apr 14 01:50:01 user nova-compute[71498]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e (non-flash)
Apr 14 01:50:01 user nova-compute[71498]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb (non-flash)
Apr 14 01:50:01 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4145e72-b768-4872-8841-0a6759559b2f]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:50:01 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BOyRmVdS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:50:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:50:02 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:50:02 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23134393432393232', 'path': '/dev/sde'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:50:02 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134393432393232', 'path': '/dev/sde'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:50:02 user nova-compute[71498]: DEBUG nova.objects.instance [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lazy-loading 'flavor' on Instance uuid 74311da6-d6b8-4aea-b6ce-97db8da53800 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:50:02 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 01:50:02 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:50:02 user nova-compute[71498]:   <source dev="/dev/sde"/>
Apr 14 01:50:02 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:50:02 user nova-compute[71498]:   <serial>4044000e-5f2c-4303-b69d-07287f59fbcb</serial>
Apr 14 01:50:02 user nova-compute[71498]: </disk>
Apr 14 01:50:02 user nova-compute[71498]:  {{(pid=71498) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 01:50:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:50:03 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:50:03 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:50:03 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] No VIF found with MAC fa:16:3e:c7:d7:5e, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:50:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-588a3e7c-c239-4ffd-8689-4af9adf06195 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.994s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:50:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "74311da6-d6b8-4aea-b6ce-97db8da53800" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:50:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:50:04 user nova-compute[71498]: INFO nova.compute.manager [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Detaching volume 4044000e-5f2c-4303-b69d-07287f59fbcb
Apr 14 01:50:04 user nova-compute[71498]: INFO nova.virt.block_device [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Attempting to driver detach volume 4044000e-5f2c-4303-b69d-07287f59fbcb from mountpoint /dev/vdb
Apr 14 01:50:04 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Attempting to detach device vdb from instance 74311da6-d6b8-4aea-b6ce-97db8da53800 from the persistent domain config. {{(pid=71498) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 01:50:04 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 01:50:04 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:50:04 user nova-compute[71498]:   <source dev="/dev/sde"/>
Apr 14 01:50:04 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:50:04 user nova-compute[71498]:   <serial>4044000e-5f2c-4303-b69d-07287f59fbcb</serial>
Apr 14 01:50:04 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 01:50:04 user nova-compute[71498]: </disk>
Apr 14 01:50:04 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:50:04 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Successfully detached device vdb from instance 74311da6-d6b8-4aea-b6ce-97db8da53800 from the persistent domain config.
Apr 14 01:50:04 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 74311da6-d6b8-4aea-b6ce-97db8da53800 from the live domain config. {{(pid=71498) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 01:50:04 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 01:50:04 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:50:04 user nova-compute[71498]:   <source dev="/dev/sde"/>
Apr 14 01:50:04 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:50:04 user nova-compute[71498]:   <serial>4044000e-5f2c-4303-b69d-07287f59fbcb</serial>
Apr 14 01:50:04 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 01:50:04 user nova-compute[71498]: </disk>
Apr 14 01:50:04 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Received event <DeviceRemovedEvent: 1681437005.29318, 74311da6-d6b8-4aea-b6ce-97db8da53800 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71498) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 74311da6-d6b8-4aea-b6ce-97db8da53800 {{(pid=71498) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 01:50:05 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Successfully detached device vdb from instance 74311da6-d6b8-4aea-b6ce-97db8da53800 from the live domain config.
Apr 14 01:50:05 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BOyRmVdS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:50:05 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:50:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f10b2ba-b3c0-4f1e-82c9-69346d68cccf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:50:05 user nova-compute[71498]: No targets found.
Apr 14 01:50:05 user nova-compute[71498]: iSNS:
Apr 14 01:50:05 user nova-compute[71498]: No targets found.
Apr 14 01:50:05 user nova-compute[71498]: STATIC:
Apr 14 01:50:05 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb
Apr 14 01:50:05 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:50:05 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:50:05 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a
Apr 14 01:50:05 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:50:05 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:50:05 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e
Apr 14 01:50:05 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:50:05 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:50:05 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22
Apr 14 01:50:05 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:50:05 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:50:05 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e
Apr 14 01:50:05 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:50:05 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:50:05 user nova-compute[71498]: FIRMWARE:
Apr 14 01:50:05 user nova-compute[71498]: No targets found.
Apr 14 01:50:05 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:50:05 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:50:05 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[05490b47-34eb-456e-a788-efc6d9018f9e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b19cf16-e9df-41cc-b5bf-c303d0f287e1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:50:05 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:50:05 user nova-compute[71498]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)
Apr 14 01:50:05 user nova-compute[71498]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e (non-flash)
Apr 14 01:50:05 user nova-compute[71498]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb (non-flash)
Apr 14 01:50:05 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:50:05 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:50:05 user nova-compute[71498]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)
Apr 14 01:50:05 user nova-compute[71498]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e (non-flash)
Apr 14 01:50:05 user nova-compute[71498]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb (non-flash)
Apr 14 01:50:05 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51f42aed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb'): ({'sde'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Removing single pathed devices sde {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[413e4789-bfb3-4406-8252-eac359aca041]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a950129c-c955-42d9-97f0-70bec7c7f398]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Flushing IO for device /dev/sde {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[189743e1-ad68-4c78-8695-a104c5804aa3]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7872ca1-49b1-42e8-ad0c-650db9dd557f]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] SCSI volumes sde have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[01057fc2-c8bd-4b62-b0af-6c08f04a6469]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6daf27d-f940-4bea-8015-3cd12e38f8f0]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb, portal: 172.16.0.220,3260]
Apr 14 01:50:05 user nova-compute[71498]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb, portal: 172.16.0.220,3260] successful.
Apr 14 01:50:05 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4044000e-5f2c-4303-b69d-07287f59fbcb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1641b12f-aea9-4024-af84-b94f096b1246]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] <== disconnect_volume: return (330ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:50:05 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:50:06 user nova-compute[71498]: DEBUG nova.objects.instance [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lazy-loading 'flavor' on Instance uuid 74311da6-d6b8-4aea-b6ce-97db8da53800 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:50:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3996b91f-e623-42b9-bd74-d783d898af00 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.804s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:50:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:50:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:50:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:50:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:50:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:50:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:50:19 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:50:20 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:50:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:50:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:50:26 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:50:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:50:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:50:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:50:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:50:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "85b399dc-62df-480d-8561-5d9d1ab75c52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:50:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:50:32 user nova-compute[71498]: DEBUG nova.compute.manager [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 01:50:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:50:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:50:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:50:32 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:50:32 user nova-compute[71498]: INFO nova.compute.claims [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Claim successful on node user
Apr 14 01:50:33 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:50:33 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:50:33 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:50:33 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:50:33 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.698s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:50:33 user nova-compute[71498]: DEBUG nova.compute.manager [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 01:50:33 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.228s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:50:33 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:50:33 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 01:50:33 user nova-compute[71498]: DEBUG nova.compute.manager [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 01:50:33 user nova-compute[71498]: DEBUG nova.network.neutron [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:50:33 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 01:50:33 user nova-compute[71498]: DEBUG nova.compute.manager [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 01:50:33 user nova-compute[71498]: DEBUG nova.policy [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba0894753a074f99ab226fde0565dd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f650e04d2c947498b9e7a8d002862ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:50:33 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:50:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:33 user nova-compute[71498]: DEBUG nova.compute.manager [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 01:50:33 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:50:33 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Creating image(s)
Apr 14 01:50:33 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "/opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:50:33 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "/opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:50:33 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "/opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:50:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.149s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:50:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:50:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.167s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk 1073741824" returned: 0 in 0.064s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:50:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.168s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:34 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 01:50:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:34 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:50:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:34 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Cannot resize image /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 01:50:34 user nova-compute[71498]: DEBUG nova.objects.instance [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'migration_context' on Instance uuid 85b399dc-62df-480d-8561-5d9d1ab75c52 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:50:34 user nova-compute[71498]: DEBUG nova.network.neutron [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Successfully created port: e31ffaf4-6b2b-4099-88b5-683bc51ccfdf {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:50:34 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 01:50:34 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Ensure instance console log exists: /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:50:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:50:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:50:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:50:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:35 user nova-compute[71498]: DEBUG nova.network.neutron [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Successfully updated port: e31ffaf4-6b2b-4099-88b5-683bc51ccfdf {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:50:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "refresh_cache-85b399dc-62df-480d-8561-5d9d1ab75c52" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:50:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquired lock "refresh_cache-85b399dc-62df-480d-8561-5d9d1ab75c52" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:50:35 user nova-compute[71498]: DEBUG nova.network.neutron [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:50:35 user nova-compute[71498]: DEBUG nova.compute.manager [req-572d904f-f9e5-4294-babf-6977edb4d0ae req-3ce5de93-2b34-4b9e-93ff-81dbdf8a7775 service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Received event network-changed-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:50:35 user nova-compute[71498]: DEBUG nova.compute.manager [req-572d904f-f9e5-4294-babf-6977edb4d0ae req-3ce5de93-2b34-4b9e-93ff-81dbdf8a7775 service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Refreshing instance network info cache due to event network-changed-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:50:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-572d904f-f9e5-4294-babf-6977edb4d0ae req-3ce5de93-2b34-4b9e-93ff-81dbdf8a7775 service nova] Acquiring lock "refresh_cache-85b399dc-62df-480d-8561-5d9d1ab75c52" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:50:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:35 user nova-compute[71498]: DEBUG nova.network.neutron [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:50:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG nova.network.neutron [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Updating instance_info_cache with network_info: [{"id": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "address": "fa:16:3e:c2:1d:7f", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31ffaf4-6b", "ovs_interfaceid": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Releasing lock "refresh_cache-85b399dc-62df-480d-8561-5d9d1ab75c52" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG nova.compute.manager [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Instance network_info: |[{"id": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "address": "fa:16:3e:c2:1d:7f", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31ffaf4-6b", "ovs_interfaceid": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-572d904f-f9e5-4294-babf-6977edb4d0ae req-3ce5de93-2b34-4b9e-93ff-81dbdf8a7775 service nova] Acquired lock "refresh_cache-85b399dc-62df-480d-8561-5d9d1ab75c52" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG nova.network.neutron [req-572d904f-f9e5-4294-babf-6977edb4d0ae req-3ce5de93-2b34-4b9e-93ff-81dbdf8a7775 service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Refreshing network info cache for port e31ffaf4-6b2b-4099-88b5-683bc51ccfdf {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Start _get_guest_xml network_info=[{"id": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "address": "fa:16:3e:c2:1d:7f", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31ffaf4-6b", "ovs_interfaceid": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:50:36 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:50:36 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:50:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:50:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-325708357',display_name='tempest-AttachVolumeTestJSON-server-325708357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-325708357',id=27,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvk+JYMt+HZ39UKnyK9XjRAYXFTfLUFV2C7qQoN4BD8jI9jpYJTV8jA9OgD5QAxdNshSqirCRpZ3xA98RiAsOOX3u/3A0BiHL6YVfgoocjrtHZ6NQNKyL6LjNBDUv8OmA==',key_name='tempest-keypair-2007571811',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f650e04d2c947498b9e7a8d002862ad',ramdisk_id='',reservation_id='r-d003i0bm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-296004410',owner_user_name='tempest-AttachVolumeTestJSON-296004410-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:50:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba0894753a074f99ab226fde0565dd28',uuid=85b399dc-62df-480d-8561-5d9d1ab75c52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "address": "fa:16:3e:c2:1d:7f", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31ffaf4-6b", "ovs_interfaceid": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Converting VIF {"id": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "address": "fa:16:3e:c2:1d:7f", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31ffaf4-6b", "ovs_interfaceid": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1d:7f,bridge_name='br-int',has_traffic_filtering=True,id=e31ffaf4-6b2b-4099-88b5-683bc51ccfdf,network=Network(fe9d57b9-96e8-424e-8dc9-0c95f1aff03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape31ffaf4-6b') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG nova.objects.instance [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'pci_devices' on Instance uuid 85b399dc-62df-480d-8561-5d9d1ab75c52 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:50:36 user nova-compute[71498]:   <uuid>85b399dc-62df-480d-8561-5d9d1ab75c52</uuid>
Apr 14 01:50:36 user nova-compute[71498]:   <name>instance-0000001b</name>
Apr 14 01:50:36 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:50:36 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:50:36 user nova-compute[71498]:   <metadata>
Apr 14 01:50:36 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:50:36 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:50:36 user nova-compute[71498]:       <nova:name>tempest-AttachVolumeTestJSON-server-325708357</nova:name>
Apr 14 01:50:36 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:50:36</nova:creationTime>
Apr 14 01:50:36 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:50:36 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:50:36 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:50:36 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:50:36 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:50:36 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:50:36 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:50:36 user nova-compute[71498]:       <nova:owner>
Apr 14 01:50:36 user nova-compute[71498]:         <nova:user uuid="ba0894753a074f99ab226fde0565dd28">tempest-AttachVolumeTestJSON-296004410-project-member</nova:user>
Apr 14 01:50:36 user nova-compute[71498]:         <nova:project uuid="0f650e04d2c947498b9e7a8d002862ad">tempest-AttachVolumeTestJSON-296004410</nova:project>
Apr 14 01:50:36 user nova-compute[71498]:       </nova:owner>
Apr 14 01:50:36 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:50:36 user nova-compute[71498]:       <nova:ports>
Apr 14 01:50:36 user nova-compute[71498]:         <nova:port uuid="e31ffaf4-6b2b-4099-88b5-683bc51ccfdf">
Apr 14 01:50:36 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 14 01:50:36 user nova-compute[71498]:         </nova:port>
Apr 14 01:50:36 user nova-compute[71498]:       </nova:ports>
Apr 14 01:50:36 user nova-compute[71498]:     </nova:instance>
Apr 14 01:50:36 user nova-compute[71498]:   </metadata>
Apr 14 01:50:36 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:50:36 user nova-compute[71498]:     <system>
Apr 14 01:50:36 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:50:36 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:50:36 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:50:36 user nova-compute[71498]:       <entry name="serial">85b399dc-62df-480d-8561-5d9d1ab75c52</entry>
Apr 14 01:50:36 user nova-compute[71498]:       <entry name="uuid">85b399dc-62df-480d-8561-5d9d1ab75c52</entry>
Apr 14 01:50:36 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:50:36 user nova-compute[71498]:     </system>
Apr 14 01:50:36 user nova-compute[71498]:   </sysinfo>
Apr 14 01:50:36 user nova-compute[71498]:   <os>
Apr 14 01:50:36 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:50:36 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:50:36 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:50:36 user nova-compute[71498]:   </os>
Apr 14 01:50:36 user nova-compute[71498]:   <features>
Apr 14 01:50:36 user nova-compute[71498]:     <acpi/>
Apr 14 01:50:36 user nova-compute[71498]:     <apic/>
Apr 14 01:50:36 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:50:36 user nova-compute[71498]:   </features>
Apr 14 01:50:36 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:50:36 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:50:36 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:50:36 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:50:36 user nova-compute[71498]:   </clock>
Apr 14 01:50:36 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:50:36 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:50:36 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:50:36 user nova-compute[71498]:   </cpu>
Apr 14 01:50:36 user nova-compute[71498]:   <devices>
Apr 14 01:50:36 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:50:36 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:50:36 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk"/>
Apr 14 01:50:36 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:50:36 user nova-compute[71498]:     </disk>
Apr 14 01:50:36 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:50:36 user nova-compute[71498]:       <mac address="fa:16:3e:c2:1d:7f"/>
Apr 14 01:50:36 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:50:36 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:50:36 user nova-compute[71498]:       <target dev="tape31ffaf4-6b"/>
Apr 14 01:50:36 user nova-compute[71498]:     </interface>
Apr 14 01:50:36 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:50:36 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/console.log" append="off"/>
Apr 14 01:50:36 user nova-compute[71498]:     </serial>
Apr 14 01:50:36 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:50:36 user nova-compute[71498]:     <video>
Apr 14 01:50:36 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:50:36 user nova-compute[71498]:     </video>
Apr 14 01:50:36 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:50:36 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:50:36 user nova-compute[71498]:     </rng>
Apr 14 01:50:36 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:50:36 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:50:36 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:50:36 user nova-compute[71498]:     </memballoon>
Apr 14 01:50:36 user nova-compute[71498]:   </devices>
Apr 14 01:50:36 user nova-compute[71498]: </domain>
Apr 14 01:50:36 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:50:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-325708357',display_name='tempest-AttachVolumeTestJSON-server-325708357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-325708357',id=27,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvk+JYMt+HZ39UKnyK9XjRAYXFTfLUFV2C7qQoN4BD8jI9jpYJTV8jA9OgD5QAxdNshSqirCRpZ3xA98RiAsOOX3u/3A0BiHL6YVfgoocjrtHZ6NQNKyL6LjNBDUv8OmA==',key_name='tempest-keypair-2007571811',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f650e04d2c947498b9e7a8d002862ad',ramdisk_id='',reservation_id='r-d003i0bm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-296004410',owner_user_name='tempest-AttachVolumeTestJSON-296004410-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:50:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba0894753a074f99ab226fde0565dd28',uuid=85b399dc-62df-480d-8561-5d9d1ab75c52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "address": "fa:16:3e:c2:1d:7f", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31ffaf4-6b", "ovs_interfaceid": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Converting VIF {"id": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "address": "fa:16:3e:c2:1d:7f", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31ffaf4-6b", "ovs_interfaceid": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1d:7f,bridge_name='br-int',has_traffic_filtering=True,id=e31ffaf4-6b2b-4099-88b5-683bc51ccfdf,network=Network(fe9d57b9-96e8-424e-8dc9-0c95f1aff03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape31ffaf4-6b') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG os_vif [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1d:7f,bridge_name='br-int',has_traffic_filtering=True,id=e31ffaf4-6b2b-4099-88b5-683bc51ccfdf,network=Network(fe9d57b9-96e8-424e-8dc9-0c95f1aff03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape31ffaf4-6b') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape31ffaf4-6b, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape31ffaf4-6b, col_values=(('external_ids', {'iface-id': 'e31ffaf4-6b2b-4099-88b5-683bc51ccfdf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:1d:7f', 'vm-uuid': '85b399dc-62df-480d-8561-5d9d1ab75c52'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:50:36 user nova-compute[71498]: INFO os_vif [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1d:7f,bridge_name='br-int',has_traffic_filtering=True,id=e31ffaf4-6b2b-4099-88b5-683bc51ccfdf,network=Network(fe9d57b9-96e8-424e-8dc9-0c95f1aff03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape31ffaf4-6b')
Apr 14 01:50:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] No VIF found with MAC fa:16:3e:c2:1d:7f, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG nova.network.neutron [req-572d904f-f9e5-4294-babf-6977edb4d0ae req-3ce5de93-2b34-4b9e-93ff-81dbdf8a7775 service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Updated VIF entry in instance network info cache for port e31ffaf4-6b2b-4099-88b5-683bc51ccfdf. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG nova.network.neutron [req-572d904f-f9e5-4294-babf-6977edb4d0ae req-3ce5de93-2b34-4b9e-93ff-81dbdf8a7775 service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Updating instance_info_cache with network_info: [{"id": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "address": "fa:16:3e:c2:1d:7f", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31ffaf4-6b", "ovs_interfaceid": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-572d904f-f9e5-4294-babf-6977edb4d0ae req-3ce5de93-2b34-4b9e-93ff-81dbdf8a7775 service nova] Releasing lock "refresh_cache-85b399dc-62df-480d-8561-5d9d1ab75c52" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437039.815564, 85b399dc-62df-480d-8561-5d9d1ab75c52 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:50:40 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] VM Resumed (Lifecycle Event)
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.compute.manager [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-abb188ab-2609-4c6b-a4fd-7828f4d1b511 req-821269f5-fd72-4879-888e-9f7749d43d33 service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Received event network-vif-plugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-abb188ab-2609-4c6b-a4fd-7828f4d1b511 req-821269f5-fd72-4879-888e-9f7749d43d33 service nova] Acquiring lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-abb188ab-2609-4c6b-a4fd-7828f4d1b511 req-821269f5-fd72-4879-888e-9f7749d43d33 service nova] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-abb188ab-2609-4c6b-a4fd-7828f4d1b511 req-821269f5-fd72-4879-888e-9f7749d43d33 service nova] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-abb188ab-2609-4c6b-a4fd-7828f4d1b511 req-821269f5-fd72-4879-888e-9f7749d43d33 service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] No waiting events found dispatching network-vif-plugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:50:40 user nova-compute[71498]: WARNING nova.compute.manager [req-abb188ab-2609-4c6b-a4fd-7828f4d1b511 req-821269f5-fd72-4879-888e-9f7749d43d33 service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Received unexpected event network-vif-plugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf for instance with vm_state building and task_state spawning.
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-121d712a-5db8-4002-8cf6-977f5045135a req-e68c7c17-55a4-43bf-97bb-2163239ccc33 service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Received event network-vif-plugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-121d712a-5db8-4002-8cf6-977f5045135a req-e68c7c17-55a4-43bf-97bb-2163239ccc33 service nova] Acquiring lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-121d712a-5db8-4002-8cf6-977f5045135a req-e68c7c17-55a4-43bf-97bb-2163239ccc33 service nova] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-121d712a-5db8-4002-8cf6-977f5045135a req-e68c7c17-55a4-43bf-97bb-2163239ccc33 service nova] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-121d712a-5db8-4002-8cf6-977f5045135a req-e68c7c17-55a4-43bf-97bb-2163239ccc33 service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] No waiting events found dispatching network-vif-plugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:50:40 user nova-compute[71498]: WARNING nova.compute.manager [req-121d712a-5db8-4002-8cf6-977f5045135a req-e68c7c17-55a4-43bf-97bb-2163239ccc33 service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Received unexpected event network-vif-plugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf for instance with vm_state building and task_state spawning.
Apr 14 01:50:40 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Instance spawned successfully.
Apr 14 01:50:40 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:50:40 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=7779MB free_disk=26.302684783935547GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:50:40 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437039.816146, 85b399dc-62df-480d-8561-5d9d1ab75c52 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:50:40 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] VM Started (Lifecycle Event)
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:50:40 user nova-compute[71498]: INFO nova.compute.manager [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Took 6.37 seconds to spawn the instance on the hypervisor.
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.compute.manager [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:50:40 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance a19a1c08-5454-481b-bb5a-70c39ead9afc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance fa29c144-0ff9-4efb-a574-f521d18f08fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 74311da6-d6b8-4aea-b6ce-97db8da53800 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 1ccf53b5-9199-4812-a635-4f4f22fb5d28 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance ae82789e-1bed-419b-a580-68ff7ed03ef2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance e9be81ce-9ccc-4557-9763-33984b2c6573 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 85b399dc-62df-480d-8561-5d9d1ab75c52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 01:50:40 user nova-compute[71498]: INFO nova.compute.manager [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Took 7.58 seconds to build instance.
Apr 14 01:50:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dcf6b6a5-bbb7-42d4-8fb4-ff90cb9be5a8 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.707s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 01:50:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.641s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:50:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:50:42 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:50:42 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:50:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 01:50:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:50:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-fa29c144-0ff9-4efb-a574-f521d18f08fa" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:50:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-fa29c144-0ff9-4efb-a574-f521d18f08fa" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:50:43 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 01:50:43 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Updating instance_info_cache with network_info: [{"id": "6a841349-4e6e-40e1-90f0-998d46c60567", "address": "fa:16:3e:49:5d:eb", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a841349-4e", "ovs_interfaceid": "6a841349-4e6e-40e1-90f0-998d46c60567", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:50:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-fa29c144-0ff9-4efb-a574-f521d18f08fa" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:50:43 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 01:50:43 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:50:43 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:50:43 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:50:43 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:50:43 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:50:43 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:50:43 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 01:50:44 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:50:46 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:50:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:50:51 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:50:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:50:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:50:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:50:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "74311da6-d6b8-4aea-b6ce-97db8da53800" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:50:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:50:58 user nova-compute[71498]: DEBUG nova.objects.instance [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lazy-loading 'flavor' on Instance uuid 74311da6-d6b8-4aea-b6ce-97db8da53800 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:50:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:50:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "74311da6-d6b8-4aea-b6ce-97db8da53800" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:50:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:50:59 user nova-compute[71498]: INFO nova.compute.manager [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Attaching volume 016cf8b7-6ab7-4810-bc0a-a27d51484e71 to /dev/vdb
Apr 14 01:50:59 user nova-compute[71498]: DEBUG os_brick.utils [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:50:59 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:59 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:59 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5095ea6c-9e42-4a35-b2aa-131c2cc15159]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:50:59 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:59 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:59 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1485fa8e-2358-4711-b48e-356c0dc41134]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:50:59 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:59 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:50:59 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bdbced-0d8f-4e6a-9d11-0461586fa637]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:50:59 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2211433-2474-4814-9937-9b3989f8825b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:50:59 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:59 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:50:59 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:50:59 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:50:59 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:50:59 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:50:59 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[50281ef3-c1c8-490e-a993-323b201dc573]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:50:59 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:50:59 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:50:59 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:50:59 user nova-compute[71498]: DEBUG os_brick.utils [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:50:59 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Updating existing volume attachment record: ee08809a-e062-41c2-afd0-27bec41e4406 {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:51:00 user nova-compute[71498]: DEBUG nova.compute.manager [req-1831f4f6-2842-4acf-8e2e-0f26409c0622 req-322410e5-fa02-4896-a50a-5f239ef530cb service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Received event network-changed-db433bb1-8c59-4e6b-ae87-f6fab836df0f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:51:00 user nova-compute[71498]: DEBUG nova.compute.manager [req-1831f4f6-2842-4acf-8e2e-0f26409c0622 req-322410e5-fa02-4896-a50a-5f239ef530cb service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Refreshing instance network info cache due to event network-changed-db433bb1-8c59-4e6b-ae87-f6fab836df0f. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:51:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1831f4f6-2842-4acf-8e2e-0f26409c0622 req-322410e5-fa02-4896-a50a-5f239ef530cb service nova] Acquiring lock "refresh_cache-18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:51:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1831f4f6-2842-4acf-8e2e-0f26409c0622 req-322410e5-fa02-4896-a50a-5f239ef530cb service nova] Acquired lock "refresh_cache-18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:51:00 user nova-compute[71498]: DEBUG nova.network.neutron [req-1831f4f6-2842-4acf-8e2e-0f26409c0622 req-322410e5-fa02-4896-a50a-5f239ef530cb service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Refreshing network info cache for port db433bb1-8c59-4e6b-ae87-f6fab836df0f {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:51:00 user nova-compute[71498]: DEBUG nova.network.neutron [req-1831f4f6-2842-4acf-8e2e-0f26409c0622 req-322410e5-fa02-4896-a50a-5f239ef530cb service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Updated VIF entry in instance network info cache for port db433bb1-8c59-4e6b-ae87-f6fab836df0f. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:51:00 user nova-compute[71498]: DEBUG nova.network.neutron [req-1831f4f6-2842-4acf-8e2e-0f26409c0622 req-322410e5-fa02-4896-a50a-5f239ef530cb service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Updating instance_info_cache with network_info: [{"id": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "address": "fa:16:3e:d5:f1:51", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb433bb1-8c", "ovs_interfaceid": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:51:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1831f4f6-2842-4acf-8e2e-0f26409c0622 req-322410e5-fa02-4896-a50a-5f239ef530cb service nova] Releasing lock "refresh_cache-18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:51:01 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:51:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:51:02 user nova-compute[71498]: INFO nova.compute.manager [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Shelving
Apr 14 01:51:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:03 user nova-compute[71498]: DEBUG nova.compute.manager [req-5ae299db-6822-4bdd-bce3-750fa5feb3b9 req-104f92cc-26b2-499b-8298-121ff9811e65 service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Received event network-vif-unplugged-db433bb1-8c59-4e6b-ae87-f6fab836df0f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:51:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5ae299db-6822-4bdd-bce3-750fa5feb3b9 req-104f92cc-26b2-499b-8298-121ff9811e65 service nova] Acquiring lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:51:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5ae299db-6822-4bdd-bce3-750fa5feb3b9 req-104f92cc-26b2-499b-8298-121ff9811e65 service nova] Lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:51:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5ae299db-6822-4bdd-bce3-750fa5feb3b9 req-104f92cc-26b2-499b-8298-121ff9811e65 service nova] Lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:51:03 user nova-compute[71498]: DEBUG nova.compute.manager [req-5ae299db-6822-4bdd-bce3-750fa5feb3b9 req-104f92cc-26b2-499b-8298-121ff9811e65 service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] No waiting events found dispatching network-vif-unplugged-db433bb1-8c59-4e6b-ae87-f6fab836df0f {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:51:03 user nova-compute[71498]: WARNING nova.compute.manager [req-5ae299db-6822-4bdd-bce3-750fa5feb3b9 req-104f92cc-26b2-499b-8298-121ff9811e65 service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Received unexpected event network-vif-unplugged-db433bb1-8c59-4e6b-ae87-f6fab836df0f for instance with vm_state active and task_state shelving.
Apr 14 01:51:03 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Instance destroyed successfully.
Apr 14 01:51:03 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Beginning cold snapshot process
Apr 14 01:51:03 user nova-compute[71498]: DEBUG nova.privsep.utils [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71498) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 01:51:03 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk /opt/stack/data/nova/instances/snapshots/tmp6_i7g2zx/5444c004692c4c81b96f068f1ccbfd73 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWVdFpDI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:51:04 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:51:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:51:04 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:51:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:51:04 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:51:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk /opt/stack/data/nova/instances/snapshots/tmp6_i7g2zx/5444c004692c4c81b96f068f1ccbfd73" returned: 0 in 0.604s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:04 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Snapshot extracted, beginning image upload
Apr 14 01:51:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1952ddc-557d-484f-8905-f982506ab97f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:51:04 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a1f3e7-41a7-4f7f-b2f8-ef027a54481e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71] added
Apr 14 01:51:04 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f22ac6f-2294-4b49-87c0-f5a53317c4ce]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b983f002-a194-40ed-ae9b-6576c86cd319]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nWVdFpDI {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nWVdFpDI" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6579896e-7577-4bd4-a8e1-649c8982d5d9]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nWVdFpDI'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[369696ea-2e0f-4ca6-a875-cb6a61088ce9]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6f3669-198e-4d3e-abbd-cc361a3184d3]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:51:04 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:51:04 user nova-compute[71498]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)
Apr 14 01:51:04 user nova-compute[71498]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e (non-flash)
Apr 14 01:51:04 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:51:04 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:51:04 user nova-compute[71498]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)
Apr 14 01:51:04 user nova-compute[71498]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e (non-flash)
Apr 14 01:51:04 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82ecae7-1185-4647-be45-db737cc74276]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71, portal: 172.16.0.220,3260]
Apr 14 01:51:04 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71, portal: 172.16.0.220,3260] successful.
Apr 14 01:51:04 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[130677ac-4979-471b-a165-6fc0dc29a900]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[583819bf-302d-43a7-b993-f9c60b33323a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:51:04 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:51:04 user nova-compute[71498]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)
Apr 14 01:51:04 user nova-compute[71498]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e (non-flash)
Apr 14 01:51:04 user nova-compute[71498]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 (non-flash)
Apr 14 01:51:04 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:51:04 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:51:04 user nova-compute[71498]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)
Apr 14 01:51:04 user nova-compute[71498]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e (non-flash)
Apr 14 01:51:04 user nova-compute[71498]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 (non-flash)
Apr 14 01:51:04 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ef32f2-62ca-4e8b-906a-fe8e152f183c]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:51:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWVdFpDI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:51:05 user nova-compute[71498]: DEBUG nova.compute.manager [req-c76cc594-b87b-4609-abba-26ddbc4e4d0b req-1bec5054-b9ab-4ea2-a81d-311b4dff44d7 service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Received event network-vif-plugged-db433bb1-8c59-4e6b-ae87-f6fab836df0f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:51:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c76cc594-b87b-4609-abba-26ddbc4e4d0b req-1bec5054-b9ab-4ea2-a81d-311b4dff44d7 service nova] Acquiring lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:51:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c76cc594-b87b-4609-abba-26ddbc4e4d0b req-1bec5054-b9ab-4ea2-a81d-311b4dff44d7 service nova] Lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:51:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c76cc594-b87b-4609-abba-26ddbc4e4d0b req-1bec5054-b9ab-4ea2-a81d-311b4dff44d7 service nova] Lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:51:05 user nova-compute[71498]: DEBUG nova.compute.manager [req-c76cc594-b87b-4609-abba-26ddbc4e4d0b req-1bec5054-b9ab-4ea2-a81d-311b4dff44d7 service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] No waiting events found dispatching network-vif-plugged-db433bb1-8c59-4e6b-ae87-f6fab836df0f {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:51:05 user nova-compute[71498]: WARNING nova.compute.manager [req-c76cc594-b87b-4609-abba-26ddbc4e4d0b req-1bec5054-b9ab-4ea2-a81d-311b4dff44d7 service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Received unexpected event network-vif-plugged-db433bb1-8c59-4e6b-ae87-f6fab836df0f for instance with vm_state active and task_state shelving_image_uploading.
Apr 14 01:51:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:51:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23366613466383338', 'path': '/dev/sde'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:51:05 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366613466383338', 'path': '/dev/sde'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:51:05 user nova-compute[71498]: DEBUG nova.objects.instance [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lazy-loading 'flavor' on Instance uuid 74311da6-d6b8-4aea-b6ce-97db8da53800 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:51:05 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 01:51:05 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:51:05 user nova-compute[71498]:   <source dev="/dev/sde"/>
Apr 14 01:51:05 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:51:05 user nova-compute[71498]:   <serial>016cf8b7-6ab7-4810-bc0a-a27d51484e71</serial>
Apr 14 01:51:05 user nova-compute[71498]: </disk>
Apr 14 01:51:05 user nova-compute[71498]:  {{(pid=71498) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 01:51:06 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:51:06 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:51:06 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] No VIF found with MAC fa:16:3e:c7:d7:5e, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:51:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f8298f19-1be0-4d4b-8bcd-b0bfef52fe54 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.083s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:51:06 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:06 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Snapshot image upload complete
Apr 14 01:51:06 user nova-compute[71498]: DEBUG nova.compute.manager [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:51:06 user nova-compute[71498]: INFO nova.compute.manager [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Shelve offloading
Apr 14 01:51:06 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Instance destroyed successfully.
Apr 14 01:51:06 user nova-compute[71498]: DEBUG nova.compute.manager [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:51:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "refresh_cache-18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:51:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquired lock "refresh_cache-18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:51:06 user nova-compute[71498]: DEBUG nova.network.neutron [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:51:07 user nova-compute[71498]: DEBUG nova.network.neutron [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Updating instance_info_cache with network_info: [{"id": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "address": "fa:16:3e:d5:f1:51", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb433bb1-8c", "ovs_interfaceid": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:51:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Releasing lock "refresh_cache-18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:51:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "74311da6-d6b8-4aea-b6ce-97db8da53800" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:51:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:51:07 user nova-compute[71498]: INFO nova.compute.manager [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Detaching volume 016cf8b7-6ab7-4810-bc0a-a27d51484e71
Apr 14 01:51:07 user nova-compute[71498]: INFO nova.virt.block_device [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Attempting to driver detach volume 016cf8b7-6ab7-4810-bc0a-a27d51484e71 from mountpoint /dev/vdb
Apr 14 01:51:07 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Attempting to detach device vdb from instance 74311da6-d6b8-4aea-b6ce-97db8da53800 from the persistent domain config. {{(pid=71498) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 01:51:07 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 01:51:07 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:51:07 user nova-compute[71498]:   <source dev="/dev/sde"/>
Apr 14 01:51:07 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:51:07 user nova-compute[71498]:   <serial>016cf8b7-6ab7-4810-bc0a-a27d51484e71</serial>
Apr 14 01:51:07 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 01:51:07 user nova-compute[71498]: </disk>
Apr 14 01:51:07 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:51:07 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Successfully detached device vdb from instance 74311da6-d6b8-4aea-b6ce-97db8da53800 from the persistent domain config.
Apr 14 01:51:07 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 74311da6-d6b8-4aea-b6ce-97db8da53800 from the live domain config. {{(pid=71498) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 01:51:07 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 01:51:07 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:51:07 user nova-compute[71498]:   <source dev="/dev/sde"/>
Apr 14 01:51:07 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:51:07 user nova-compute[71498]:   <serial>016cf8b7-6ab7-4810-bc0a-a27d51484e71</serial>
Apr 14 01:51:07 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 01:51:07 user nova-compute[71498]: </disk>
Apr 14 01:51:07 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:51:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:07 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Instance destroyed successfully.
Apr 14 01:51:07 user nova-compute[71498]: DEBUG nova.objects.instance [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lazy-loading 'resources' on Instance uuid 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:51:07 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:49:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1301145911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1301145911',id=24,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPK5vWQCKiGuvwej8MZ61wsOrdvHzkY8KKRb64YirQyItNzZ+qUyi3rsN2xXflr+RBnZBMnmrlu6xsd3Isj7tFk7wOqGbcQSauLFOHMBPmHHo5KdwuxT7vQvU/ChwXXgmw==',key_name='tempest-keypair-1472759355',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:49:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a6d05ca328d64f2aa1d19550475edba3',ramdisk_id='',reservation_id='r-dkqwl1kl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2042065984',owner_user_name='tempest-AttachVolumeShelveTestJSON-2042065984-project-member',shelved_at='2023-04-14T01:51:06.526160',shelved_host='user',shelved_image_id='9449b6a2-115f-4228-8d3c-236393420350'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:51:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a5da3e233c74524a953ce0d4e074077',uuid=18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "address": "fa:16:3e:d5:f1:51", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb433bb1-8c", "ovs_interfaceid": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:51:07 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Converting VIF {"id": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "address": "fa:16:3e:d5:f1:51", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb433bb1-8c", "ovs_interfaceid": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:51:07 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f1:51,bridge_name='br-int',has_traffic_filtering=True,id=db433bb1-8c59-4e6b-ae87-f6fab836df0f,network=Network(a7b6c0bc-d2de-4431-821b-c2917738e556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb433bb1-8c') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:51:07 user nova-compute[71498]: DEBUG os_vif [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f1:51,bridge_name='br-int',has_traffic_filtering=True,id=db433bb1-8c59-4e6b-ae87-f6fab836df0f,network=Network(a7b6c0bc-d2de-4431-821b-c2917738e556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb433bb1-8c') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:51:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb433bb1-8c, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:51:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:51:07 user nova-compute[71498]: INFO os_vif [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f1:51,bridge_name='br-int',has_traffic_filtering=True,id=db433bb1-8c59-4e6b-ae87-f6fab836df0f,network=Network(a7b6c0bc-d2de-4431-821b-c2917738e556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb433bb1-8c')
Apr 14 01:51:07 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Deleting instance files /opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80_del
Apr 14 01:51:07 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Deletion of /opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80_del complete
Apr 14 01:51:07 user nova-compute[71498]: DEBUG nova.compute.manager [req-5e19df30-a18e-4407-b6af-b25b4264fde0 req-b9b10054-78a3-43aa-bfc8-28f482d00db8 service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Received event network-changed-db433bb1-8c59-4e6b-ae87-f6fab836df0f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:51:07 user nova-compute[71498]: DEBUG nova.compute.manager [req-5e19df30-a18e-4407-b6af-b25b4264fde0 req-b9b10054-78a3-43aa-bfc8-28f482d00db8 service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Refreshing instance network info cache due to event network-changed-db433bb1-8c59-4e6b-ae87-f6fab836df0f. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:51:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5e19df30-a18e-4407-b6af-b25b4264fde0 req-b9b10054-78a3-43aa-bfc8-28f482d00db8 service nova] Acquiring lock "refresh_cache-18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:51:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5e19df30-a18e-4407-b6af-b25b4264fde0 req-b9b10054-78a3-43aa-bfc8-28f482d00db8 service nova] Acquired lock "refresh_cache-18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:51:07 user nova-compute[71498]: DEBUG nova.network.neutron [req-5e19df30-a18e-4407-b6af-b25b4264fde0 req-b9b10054-78a3-43aa-bfc8-28f482d00db8 service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Refreshing network info cache for port db433bb1-8c59-4e6b-ae87-f6fab836df0f {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:51:07 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Deleted allocations for instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80
Apr 14 01:51:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:51:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:51:07 user nova-compute[71498]: DEBUG nova.objects.instance [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lazy-loading 'numa_topology' on Instance uuid 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:51:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Received event <DeviceRemovedEvent: 1681437068.0529728, 74311da6-d6b8-4aea-b6ce-97db8da53800 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71498) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 74311da6-d6b8-4aea-b6ce-97db8da53800 {{(pid=71498) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 01:51:08 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Successfully detached device vdb from instance 74311da6-d6b8-4aea-b6ce-97db8da53800 from the live domain config.
Apr 14 01:51:08 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWVdFpDI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:51:08 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:51:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b0f417-0c81-498c-8832-995e80d39ad5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:51:08 user nova-compute[71498]: No targets found.
Apr 14 01:51:08 user nova-compute[71498]: iSNS:
Apr 14 01:51:08 user nova-compute[71498]: No targets found.
Apr 14 01:51:08 user nova-compute[71498]: STATIC:
Apr 14 01:51:08 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a
Apr 14 01:51:08 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:51:08 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:51:08 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e
Apr 14 01:51:08 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:51:08 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:51:08 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71
Apr 14 01:51:08 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:51:08 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:51:08 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22
Apr 14 01:51:08 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:51:08 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:51:08 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e
Apr 14 01:51:08 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:51:08 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:51:08 user nova-compute[71498]: FIRMWARE:
Apr 14 01:51:08 user nova-compute[71498]: No targets found.
Apr 14 01:51:08 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:51:08 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:51:08 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d579b038-ffe5-44b9-9555-ec0df3dea9a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[94906c45-3876-4f32-b81b-c75824798c40]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:51:08 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:51:08 user nova-compute[71498]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)
Apr 14 01:51:08 user nova-compute[71498]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e (non-flash)
Apr 14 01:51:08 user nova-compute[71498]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 (non-flash)
Apr 14 01:51:08 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:51:08 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:51:08 user nova-compute[71498]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)
Apr 14 01:51:08 user nova-compute[71498]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e (non-flash)
Apr 14 01:51:08 user nova-compute[71498]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 (non-flash)
Apr 14 01:51:08 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51c4676a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71'): ({'sde'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Removing single pathed devices sde {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de5c99e-2db0-4363-9b68-6b90b6fca0e3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d539fa9f-14d9-4353-9b43-6d1ce45dc2fe]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Flushing IO for device /dev/sde {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[469f2334-3368-476b-b527-f5e938aec2e3]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG nova.network.neutron [req-5e19df30-a18e-4407-b6af-b25b4264fde0 req-b9b10054-78a3-43aa-bfc8-28f482d00db8 service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Updated VIF entry in instance network info cache for port db433bb1-8c59-4e6b-ae87-f6fab836df0f. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG nova.network.neutron [req-5e19df30-a18e-4407-b6af-b25b4264fde0 req-b9b10054-78a3-43aa-bfc8-28f482d00db8 service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Updating instance_info_cache with network_info: [{"id": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "address": "fa:16:3e:d5:f1:51", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapdb433bb1-8c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5e19df30-a18e-4407-b6af-b25b4264fde0 req-b9b10054-78a3-43aa-bfc8-28f482d00db8 service nova] Releasing lock "refresh_cache-18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fd9011-6a3f-4146-8107-75c33349a218]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] SCSI volumes sde have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a273145f-ca4c-42a8-a263-6277efbae558 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.483s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[be77136a-8ac3-4232-9eab-f68e1f26cc77]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3778495-da93-46d7-9387-e16414c95b4b]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71, portal: 172.16.0.220,3260]
Apr 14 01:51:08 user nova-compute[71498]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71, portal: 172.16.0.220,3260] successful.
Apr 14 01:51:08 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:016cf8b7-6ab7-4810-bc0a-a27d51484e71 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3251439a-6391-4c7c-81e8-ef60ceace1e4]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] <== disconnect_volume: return (334ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:51:08 user nova-compute[71498]: DEBUG nova.compute.manager [None req-dd8e3a18-c7d7-4769-812d-9991eef10911 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:51:09 user nova-compute[71498]: INFO nova.compute.manager [None req-dd8e3a18-c7d7-4769-812d-9991eef10911 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] instance snapshotting
Apr 14 01:51:09 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-dd8e3a18-c7d7-4769-812d-9991eef10911 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Beginning live snapshot process
Apr 14 01:51:09 user nova-compute[71498]: DEBUG nova.objects.instance [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lazy-loading 'flavor' on Instance uuid 74311da6-d6b8-4aea-b6ce-97db8da53800 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:51:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-dd8e3a18-c7d7-4769-812d-9991eef10911 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json -f qcow2 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4658a68b-3303-4a43-882a-b888826c4b72 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.754s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:51:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-dd8e3a18-c7d7-4769-812d-9991eef10911 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json -f qcow2" returned: 0 in 0.132s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-dd8e3a18-c7d7-4769-812d-9991eef10911 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json -f qcow2 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-dd8e3a18-c7d7-4769-812d-9991eef10911 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json -f qcow2" returned: 0 in 0.136s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-dd8e3a18-c7d7-4769-812d-9991eef10911 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-dd8e3a18-c7d7-4769-812d-9991eef10911 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.143s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-dd8e3a18-c7d7-4769-812d-9991eef10911 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfeyb8b3g/0ab1beb6164a4e81932e651e7cf7a94d.delta 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-dd8e3a18-c7d7-4769-812d-9991eef10911 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfeyb8b3g/0ab1beb6164a4e81932e651e7cf7a94d.delta 1073741824" returned: 0 in 0.046s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:09 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-dd8e3a18-c7d7-4769-812d-9991eef10911 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 01:51:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-dd8e3a18-c7d7-4769-812d-9991eef10911 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71498) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 01:51:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-dd8e3a18-c7d7-4769-812d-9991eef10911 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71498) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 01:51:10 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-dd8e3a18-c7d7-4769-812d-9991eef10911 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 01:51:11 user nova-compute[71498]: DEBUG nova.privsep.utils [None req-dd8e3a18-c7d7-4769-812d-9991eef10911 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71498) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 01:51:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-dd8e3a18-c7d7-4769-812d-9991eef10911 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfeyb8b3g/0ab1beb6164a4e81932e651e7cf7a94d.delta /opt/stack/data/nova/instances/snapshots/tmpfeyb8b3g/0ab1beb6164a4e81932e651e7cf7a94d {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-dd8e3a18-c7d7-4769-812d-9991eef10911 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfeyb8b3g/0ab1beb6164a4e81932e651e7cf7a94d.delta /opt/stack/data/nova/instances/snapshots/tmpfeyb8b3g/0ab1beb6164a4e81932e651e7cf7a94d" returned: 0 in 0.399s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:11 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-dd8e3a18-c7d7-4769-812d-9991eef10911 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Snapshot extracted, beginning image upload
Apr 14 01:51:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e9be81ce-9ccc-4557-9763-33984b2c6573" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:51:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e9be81ce-9ccc-4557-9763-33984b2c6573" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:51:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "e9be81ce-9ccc-4557-9763-33984b2c6573-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:51:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e9be81ce-9ccc-4557-9763-33984b2c6573-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:51:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e9be81ce-9ccc-4557-9763-33984b2c6573-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:51:11 user nova-compute[71498]: INFO nova.compute.manager [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Terminating instance
Apr 14 01:51:11 user nova-compute[71498]: DEBUG nova.compute.manager [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 01:51:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG nova.compute.manager [req-91180fde-5cc6-4ba6-9fde-22f2ea85faab req-51dfa2df-18f2-4dc7-967f-8dcae07e0e03 service nova] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Received event network-vif-unplugged-9e97257c-885b-434b-97cd-fe0f3ee85a43 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-91180fde-5cc6-4ba6-9fde-22f2ea85faab req-51dfa2df-18f2-4dc7-967f-8dcae07e0e03 service nova] Acquiring lock "e9be81ce-9ccc-4557-9763-33984b2c6573-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-91180fde-5cc6-4ba6-9fde-22f2ea85faab req-51dfa2df-18f2-4dc7-967f-8dcae07e0e03 service nova] Lock "e9be81ce-9ccc-4557-9763-33984b2c6573-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-91180fde-5cc6-4ba6-9fde-22f2ea85faab req-51dfa2df-18f2-4dc7-967f-8dcae07e0e03 service nova] Lock "e9be81ce-9ccc-4557-9763-33984b2c6573-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG nova.compute.manager [req-91180fde-5cc6-4ba6-9fde-22f2ea85faab req-51dfa2df-18f2-4dc7-967f-8dcae07e0e03 service nova] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] No waiting events found dispatching network-vif-unplugged-9e97257c-885b-434b-97cd-fe0f3ee85a43 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG nova.compute.manager [req-91180fde-5cc6-4ba6-9fde-22f2ea85faab req-51dfa2df-18f2-4dc7-967f-8dcae07e0e03 service nova] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Received event network-vif-unplugged-9e97257c-885b-434b-97cd-fe0f3ee85a43 for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:12 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Instance destroyed successfully.
Apr 14 01:51:12 user nova-compute[71498]: DEBUG nova.objects.instance [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lazy-loading 'resources' on Instance uuid e9be81ce-9ccc-4557-9763-33984b2c6573 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:49:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-957339692',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-957339692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-957339692',id=26,image_ref='bdcaffbf-53d5-4766-b9e2-130897a929c1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:49:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1f4117a4adb4aa3b42951cf1fc84237',ramdisk_id='',reservation_id='r-qvh0t9s7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-224521177',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-224521177-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-224521177',owner_user_name='tempest-TestVolumeBootPattern-224521177-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:49:41Z,user_data=None,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',uuid=e9be81ce-9ccc-4557-9763-33984b2c6573,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e97257c-885b-434b-97cd-fe0f3ee85a43", "address": "fa:16:3e:ef:c7:86", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e97257c-88", "ovs_interfaceid": "9e97257c-885b-434b-97cd-fe0f3ee85a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converting VIF {"id": "9e97257c-885b-434b-97cd-fe0f3ee85a43", "address": "fa:16:3e:ef:c7:86", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e97257c-88", "ovs_interfaceid": "9e97257c-885b-434b-97cd-fe0f3ee85a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c7:86,bridge_name='br-int',has_traffic_filtering=True,id=9e97257c-885b-434b-97cd-fe0f3ee85a43,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e97257c-88') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG os_vif [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c7:86,bridge_name='br-int',has_traffic_filtering=True,id=9e97257c-885b-434b-97cd-fe0f3ee85a43,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e97257c-88') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e97257c-88, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:51:12 user nova-compute[71498]: INFO os_vif [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:c7:86,bridge_name='br-int',has_traffic_filtering=True,id=9e97257c-885b-434b-97cd-fe0f3ee85a43,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e97257c-88')
Apr 14 01:51:12 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WOKSIlVx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:51:12 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:51:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[05dfa352-2cd1-471e-8976-36bf19ac98ad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:51:12 user nova-compute[71498]: No targets found.
Apr 14 01:51:12 user nova-compute[71498]: iSNS:
Apr 14 01:51:12 user nova-compute[71498]: No targets found.
Apr 14 01:51:12 user nova-compute[71498]: STATIC:
Apr 14 01:51:12 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a
Apr 14 01:51:12 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:51:12 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:51:12 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e
Apr 14 01:51:12 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:51:12 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:51:12 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22
Apr 14 01:51:12 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:51:12 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:51:12 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e
Apr 14 01:51:12 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:51:12 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:51:12 user nova-compute[71498]: FIRMWARE:
Apr 14 01:51:12 user nova-compute[71498]: No targets found.
Apr 14 01:51:12 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:51:12 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:51:12 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aed0e2e-fac4-4977-95d8-35b01dd0cf30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[64262c9e-2940-43d3-a377-6b2074a8f7b7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:51:12 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:51:12 user nova-compute[71498]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)
Apr 14 01:51:12 user nova-compute[71498]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e (non-flash)
Apr 14 01:51:12 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:51:12 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:51:12 user nova-compute[71498]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)
Apr 14 01:51:12 user nova-compute[71498]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e (non-flash)
Apr 14 01:51:12 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51c46a3370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e'): ({'sdd'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Removing single pathed devices sdd {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0766dd8f-44c2-453f-acf7-eecf091c9190]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d434ce-1b2c-4f3c-8acd-00560bff746b]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Flushing IO for device /dev/sdd {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a114cbc-3c23-460a-bc49-85226fd2c808]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc18a25-35d0-4069-a08b-f0ee475780bb]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] SCSI volumes sdd have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23532303063663439',) {{(pid=81721) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 01:51:12 user nova-compute[71498]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23532303063663439
Apr 14 01:51:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[53755463-44e5-4412-a205-644ffd3a040c]: (4, None) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[883b0478-2084-4443-a8e2-cdbae4b9c952]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8687c18-df53-4539-ac6f-c5ed691646ea]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e, portal: 172.16.0.220,3260]
Apr 14 01:51:12 user nova-compute[71498]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e, portal: 172.16.0.220,3260] successful.
Apr 14 01:51:12 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc92e1f9-d41a-47d9-abab-eca949db9d8e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c338d50-4bf6-494b-8360-2cc5c54e0aa3]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] <== disconnect_volume: return (314ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:51:12 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Deleting instance files /opt/stack/data/nova/instances/e9be81ce-9ccc-4557-9763-33984b2c6573_del
Apr 14 01:51:12 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Deletion of /opt/stack/data/nova/instances/e9be81ce-9ccc-4557-9763-33984b2c6573_del complete
Apr 14 01:51:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:12 user nova-compute[71498]: INFO nova.compute.manager [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Took 1.18 seconds to destroy the instance on the hypervisor.
Apr 14 01:51:12 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 01:51:12 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 01:51:13 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:51:13 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Took 0.45 seconds to deallocate network for instance.
Apr 14 01:51:13 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-dd8e3a18-c7d7-4769-812d-9991eef10911 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Snapshot image upload complete
Apr 14 01:51:13 user nova-compute[71498]: INFO nova.compute.manager [None req-dd8e3a18-c7d7-4769-812d-9991eef10911 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Took 4.68 seconds to snapshot the instance on the hypervisor.
Apr 14 01:51:14 user nova-compute[71498]: DEBUG nova.compute.manager [req-8a94dbd4-5e1d-440b-8d93-624922d2d3ab req-7fac2cbc-6c1c-4046-8c4c-0dfae0b30486 service nova] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Received event network-vif-plugged-9e97257c-885b-434b-97cd-fe0f3ee85a43 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:51:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8a94dbd4-5e1d-440b-8d93-624922d2d3ab req-7fac2cbc-6c1c-4046-8c4c-0dfae0b30486 service nova] Acquiring lock "e9be81ce-9ccc-4557-9763-33984b2c6573-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:51:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8a94dbd4-5e1d-440b-8d93-624922d2d3ab req-7fac2cbc-6c1c-4046-8c4c-0dfae0b30486 service nova] Lock "e9be81ce-9ccc-4557-9763-33984b2c6573-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:51:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8a94dbd4-5e1d-440b-8d93-624922d2d3ab req-7fac2cbc-6c1c-4046-8c4c-0dfae0b30486 service nova] Lock "e9be81ce-9ccc-4557-9763-33984b2c6573-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:51:14 user nova-compute[71498]: DEBUG nova.compute.manager [req-8a94dbd4-5e1d-440b-8d93-624922d2d3ab req-7fac2cbc-6c1c-4046-8c4c-0dfae0b30486 service nova] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] No waiting events found dispatching network-vif-plugged-9e97257c-885b-434b-97cd-fe0f3ee85a43 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:51:14 user nova-compute[71498]: WARNING nova.compute.manager [req-8a94dbd4-5e1d-440b-8d93-624922d2d3ab req-7fac2cbc-6c1c-4046-8c4c-0dfae0b30486 service nova] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Received unexpected event network-vif-plugged-9e97257c-885b-434b-97cd-fe0f3ee85a43 for instance with vm_state active and task_state deleting.
Apr 14 01:51:14 user nova-compute[71498]: DEBUG nova.compute.manager [req-8a94dbd4-5e1d-440b-8d93-624922d2d3ab req-7fac2cbc-6c1c-4046-8c4c-0dfae0b30486 service nova] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Received event network-vif-deleted-9e97257c-885b-434b-97cd-fe0f3ee85a43 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:51:14 user nova-compute[71498]: INFO nova.compute.manager [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Took 0.75 seconds to detach 1 volumes for instance.
Apr 14 01:51:14 user nova-compute[71498]: DEBUG nova.compute.manager [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Deleting volume: cc92e1f9-d41a-47d9-abab-eca949db9d8e {{(pid=71498) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 01:51:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:51:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:51:14 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:51:14 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:51:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.305s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:51:14 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Deleted allocations for instance e9be81ce-9ccc-4557-9763-33984b2c6573
Apr 14 01:51:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fd6b60da-02d3-4dfd-b11a-f4ae1f01c7cb tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "e9be81ce-9ccc-4557-9763-33984b2c6573" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.916s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:51:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:18 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681437063.3901908, 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:51:18 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] VM Stopped (Lifecycle Event)
Apr 14 01:51:18 user nova-compute[71498]: DEBUG nova.compute.manager [None req-37a4c1d7-f5b8-48f5-b3be-e4568a9821e4 None None] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:51:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:27 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681437072.5352364, e9be81ce-9ccc-4557-9763-33984b2c6573 => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:51:27 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] VM Stopped (Lifecycle Event)
Apr 14 01:51:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-86a36b4a-9168-4a74-8301-c75bf13b3453 None None] [instance: e9be81ce-9ccc-4557-9763-33984b2c6573] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:51:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:51:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 01:51:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:51:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:51:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:30 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:51:32 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:51:32 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Cleaning up deleted instances with incomplete migration  {{(pid=71498) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 01:51:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:33 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:51:33 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:51:33 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:51:33 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:51:33 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 01:51:33 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:51:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:33 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:51:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:51:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:51:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:51:36 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:51:36 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:51:36 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=7986MB free_disk=26.22760009765625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 01:51:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:51:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:51:36 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:51:36 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:51:36 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance a19a1c08-5454-481b-bb5a-70c39ead9afc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:51:36 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance fa29c144-0ff9-4efb-a574-f521d18f08fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:51:36 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:51:36 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 74311da6-d6b8-4aea-b6ce-97db8da53800 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:51:36 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 1ccf53b5-9199-4812-a635-4f4f22fb5d28 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:51:36 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance ae82789e-1bed-419b-a580-68ff7ed03ef2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:51:36 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 85b399dc-62df-480d-8561-5d9d1ab75c52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:51:36 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 01:51:36 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 01:51:37 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:51:37 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:51:37 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 01:51:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.457s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:51:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:40 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:51:40 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 01:51:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-73cc8ede-babd-4281-bf1d-c5a3f8bad440" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:51:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-73cc8ede-babd-4281-bf1d-c5a3f8bad440" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:51:40 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 01:51:40 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Updating instance_info_cache with network_info: [{"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:51:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-73cc8ede-babd-4281-bf1d-c5a3f8bad440" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:51:40 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 01:51:40 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:51:40 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:51:40 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:51:41 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:51:41 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:51:41 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:51:41 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 01:51:41 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:51:41 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Cleaning up deleted instances {{(pid=71498) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 01:51:41 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] There are 0 instances to clean {{(pid=71498) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 01:51:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:51:43 user nova-compute[71498]: INFO nova.compute.manager [None req-68ad434b-655f-4e65-b246-2642b6745567 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Unrescuing
Apr 14 01:51:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-68ad434b-655f-4e65-b246-2642b6745567 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "refresh_cache-a19a1c08-5454-481b-bb5a-70c39ead9afc" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:51:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-68ad434b-655f-4e65-b246-2642b6745567 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquired lock "refresh_cache-a19a1c08-5454-481b-bb5a-70c39ead9afc" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:51:43 user nova-compute[71498]: DEBUG nova.network.neutron [None req-68ad434b-655f-4e65-b246-2642b6745567 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:51:44 user nova-compute[71498]: DEBUG nova.network.neutron [None req-68ad434b-655f-4e65-b246-2642b6745567 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Updating instance_info_cache with network_info: [{"id": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "address": "fa:16:3e:1f:54:6c", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b00fd21-ee", "ovs_interfaceid": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:51:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-68ad434b-655f-4e65-b246-2642b6745567 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Releasing lock "refresh_cache-a19a1c08-5454-481b-bb5a-70c39ead9afc" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:51:44 user nova-compute[71498]: DEBUG nova.objects.instance [None req-68ad434b-655f-4e65-b246-2642b6745567 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'flavor' on Instance uuid a19a1c08-5454-481b-bb5a-70c39ead9afc {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:51:44 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:44 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:44 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:51:44 user nova-compute[71498]: DEBUG nova.compute.manager [req-7179134a-816d-4bbe-82f1-e698038c3efa req-df8783bc-3d34-4ab1-9733-a7ccd120b209 service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Received event network-vif-unplugged-2b00fd21-ee22-48c1-beb5-66e60de9876a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:51:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7179134a-816d-4bbe-82f1-e698038c3efa req-df8783bc-3d34-4ab1-9733-a7ccd120b209 service nova] Acquiring lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:51:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7179134a-816d-4bbe-82f1-e698038c3efa req-df8783bc-3d34-4ab1-9733-a7ccd120b209 service nova] Lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:51:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7179134a-816d-4bbe-82f1-e698038c3efa req-df8783bc-3d34-4ab1-9733-a7ccd120b209 service nova] Lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:51:44 user nova-compute[71498]: DEBUG nova.compute.manager [req-7179134a-816d-4bbe-82f1-e698038c3efa req-df8783bc-3d34-4ab1-9733-a7ccd120b209 service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] No waiting events found dispatching network-vif-unplugged-2b00fd21-ee22-48c1-beb5-66e60de9876a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:51:44 user nova-compute[71498]: WARNING nova.compute.manager [req-7179134a-816d-4bbe-82f1-e698038c3efa req-df8783bc-3d34-4ab1-9733-a7ccd120b209 service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Received unexpected event network-vif-unplugged-2b00fd21-ee22-48c1-beb5-66e60de9876a for instance with vm_state rescued and task_state unrescuing.
Apr 14 01:51:44 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:44 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:44 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Instance destroyed successfully.
Apr 14 01:51:46 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:46 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:46 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:46 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:46 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:46 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:46 user nova-compute[71498]: DEBUG nova.compute.manager [req-aa9dde26-6b08-44a3-8678-780a5f39c61e req-0fde7e34-7d8e-4481-8545-fee08b999bfe service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Received event network-vif-plugged-2b00fd21-ee22-48c1-beb5-66e60de9876a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:51:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-aa9dde26-6b08-44a3-8678-780a5f39c61e req-0fde7e34-7d8e-4481-8545-fee08b999bfe service nova] Acquiring lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:51:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-aa9dde26-6b08-44a3-8678-780a5f39c61e req-0fde7e34-7d8e-4481-8545-fee08b999bfe service nova] Lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:51:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-aa9dde26-6b08-44a3-8678-780a5f39c61e req-0fde7e34-7d8e-4481-8545-fee08b999bfe service nova] Lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:51:46 user nova-compute[71498]: DEBUG nova.compute.manager [req-aa9dde26-6b08-44a3-8678-780a5f39c61e req-0fde7e34-7d8e-4481-8545-fee08b999bfe service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] No waiting events found dispatching network-vif-plugged-2b00fd21-ee22-48c1-beb5-66e60de9876a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:51:46 user nova-compute[71498]: WARNING nova.compute.manager [req-aa9dde26-6b08-44a3-8678-780a5f39c61e req-0fde7e34-7d8e-4481-8545-fee08b999bfe service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Received unexpected event network-vif-plugged-2b00fd21-ee22-48c1-beb5-66e60de9876a for instance with vm_state rescued and task_state unrescuing.
Apr 14 01:51:46 user nova-compute[71498]: DEBUG nova.compute.manager [req-aa9dde26-6b08-44a3-8678-780a5f39c61e req-0fde7e34-7d8e-4481-8545-fee08b999bfe service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Received event network-vif-plugged-2b00fd21-ee22-48c1-beb5-66e60de9876a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:51:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-aa9dde26-6b08-44a3-8678-780a5f39c61e req-0fde7e34-7d8e-4481-8545-fee08b999bfe service nova] Acquiring lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:51:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-aa9dde26-6b08-44a3-8678-780a5f39c61e req-0fde7e34-7d8e-4481-8545-fee08b999bfe service nova] Lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:51:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-aa9dde26-6b08-44a3-8678-780a5f39c61e req-0fde7e34-7d8e-4481-8545-fee08b999bfe service nova] Lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:51:46 user nova-compute[71498]: DEBUG nova.compute.manager [req-aa9dde26-6b08-44a3-8678-780a5f39c61e req-0fde7e34-7d8e-4481-8545-fee08b999bfe service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] No waiting events found dispatching network-vif-plugged-2b00fd21-ee22-48c1-beb5-66e60de9876a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:51:46 user nova-compute[71498]: WARNING nova.compute.manager [req-aa9dde26-6b08-44a3-8678-780a5f39c61e req-0fde7e34-7d8e-4481-8545-fee08b999bfe service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Received unexpected event network-vif-plugged-2b00fd21-ee22-48c1-beb5-66e60de9876a for instance with vm_state rescued and task_state unrescuing.
Apr 14 01:51:46 user nova-compute[71498]: DEBUG nova.compute.manager [req-aa9dde26-6b08-44a3-8678-780a5f39c61e req-0fde7e34-7d8e-4481-8545-fee08b999bfe service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Received event network-vif-plugged-2b00fd21-ee22-48c1-beb5-66e60de9876a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:51:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-aa9dde26-6b08-44a3-8678-780a5f39c61e req-0fde7e34-7d8e-4481-8545-fee08b999bfe service nova] Acquiring lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:51:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-aa9dde26-6b08-44a3-8678-780a5f39c61e req-0fde7e34-7d8e-4481-8545-fee08b999bfe service nova] Lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:51:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-aa9dde26-6b08-44a3-8678-780a5f39c61e req-0fde7e34-7d8e-4481-8545-fee08b999bfe service nova] Lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:51:46 user nova-compute[71498]: DEBUG nova.compute.manager [req-aa9dde26-6b08-44a3-8678-780a5f39c61e req-0fde7e34-7d8e-4481-8545-fee08b999bfe service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] No waiting events found dispatching network-vif-plugged-2b00fd21-ee22-48c1-beb5-66e60de9876a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:51:46 user nova-compute[71498]: WARNING nova.compute.manager [req-aa9dde26-6b08-44a3-8678-780a5f39c61e req-0fde7e34-7d8e-4481-8545-fee08b999bfe service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Received unexpected event network-vif-plugged-2b00fd21-ee22-48c1-beb5-66e60de9876a for instance with vm_state rescued and task_state unrescuing.
Apr 14 01:51:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:48 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Removed pending event for a19a1c08-5454-481b-bb5a-70c39ead9afc due to event {{(pid=71498) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 01:51:48 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437108.2547677, a19a1c08-5454-481b-bb5a-70c39ead9afc => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:51:48 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] VM Resumed (Lifecycle Event)
Apr 14 01:51:48 user nova-compute[71498]: DEBUG nova.compute.manager [None req-68ad434b-655f-4e65-b246-2642b6745567 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:51:48 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:51:48 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:51:48 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 01:51:48 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437108.258201, a19a1c08-5454-481b-bb5a-70c39ead9afc => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:51:48 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] VM Started (Lifecycle Event)
Apr 14 01:51:48 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:51:48 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:51:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:51:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:52:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 01:52:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:52:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:52:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "1ccf53b5-9199-4812-a635-4f4f22fb5d28" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:52:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "1ccf53b5-9199-4812-a635-4f4f22fb5d28" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:52:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "1ccf53b5-9199-4812-a635-4f4f22fb5d28-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:52:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "1ccf53b5-9199-4812-a635-4f4f22fb5d28-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:52:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "1ccf53b5-9199-4812-a635-4f4f22fb5d28-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:52:05 user nova-compute[71498]: INFO nova.compute.manager [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Terminating instance
Apr 14 01:52:05 user nova-compute[71498]: DEBUG nova.compute.manager [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 01:52:05 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:05 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:05 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:05 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:05 user nova-compute[71498]: DEBUG nova.compute.manager [req-d6b3fda1-11d3-4975-8098-84710b40729b req-78d17823-2d59-4a3a-bad8-e9520b459961 service nova] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Received event network-vif-unplugged-d58d1594-1a97-4a63-be67-e8101e889654 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:52:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d6b3fda1-11d3-4975-8098-84710b40729b req-78d17823-2d59-4a3a-bad8-e9520b459961 service nova] Acquiring lock "1ccf53b5-9199-4812-a635-4f4f22fb5d28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:52:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d6b3fda1-11d3-4975-8098-84710b40729b req-78d17823-2d59-4a3a-bad8-e9520b459961 service nova] Lock "1ccf53b5-9199-4812-a635-4f4f22fb5d28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:52:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d6b3fda1-11d3-4975-8098-84710b40729b req-78d17823-2d59-4a3a-bad8-e9520b459961 service nova] Lock "1ccf53b5-9199-4812-a635-4f4f22fb5d28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:52:05 user nova-compute[71498]: DEBUG nova.compute.manager [req-d6b3fda1-11d3-4975-8098-84710b40729b req-78d17823-2d59-4a3a-bad8-e9520b459961 service nova] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] No waiting events found dispatching network-vif-unplugged-d58d1594-1a97-4a63-be67-e8101e889654 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:52:05 user nova-compute[71498]: DEBUG nova.compute.manager [req-d6b3fda1-11d3-4975-8098-84710b40729b req-78d17823-2d59-4a3a-bad8-e9520b459961 service nova] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Received event network-vif-unplugged-d58d1594-1a97-4a63-be67-e8101e889654 for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:06 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Instance destroyed successfully.
Apr 14 01:52:06 user nova-compute[71498]: DEBUG nova.objects.instance [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lazy-loading 'resources' on Instance uuid 1ccf53b5-9199-4812-a635-4f4f22fb5d28 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:47:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-305851277',display_name='tempest-TestVolumeBootPattern-volume-backed-server-305851277',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-305851277',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:47:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1f4117a4adb4aa3b42951cf1fc84237',ramdisk_id='',reservation_id='r-1jywfjut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-224521177',owner_user_name='tempest-TestVolumeBootPattern-224521177-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:47:40Z,user_data=None,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',uuid=1ccf53b5-9199-4812-a635-4f4f22fb5d28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d58d1594-1a97-4a63-be67-e8101e889654", "address": "fa:16:3e:1d:82:b9", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd58d1594-1a", "ovs_interfaceid": "d58d1594-1a97-4a63-be67-e8101e889654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converting VIF {"id": "d58d1594-1a97-4a63-be67-e8101e889654", "address": "fa:16:3e:1d:82:b9", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd58d1594-1a", "ovs_interfaceid": "d58d1594-1a97-4a63-be67-e8101e889654", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:82:b9,bridge_name='br-int',has_traffic_filtering=True,id=d58d1594-1a97-4a63-be67-e8101e889654,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd58d1594-1a') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG os_vif [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:82:b9,bridge_name='br-int',has_traffic_filtering=True,id=d58d1594-1a97-4a63-be67-e8101e889654,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd58d1594-1a') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd58d1594-1a, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:52:06 user nova-compute[71498]: INFO os_vif [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:82:b9,bridge_name='br-int',has_traffic_filtering=True,id=d58d1594-1a97-4a63-be67-e8101e889654,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd58d1594-1a')
Apr 14 01:52:06 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sxmOykTu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:52:06 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:52:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8af49f4-aac9-4db7-8651-ee4b4b6663e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:52:06 user nova-compute[71498]: No targets found.
Apr 14 01:52:06 user nova-compute[71498]: iSNS:
Apr 14 01:52:06 user nova-compute[71498]: No targets found.
Apr 14 01:52:06 user nova-compute[71498]: STATIC:
Apr 14 01:52:06 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a
Apr 14 01:52:06 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:52:06 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:52:06 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e
Apr 14 01:52:06 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:52:06 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:52:06 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22
Apr 14 01:52:06 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:52:06 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:52:06 user nova-compute[71498]: FIRMWARE:
Apr 14 01:52:06 user nova-compute[71498]: No targets found.
Apr 14 01:52:06 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:52:06 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:52:06 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1313473c-286b-44f3-b3e3-b972740c578f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[232a709f-b56f-4046-97b4-3140048fc095]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:52:06 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:52:06 user nova-compute[71498]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)
Apr 14 01:52:06 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:52:06 user nova-compute[71498]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e (non-flash)
Apr 14 01:52:06 user nova-compute[71498]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)
Apr 14 01:52:06 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51e423b760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e'): ({'sdh'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Removing single pathed devices sdh {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae588b70-4c71-426e-961a-ec88f873612c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1e0517-bedc-40b5-9697-db88334bdb57]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Flushing IO for device /dev/sdh {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bebfe4-9be5-48cd-9b6f-fa67f5d72666]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.042s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fc54fc-b517-4d86-9d44-7d4227090614]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] SCSI volumes sdh have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOc09c3622-3b64ae281c6fdf4c', '/dev/disk/by-id/scsi-23362363461653238', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c09c3622') {{(pid=81721) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8d84c3-1198-49d9-848f-28467c148be6]: (4, None) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e23c101-b487-4efa-9e93-cdcc06fb8d20]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[948f39b2-d2e5-4e1c-86a6-d141e9e286f2]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e, portal: 172.16.0.220,3260]
Apr 14 01:52:06 user nova-compute[71498]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e, portal: 172.16.0.220,3260] successful.
Apr 14 01:52:06 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9cb54ed-9520-43e9-a1c8-2be10b7f955e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27704c5-ba7b-4e9b-89aa-ed961a0a115a]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] <== disconnect_volume: return (325ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:52:06 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Deleting instance files /opt/stack/data/nova/instances/1ccf53b5-9199-4812-a635-4f4f22fb5d28_del
Apr 14 01:52:06 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Deletion of /opt/stack/data/nova/instances/1ccf53b5-9199-4812-a635-4f4f22fb5d28_del complete
Apr 14 01:52:06 user nova-compute[71498]: INFO nova.compute.manager [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Took 1.20 seconds to destroy the instance on the hypervisor.
Apr 14 01:52:06 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 01:52:06 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 01:52:07 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:52:07 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Took 0.50 seconds to deallocate network for instance.
Apr 14 01:52:07 user nova-compute[71498]: DEBUG nova.compute.manager [req-448883cb-02d2-455e-b350-01e02081918e req-5e4bf191-08dd-4ed8-ab22-216e855fb70c service nova] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Received event network-vif-deleted-d58d1594-1a97-4a63-be67-e8101e889654 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:52:07 user nova-compute[71498]: INFO nova.compute.manager [req-448883cb-02d2-455e-b350-01e02081918e req-5e4bf191-08dd-4ed8-ab22-216e855fb70c service nova] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Neutron deleted interface d58d1594-1a97-4a63-be67-e8101e889654; detaching it from the instance and deleting it from the info cache
Apr 14 01:52:07 user nova-compute[71498]: DEBUG nova.network.neutron [req-448883cb-02d2-455e-b350-01e02081918e req-5e4bf191-08dd-4ed8-ab22-216e855fb70c service nova] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:52:07 user nova-compute[71498]: DEBUG nova.compute.manager [req-448883cb-02d2-455e-b350-01e02081918e req-5e4bf191-08dd-4ed8-ab22-216e855fb70c service nova] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Detach interface failed, port_id=d58d1594-1a97-4a63-be67-e8101e889654, reason: Instance 1ccf53b5-9199-4812-a635-4f4f22fb5d28 could not be found. {{(pid=71498) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 01:52:07 user nova-compute[71498]: DEBUG nova.compute.manager [req-2cfe05bb-e68d-420b-b131-83b2e4ddd2d2 req-95fe83cf-fc0e-4a86-8bac-b4250d6da4c1 service nova] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Received event network-vif-plugged-d58d1594-1a97-4a63-be67-e8101e889654 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:52:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-2cfe05bb-e68d-420b-b131-83b2e4ddd2d2 req-95fe83cf-fc0e-4a86-8bac-b4250d6da4c1 service nova] Acquiring lock "1ccf53b5-9199-4812-a635-4f4f22fb5d28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:52:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-2cfe05bb-e68d-420b-b131-83b2e4ddd2d2 req-95fe83cf-fc0e-4a86-8bac-b4250d6da4c1 service nova] Lock "1ccf53b5-9199-4812-a635-4f4f22fb5d28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:52:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-2cfe05bb-e68d-420b-b131-83b2e4ddd2d2 req-95fe83cf-fc0e-4a86-8bac-b4250d6da4c1 service nova] Lock "1ccf53b5-9199-4812-a635-4f4f22fb5d28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:52:07 user nova-compute[71498]: DEBUG nova.compute.manager [req-2cfe05bb-e68d-420b-b131-83b2e4ddd2d2 req-95fe83cf-fc0e-4a86-8bac-b4250d6da4c1 service nova] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] No waiting events found dispatching network-vif-plugged-d58d1594-1a97-4a63-be67-e8101e889654 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:52:07 user nova-compute[71498]: WARNING nova.compute.manager [req-2cfe05bb-e68d-420b-b131-83b2e4ddd2d2 req-95fe83cf-fc0e-4a86-8bac-b4250d6da4c1 service nova] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Received unexpected event network-vif-plugged-d58d1594-1a97-4a63-be67-e8101e889654 for instance with vm_state active and task_state deleting.
Apr 14 01:52:07 user nova-compute[71498]: INFO nova.compute.manager [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Took 0.77 seconds to detach 1 volumes for instance.
Apr 14 01:52:07 user nova-compute[71498]: DEBUG nova.compute.manager [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Deleting volume: f9cb54ed-9520-43e9-a1c8-2be10b7f955e {{(pid=71498) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 01:52:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:52:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:52:08 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Refreshing inventories for resource provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 01:52:08 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Updating ProviderTree inventory for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 01:52:08 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Updating inventory in ProviderTree for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 01:52:08 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Refreshing aggregate associations for resource provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4, aggregates: None {{(pid=71498) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 01:52:08 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Refreshing trait associations for resource provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,HW_CPU_X86_SSE2 {{(pid=71498) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 01:52:08 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:52:08 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:52:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.535s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:52:08 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Deleted allocations for instance 1ccf53b5-9199-4812-a635-4f4f22fb5d28
Apr 14 01:52:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a2217ab9-8729-4cc3-a827-e1ab3b69e2d6 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "1ccf53b5-9199-4812-a635-4f4f22fb5d28" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.247s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:52:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:52:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:52:12 user nova-compute[71498]: INFO nova.compute.manager [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Detaching volume b1446339-0ce8-401e-b2e0-c4811b486a1a
Apr 14 01:52:12 user nova-compute[71498]: INFO nova.virt.block_device [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Attempting to driver detach volume b1446339-0ce8-401e-b2e0-c4811b486a1a from mountpoint /dev/vdb
Apr 14 01:52:12 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Attempting to detach device vdb from instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 from the persistent domain config. {{(pid=71498) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 01:52:12 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 01:52:12 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:52:12 user nova-compute[71498]:   <source dev="/dev/sdc"/>
Apr 14 01:52:12 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:52:12 user nova-compute[71498]:   <serial>b1446339-0ce8-401e-b2e0-c4811b486a1a</serial>
Apr 14 01:52:12 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 01:52:12 user nova-compute[71498]: </disk>
Apr 14 01:52:12 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:52:12 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Successfully detached device vdb from instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 from the persistent domain config.
Apr 14 01:52:12 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 from the live domain config. {{(pid=71498) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 01:52:12 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 01:52:12 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:52:12 user nova-compute[71498]:   <source dev="/dev/sdc"/>
Apr 14 01:52:12 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:52:12 user nova-compute[71498]:   <serial>b1446339-0ce8-401e-b2e0-c4811b486a1a</serial>
Apr 14 01:52:12 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 01:52:12 user nova-compute[71498]: </disk>
Apr 14 01:52:12 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:52:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Received event <DeviceRemovedEvent: 1681437133.3875961, 73cc8ede-babd-4281-bf1d-c5a3f8bad440 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71498) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 {{(pid=71498) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 01:52:13 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Successfully detached device vdb from instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 from the live domain config.
Apr 14 01:52:13 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbmBcKyr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:52:13 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:52:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5621c86-65a1-4a6c-ba79-9f14e8d8a757]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:52:13 user nova-compute[71498]: No targets found.
Apr 14 01:52:13 user nova-compute[71498]: iSNS:
Apr 14 01:52:13 user nova-compute[71498]: No targets found.
Apr 14 01:52:13 user nova-compute[71498]: STATIC:
Apr 14 01:52:13 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a
Apr 14 01:52:13 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:52:13 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:52:13 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22
Apr 14 01:52:13 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:52:13 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:52:13 user nova-compute[71498]: FIRMWARE:
Apr 14 01:52:13 user nova-compute[71498]: No targets found.
Apr 14 01:52:13 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:52:13 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:52:13 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53b1bfc-380d-40b5-8d9f-d1af3a4734b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e31257-5cdb-45a2-a88f-d4acbd293208]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:52:13 user nova-compute[71498]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)
Apr 14 01:52:13 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:52:13 user nova-compute[71498]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a (non-flash)
Apr 14 01:52:13 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51e4238280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a'): ({'sdc'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Removing single pathed devices sdc {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b58f7e4-b463-4cb1-a70e-7c84fce523f5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee0dd40-1c42-45ff-a5d6-a97b8296b322]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Flushing IO for device /dev/sdc {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a5eb13-12eb-4894-9542-9d0d32dcfc37]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cc1fc6-52a3-4e31-89b6-7f25465e292d]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] SCSI volumes sdc have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15461e0-85fc-418b-b0a2-b59f306789a5]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8550db6-a7df-4e2c-95e2-b7ff44b0bc49]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a, portal: 172.16.0.220,3260]
Apr 14 01:52:13 user nova-compute[71498]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a, portal: 172.16.0.220,3260] successful.
Apr 14 01:52:13 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1446339-0ce8-401e-b2e0-c4811b486a1a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cafcb5-c2be-409a-8137-7d7e6af4e49a]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] <== disconnect_volume: return (298ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:52:13 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:52:14 user nova-compute[71498]: DEBUG nova.objects.instance [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lazy-loading 'flavor' on Instance uuid 73cc8ede-babd-4281-bf1d-c5a3f8bad440 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:52:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-67e29ff4-506c-4a94-954b-e159410d6ed8 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.697s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:52:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:52:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:52:15 user nova-compute[71498]: DEBUG nova.compute.manager [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 01:52:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:52:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:52:15 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:52:15 user nova-compute[71498]: INFO nova.compute.claims [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Claim successful on node user
Apr 14 01:52:15 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:52:15 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:52:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:52:15 user nova-compute[71498]: DEBUG nova.compute.manager [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 01:52:16 user nova-compute[71498]: DEBUG nova.compute.manager [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 01:52:16 user nova-compute[71498]: DEBUG nova.network.neutron [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:52:16 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 01:52:16 user nova-compute[71498]: DEBUG nova.compute.manager [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 01:52:16 user nova-compute[71498]: INFO nova.virt.block_device [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Booting with volume-backed-image b1bc26f9-63fb-4bff-8f72-f1e49544441d at /dev/vda
Apr 14 01:52:16 user nova-compute[71498]: DEBUG nova.policy [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ed01a83531f4c6bb18a4593284baf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219c39c8299e46368012a947fdfbe5fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:52:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:16 user nova-compute[71498]: DEBUG nova.network.neutron [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Successfully created port: 6568fde8-2639-4cee-8527-e3ca028f42fd {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:52:17 user nova-compute[71498]: DEBUG nova.network.neutron [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Successfully updated port: 6568fde8-2639-4cee-8527-e3ca028f42fd {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:52:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "refresh_cache-7ff438f4-54e1-44b9-bb5a-1b42d48a37ed" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:52:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquired lock "refresh_cache-7ff438f4-54e1-44b9-bb5a-1b42d48a37ed" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:52:17 user nova-compute[71498]: DEBUG nova.network.neutron [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:52:17 user nova-compute[71498]: DEBUG nova.compute.manager [req-23530564-a8e4-4ae4-b5de-c46cf43e2dfc req-01a77862-d96b-49e5-99f9-e71a4c3853df service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Received event network-changed-6568fde8-2639-4cee-8527-e3ca028f42fd {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:52:17 user nova-compute[71498]: DEBUG nova.compute.manager [req-23530564-a8e4-4ae4-b5de-c46cf43e2dfc req-01a77862-d96b-49e5-99f9-e71a4c3853df service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Refreshing instance network info cache due to event network-changed-6568fde8-2639-4cee-8527-e3ca028f42fd. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:52:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-23530564-a8e4-4ae4-b5de-c46cf43e2dfc req-01a77862-d96b-49e5-99f9-e71a4c3853df service nova] Acquiring lock "refresh_cache-7ff438f4-54e1-44b9-bb5a-1b42d48a37ed" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:52:17 user nova-compute[71498]: DEBUG nova.network.neutron [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:52:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:18 user nova-compute[71498]: DEBUG nova.network.neutron [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Updating instance_info_cache with network_info: [{"id": "6568fde8-2639-4cee-8527-e3ca028f42fd", "address": "fa:16:3e:69:f8:89", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6568fde8-26", "ovs_interfaceid": "6568fde8-2639-4cee-8527-e3ca028f42fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:52:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Releasing lock "refresh_cache-7ff438f4-54e1-44b9-bb5a-1b42d48a37ed" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:52:18 user nova-compute[71498]: DEBUG nova.compute.manager [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Instance network_info: |[{"id": "6568fde8-2639-4cee-8527-e3ca028f42fd", "address": "fa:16:3e:69:f8:89", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6568fde8-26", "ovs_interfaceid": "6568fde8-2639-4cee-8527-e3ca028f42fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 01:52:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-23530564-a8e4-4ae4-b5de-c46cf43e2dfc req-01a77862-d96b-49e5-99f9-e71a4c3853df service nova] Acquired lock "refresh_cache-7ff438f4-54e1-44b9-bb5a-1b42d48a37ed" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:52:18 user nova-compute[71498]: DEBUG nova.network.neutron [req-23530564-a8e4-4ae4-b5de-c46cf43e2dfc req-01a77862-d96b-49e5-99f9-e71a4c3853df service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Refreshing network info cache for port 6568fde8-2639-4cee-8527-e3ca028f42fd {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:52:19 user nova-compute[71498]: DEBUG nova.network.neutron [req-23530564-a8e4-4ae4-b5de-c46cf43e2dfc req-01a77862-d96b-49e5-99f9-e71a4c3853df service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Updated VIF entry in instance network info cache for port 6568fde8-2639-4cee-8527-e3ca028f42fd. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:52:19 user nova-compute[71498]: DEBUG nova.network.neutron [req-23530564-a8e4-4ae4-b5de-c46cf43e2dfc req-01a77862-d96b-49e5-99f9-e71a4c3853df service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Updating instance_info_cache with network_info: [{"id": "6568fde8-2639-4cee-8527-e3ca028f42fd", "address": "fa:16:3e:69:f8:89", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6568fde8-26", "ovs_interfaceid": "6568fde8-2639-4cee-8527-e3ca028f42fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:52:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-23530564-a8e4-4ae4-b5de-c46cf43e2dfc req-01a77862-d96b-49e5-99f9-e71a4c3853df service nova] Releasing lock "refresh_cache-7ff438f4-54e1-44b9-bb5a-1b42d48a37ed" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:52:19 user nova-compute[71498]: DEBUG nova.compute.manager [req-3ed90873-fef2-4afe-ba98-36929692dca5 req-17d7edcd-d00a-4a05-9466-80f5f16f3aba service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Received event network-changed-20a227b0-3b4d-4df0-b583-071771a0ae44 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:52:19 user nova-compute[71498]: DEBUG nova.compute.manager [req-3ed90873-fef2-4afe-ba98-36929692dca5 req-17d7edcd-d00a-4a05-9466-80f5f16f3aba service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Refreshing instance network info cache due to event network-changed-20a227b0-3b4d-4df0-b583-071771a0ae44. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:52:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3ed90873-fef2-4afe-ba98-36929692dca5 req-17d7edcd-d00a-4a05-9466-80f5f16f3aba service nova] Acquiring lock "refresh_cache-74311da6-d6b8-4aea-b6ce-97db8da53800" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:52:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3ed90873-fef2-4afe-ba98-36929692dca5 req-17d7edcd-d00a-4a05-9466-80f5f16f3aba service nova] Acquired lock "refresh_cache-74311da6-d6b8-4aea-b6ce-97db8da53800" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:52:19 user nova-compute[71498]: DEBUG nova.network.neutron [req-3ed90873-fef2-4afe-ba98-36929692dca5 req-17d7edcd-d00a-4a05-9466-80f5f16f3aba service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Refreshing network info cache for port 20a227b0-3b4d-4df0-b583-071771a0ae44 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:52:20 user nova-compute[71498]: DEBUG nova.network.neutron [req-3ed90873-fef2-4afe-ba98-36929692dca5 req-17d7edcd-d00a-4a05-9466-80f5f16f3aba service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Updated VIF entry in instance network info cache for port 20a227b0-3b4d-4df0-b583-071771a0ae44. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:52:20 user nova-compute[71498]: DEBUG nova.network.neutron [req-3ed90873-fef2-4afe-ba98-36929692dca5 req-17d7edcd-d00a-4a05-9466-80f5f16f3aba service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Updating instance_info_cache with network_info: [{"id": "20a227b0-3b4d-4df0-b583-071771a0ae44", "address": "fa:16:3e:c7:d7:5e", "network": {"id": "31f4b7e9-13bd-4aca-b6c3-a283c637ed63", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-802021657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "740488dbb5114fb2b38be20f8ce4adb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a227b0-3b", "ovs_interfaceid": "20a227b0-3b4d-4df0-b583-071771a0ae44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:52:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3ed90873-fef2-4afe-ba98-36929692dca5 req-17d7edcd-d00a-4a05-9466-80f5f16f3aba service nova] Releasing lock "refresh_cache-74311da6-d6b8-4aea-b6ce-97db8da53800" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:52:21 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681437126.1878746, 1ccf53b5-9199-4812-a635-4f4f22fb5d28 => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:52:21 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] VM Stopped (Lifecycle Event)
Apr 14 01:52:21 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d2079217-d1c6-4135-b311-2102ab91da04 None None] [instance: 1ccf53b5-9199-4812-a635-4f4f22fb5d28] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:52:21 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:21 user nova-compute[71498]: DEBUG os_brick.utils [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:52:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:21 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac3a2ec-c9c4-41b6-a8b4-17556820f576]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:21 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a016af6c-c363-47ee-8231-835a37b3b2bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:21 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abf559d-1c44-4571-afa0-e20d21dc54f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:21 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f301a6b-db41-4043-8815-0df9c7cf66fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:52:21 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:52:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:52:21 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:52:21 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a395729f-5ce4-4a95-8327-d9f993d9b56b]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:21 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:52:21 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:52:21 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:52:21 user nova-compute[71498]: DEBUG os_brick.utils [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:52:21 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Updating existing volume attachment record: 552eb2d1-8cf4-4fea-88fd-1f7f5222eb5b {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:52:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f162fd67-8976-4e74-a034-0e444e8c0dd7 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "74311da6-d6b8-4aea-b6ce-97db8da53800" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:52:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f162fd67-8976-4e74-a034-0e444e8c0dd7 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:52:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f162fd67-8976-4e74-a034-0e444e8c0dd7 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "74311da6-d6b8-4aea-b6ce-97db8da53800-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:52:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f162fd67-8976-4e74-a034-0e444e8c0dd7 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:52:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f162fd67-8976-4e74-a034-0e444e8c0dd7 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:52:22 user nova-compute[71498]: INFO nova.compute.manager [None req-f162fd67-8976-4e74-a034-0e444e8c0dd7 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Terminating instance
Apr 14 01:52:22 user nova-compute[71498]: DEBUG nova.compute.manager [None req-f162fd67-8976-4e74-a034-0e444e8c0dd7 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 01:52:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:22 user nova-compute[71498]: DEBUG nova.compute.manager [req-ca29b998-4751-403d-9f98-b2af3173c8cf req-4cf8f4a0-76c6-4043-bea2-5ec26fa02418 service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Received event network-vif-unplugged-20a227b0-3b4d-4df0-b583-071771a0ae44 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:52:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ca29b998-4751-403d-9f98-b2af3173c8cf req-4cf8f4a0-76c6-4043-bea2-5ec26fa02418 service nova] Acquiring lock "74311da6-d6b8-4aea-b6ce-97db8da53800-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:52:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ca29b998-4751-403d-9f98-b2af3173c8cf req-4cf8f4a0-76c6-4043-bea2-5ec26fa02418 service nova] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:52:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ca29b998-4751-403d-9f98-b2af3173c8cf req-4cf8f4a0-76c6-4043-bea2-5ec26fa02418 service nova] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:52:22 user nova-compute[71498]: DEBUG nova.compute.manager [req-ca29b998-4751-403d-9f98-b2af3173c8cf req-4cf8f4a0-76c6-4043-bea2-5ec26fa02418 service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] No waiting events found dispatching network-vif-unplugged-20a227b0-3b4d-4df0-b583-071771a0ae44 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:52:22 user nova-compute[71498]: DEBUG nova.compute.manager [req-ca29b998-4751-403d-9f98-b2af3173c8cf req-4cf8f4a0-76c6-4043-bea2-5ec26fa02418 service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Received event network-vif-unplugged-20a227b0-3b4d-4df0-b583-071771a0ae44 for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:52:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:22 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Instance destroyed successfully.
Apr 14 01:52:22 user nova-compute[71498]: DEBUG nova.objects.instance [None req-f162fd67-8976-4e74-a034-0e444e8c0dd7 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lazy-loading 'resources' on Instance uuid 74311da6-d6b8-4aea-b6ce-97db8da53800 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:52:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-f162fd67-8976-4e74-a034-0e444e8c0dd7 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:45:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-155633687',display_name='tempest-SnapshotDataIntegrityTests-server-155633687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-155633687',id=21,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFi1cj7WQkCRTINMDBTK4eWsn4iPECgZryQ4AqN8ZjRlsgtGzjrzAzp3MVZJ+8jfj3WNZWSvuGDFxF6nqqS8dsafPBU9+OLArIsc7EEDH73hlPbPglpvFtiACHZGMdbsdA==',key_name='tempest-SnapshotDataIntegrityTests-465819654',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:45:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='740488dbb5114fb2b38be20f8ce4adb0',ramdisk_id='',reservation_id='r-vzv7i33g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-919714320',owner_user_name='tempest-SnapshotDataIntegrityTests-919714320-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:45:55Z,user_data=None,user_id='34e25e45353e40b9a8bb14736c03fdeb',uuid=74311da6-d6b8-4aea-b6ce-97db8da53800,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20a227b0-3b4d-4df0-b583-071771a0ae44", "address": "fa:16:3e:c7:d7:5e", "network": {"id": "31f4b7e9-13bd-4aca-b6c3-a283c637ed63", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-802021657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "740488dbb5114fb2b38be20f8ce4adb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a227b0-3b", "ovs_interfaceid": "20a227b0-3b4d-4df0-b583-071771a0ae44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:52:22 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-f162fd67-8976-4e74-a034-0e444e8c0dd7 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Converting VIF {"id": "20a227b0-3b4d-4df0-b583-071771a0ae44", "address": "fa:16:3e:c7:d7:5e", "network": {"id": "31f4b7e9-13bd-4aca-b6c3-a283c637ed63", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-802021657-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "740488dbb5114fb2b38be20f8ce4adb0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a227b0-3b", "ovs_interfaceid": "20a227b0-3b4d-4df0-b583-071771a0ae44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:52:22 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-f162fd67-8976-4e74-a034-0e444e8c0dd7 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:d7:5e,bridge_name='br-int',has_traffic_filtering=True,id=20a227b0-3b4d-4df0-b583-071771a0ae44,network=Network(31f4b7e9-13bd-4aca-b6c3-a283c637ed63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20a227b0-3b') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:52:22 user nova-compute[71498]: DEBUG os_vif [None req-f162fd67-8976-4e74-a034-0e444e8c0dd7 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:d7:5e,bridge_name='br-int',has_traffic_filtering=True,id=20a227b0-3b4d-4df0-b583-071771a0ae44,network=Network(31f4b7e9-13bd-4aca-b6c3-a283c637ed63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20a227b0-3b') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:52:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20a227b0-3b, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:52:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:23 user nova-compute[71498]: INFO os_vif [None req-f162fd67-8976-4e74-a034-0e444e8c0dd7 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:d7:5e,bridge_name='br-int',has_traffic_filtering=True,id=20a227b0-3b4d-4df0-b583-071771a0ae44,network=Network(31f4b7e9-13bd-4aca-b6c3-a283c637ed63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20a227b0-3b')
Apr 14 01:52:23 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-f162fd67-8976-4e74-a034-0e444e8c0dd7 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Deleting instance files /opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800_del
Apr 14 01:52:23 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-f162fd67-8976-4e74-a034-0e444e8c0dd7 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Deletion of /opt/stack/data/nova/instances/74311da6-d6b8-4aea-b6ce-97db8da53800_del complete
Apr 14 01:52:23 user nova-compute[71498]: INFO nova.compute.manager [None req-f162fd67-8976-4e74-a034-0e444e8c0dd7 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Took 0.91 seconds to destroy the instance on the hypervisor.
Apr 14 01:52:23 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-f162fd67-8976-4e74-a034-0e444e8c0dd7 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 01:52:23 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 01:52:23 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 01:52:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:24 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:52:24 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Took 0.99 seconds to deallocate network for instance.
Apr 14 01:52:24 user nova-compute[71498]: DEBUG nova.compute.manager [req-8aa3c0ed-2183-4e18-a7c7-d9694b32af55 req-ef252fbe-aae5-447b-9b48-55ee45bb23c6 service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Received event network-vif-deleted-20a227b0-3b4d-4df0-b583-071771a0ae44 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:52:24 user nova-compute[71498]: INFO nova.compute.manager [req-8aa3c0ed-2183-4e18-a7c7-d9694b32af55 req-ef252fbe-aae5-447b-9b48-55ee45bb23c6 service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Neutron deleted interface 20a227b0-3b4d-4df0-b583-071771a0ae44; detaching it from the instance and deleting it from the info cache
Apr 14 01:52:24 user nova-compute[71498]: DEBUG nova.network.neutron [req-8aa3c0ed-2183-4e18-a7c7-d9694b32af55 req-ef252fbe-aae5-447b-9b48-55ee45bb23c6 service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:52:24 user nova-compute[71498]: DEBUG nova.compute.manager [req-8aa3c0ed-2183-4e18-a7c7-d9694b32af55 req-ef252fbe-aae5-447b-9b48-55ee45bb23c6 service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Detach interface failed, port_id=20a227b0-3b4d-4df0-b583-071771a0ae44, reason: Instance 74311da6-d6b8-4aea-b6ce-97db8da53800 could not be found. {{(pid=71498) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 01:52:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f162fd67-8976-4e74-a034-0e444e8c0dd7 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:52:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f162fd67-8976-4e74-a034-0e444e8c0dd7 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:52:24 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-f162fd67-8976-4e74-a034-0e444e8c0dd7 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:52:24 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-f162fd67-8976-4e74-a034-0e444e8c0dd7 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:52:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f162fd67-8976-4e74-a034-0e444e8c0dd7 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:52:24 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-f162fd67-8976-4e74-a034-0e444e8c0dd7 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Deleted allocations for instance 74311da6-d6b8-4aea-b6ce-97db8da53800
Apr 14 01:52:24 user nova-compute[71498]: DEBUG nova.compute.manager [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Received event network-vif-plugged-20a227b0-3b4d-4df0-b583-071771a0ae44 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:52:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] Acquiring lock "74311da6-d6b8-4aea-b6ce-97db8da53800-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:52:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:52:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:52:24 user nova-compute[71498]: DEBUG nova.compute.manager [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] No waiting events found dispatching network-vif-plugged-20a227b0-3b4d-4df0-b583-071771a0ae44 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:52:24 user nova-compute[71498]: WARNING nova.compute.manager [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Received unexpected event network-vif-plugged-20a227b0-3b4d-4df0-b583-071771a0ae44 for instance with vm_state deleted and task_state None.
Apr 14 01:52:24 user nova-compute[71498]: DEBUG nova.compute.manager [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Received event network-vif-plugged-20a227b0-3b4d-4df0-b583-071771a0ae44 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:52:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] Acquiring lock "74311da6-d6b8-4aea-b6ce-97db8da53800-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:52:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:52:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:52:24 user nova-compute[71498]: DEBUG nova.compute.manager [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] No waiting events found dispatching network-vif-plugged-20a227b0-3b4d-4df0-b583-071771a0ae44 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:52:24 user nova-compute[71498]: WARNING nova.compute.manager [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Received unexpected event network-vif-plugged-20a227b0-3b4d-4df0-b583-071771a0ae44 for instance with vm_state deleted and task_state None.
Apr 14 01:52:24 user nova-compute[71498]: DEBUG nova.compute.manager [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Received event network-vif-plugged-20a227b0-3b4d-4df0-b583-071771a0ae44 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:52:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] Acquiring lock "74311da6-d6b8-4aea-b6ce-97db8da53800-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:52:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:52:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:52:24 user nova-compute[71498]: DEBUG nova.compute.manager [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] No waiting events found dispatching network-vif-plugged-20a227b0-3b4d-4df0-b583-071771a0ae44 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:52:24 user nova-compute[71498]: WARNING nova.compute.manager [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Received unexpected event network-vif-plugged-20a227b0-3b4d-4df0-b583-071771a0ae44 for instance with vm_state deleted and task_state None.
Apr 14 01:52:24 user nova-compute[71498]: DEBUG nova.compute.manager [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Received event network-vif-unplugged-20a227b0-3b4d-4df0-b583-071771a0ae44 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:52:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] Acquiring lock "74311da6-d6b8-4aea-b6ce-97db8da53800-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:52:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:52:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:52:24 user nova-compute[71498]: DEBUG nova.compute.manager [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] No waiting events found dispatching network-vif-unplugged-20a227b0-3b4d-4df0-b583-071771a0ae44 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:52:24 user nova-compute[71498]: WARNING nova.compute.manager [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Received unexpected event network-vif-unplugged-20a227b0-3b4d-4df0-b583-071771a0ae44 for instance with vm_state deleted and task_state None.
Apr 14 01:52:24 user nova-compute[71498]: DEBUG nova.compute.manager [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Received event network-vif-plugged-20a227b0-3b4d-4df0-b583-071771a0ae44 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:52:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] Acquiring lock "74311da6-d6b8-4aea-b6ce-97db8da53800-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:52:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:52:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:52:24 user nova-compute[71498]: DEBUG nova.compute.manager [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] No waiting events found dispatching network-vif-plugged-20a227b0-3b4d-4df0-b583-071771a0ae44 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:52:24 user nova-compute[71498]: WARNING nova.compute.manager [req-eff05f86-7108-44bc-bcc3-d3a3b57bf484 req-c20d5091-2d89-4cae-bb2d-c6c4ad8f7fbf service nova] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Received unexpected event network-vif-plugged-20a227b0-3b4d-4df0-b583-071771a0ae44 for instance with vm_state deleted and task_state None.
Apr 14 01:52:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f162fd67-8976-4e74-a034-0e444e8c0dd7 tempest-SnapshotDataIntegrityTests-919714320 tempest-SnapshotDataIntegrityTests-919714320-project-member] Lock "74311da6-d6b8-4aea-b6ce-97db8da53800" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.460s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG nova.compute.manager [req-f0827b4e-3c1d-485a-a4ad-0cc763db3a54 req-69b7ae43-2d8b-419c-a793-a30b02dde88f service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Received event network-changed-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG nova.compute.manager [req-f0827b4e-3c1d-485a-a4ad-0cc763db3a54 req-69b7ae43-2d8b-419c-a793-a30b02dde88f service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Refreshing instance network info cache due to event network-changed-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f0827b4e-3c1d-485a-a4ad-0cc763db3a54 req-69b7ae43-2d8b-419c-a793-a30b02dde88f service nova] Acquiring lock "refresh_cache-85b399dc-62df-480d-8561-5d9d1ab75c52" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f0827b4e-3c1d-485a-a4ad-0cc763db3a54 req-69b7ae43-2d8b-419c-a793-a30b02dde88f service nova] Acquired lock "refresh_cache-85b399dc-62df-480d-8561-5d9d1ab75c52" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG nova.network.neutron [req-f0827b4e-3c1d-485a-a4ad-0cc763db3a54 req-69b7ae43-2d8b-419c-a793-a30b02dde88f service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Refreshing network info cache for port e31ffaf4-6b2b-4099-88b5-683bc51ccfdf {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG nova.network.neutron [req-f0827b4e-3c1d-485a-a4ad-0cc763db3a54 req-69b7ae43-2d8b-419c-a793-a30b02dde88f service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Updated VIF entry in instance network info cache for port e31ffaf4-6b2b-4099-88b5-683bc51ccfdf. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG nova.network.neutron [req-f0827b4e-3c1d-485a-a4ad-0cc763db3a54 req-69b7ae43-2d8b-419c-a793-a30b02dde88f service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Updating instance_info_cache with network_info: [{"id": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "address": "fa:16:3e:c2:1d:7f", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31ffaf4-6b", "ovs_interfaceid": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f0827b4e-3c1d-485a-a4ad-0cc763db3a54 req-69b7ae43-2d8b-419c-a793-a30b02dde88f service nova] Releasing lock "refresh_cache-85b399dc-62df-480d-8561-5d9d1ab75c52" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:52:26 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Creating image(s)
Apr 14 01:52:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Did not create local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Ensure instance console log exists: /opt/stack/data/nova/instances/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Start _get_guest_xml network_info=[{"id": "6568fde8-2639-4cee-8527-e3ca028f42fd", "address": "fa:16:3e:69:f8:89", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6568fde8-26", "ovs_interfaceid": "6568fde8-2639-4cee-8527-e3ca028f42fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '552eb2d1-8cf4-4fea-88fd-1f7f5222eb5b', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AUTEzbSm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7ff438f4-54e1-44b9-bb5a-1b42d48a37ed', 'attached_at': '', 'detached_at': '', 'volume_id': '2f2f2823-8b6e-49ae-ad4e-ed05a02421ae', 'serial': '2f2f2823-8b6e-49ae-ad4e-ed05a02421ae'}, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:52:26 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:52:26 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:52:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AUTEzbSm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:52:26 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:52:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:52:26 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:52:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:52:26 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:52:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77ba779-1a5a-4921-8a1c-31613e300b61]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:52:26 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bcb2dc-b222-4400-b810-734ddc316f9d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae] added
Apr 14 01:52:26 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b074e02-a71d-475e-a3cb-de5a08db525f]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3652fec-ea8f-4630-9c47-33e8dcfb1ec7]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AUTEzbSm {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AUTEzbSm" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bf59d3-38f4-44fe-b948-8687fe2fcd80]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AUTEzbSm'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e9541d-4ea0-43c2-abfb-e89c49a40ee4]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b85f49-b512-4d63-9055-4087711d3a6a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:52:26 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:52:26 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "85b399dc-62df-480d-8561-5d9d1ab75c52" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:52:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG nova.objects.instance [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'flavor' on Instance uuid 85b399dc-62df-480d-8561-5d9d1ab75c52 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9adda7-cbc7-4c28-bd56-3b2ac0708eed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae, portal: 172.16.0.220,3260]
Apr 14 01:52:27 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae, portal: 172.16.0.220,3260] successful.
Apr 14 01:52:27 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48f97c2-cf7d-4649-a687-fe89256fda86]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[643b36f5-e05e-4e62-8b98-a20cbf4703f2]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:52:27 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:52:27 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:52:27 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:52:27 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9bfead-6f88-4dc8-919f-23d5b73721a3]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AUTEzbSm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "85b399dc-62df-480d-8561-5d9d1ab75c52" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:52:27 user nova-compute[71498]: INFO nova.compute.manager [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Attaching volume 4d2a082d-59f8-4081-9ace-fc3ae1219b10 to /dev/vdb
Apr 14 01:52:27 user nova-compute[71498]: DEBUG os_brick.utils [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7673a7c7-fe5a-4856-9090-4218ed9eaef6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fc1268-e0b0-414f-aca5-67f209c67e93]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5334e5-d980-4823-a3d8-de6e4fb29414]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2f76b8-bef7-41d5-8bb4-d3e9ed75b0d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:52:27 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:52:27 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f29a3f8-f348-4661-aa7d-cf00b1952ff7]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG os_brick.utils [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Updating existing volume attachment record: 3aa66fd4-3a21-4583-b2fb-ccf9bc8e7387 {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:52:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23166633433633965', 'path': '/dev/sdc'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:52:28 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166633433633965', 'path': '/dev/sdc'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:52:28 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:52:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-831752770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-831752770',id=28,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='219c39c8299e46368012a947fdfbe5fd',ramdisk_id='',reservation_id='r-h4xgnsfu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-85797606',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:52:16Z,user_data=None,user_id='7ed01a83531f4c6bb18a4593284baf05',uuid=7ff438f4-54e1-44b9-bb5a-1b42d48a37ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6568fde8-2639-4cee-8527-e3ca028f42fd", "address": "fa:16:3e:69:f8:89", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6568fde8-26", "ovs_interfaceid": "6568fde8-2639-4cee-8527-e3ca028f42fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:52:28 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Converting VIF {"id": "6568fde8-2639-4cee-8527-e3ca028f42fd", "address": "fa:16:3e:69:f8:89", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6568fde8-26", "ovs_interfaceid": "6568fde8-2639-4cee-8527-e3ca028f42fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:52:28 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:f8:89,bridge_name='br-int',has_traffic_filtering=True,id=6568fde8-2639-4cee-8527-e3ca028f42fd,network=Network(365cbeec-3756-4258-a135-04112bdda4b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6568fde8-26') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:52:28 user nova-compute[71498]: DEBUG nova.objects.instance [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:52:28 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:52:28 user nova-compute[71498]:   <uuid>7ff438f4-54e1-44b9-bb5a-1b42d48a37ed</uuid>
Apr 14 01:52:28 user nova-compute[71498]:   <name>instance-0000001c</name>
Apr 14 01:52:28 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:52:28 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:52:28 user nova-compute[71498]:   <metadata>
Apr 14 01:52:28 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:52:28 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:52:28 user nova-compute[71498]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-831752770</nova:name>
Apr 14 01:52:28 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:52:26</nova:creationTime>
Apr 14 01:52:28 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:52:28 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:52:28 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:52:28 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:52:28 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:52:28 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:52:28 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:52:28 user nova-compute[71498]:       <nova:owner>
Apr 14 01:52:28 user nova-compute[71498]:         <nova:user uuid="7ed01a83531f4c6bb18a4593284baf05">tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member</nova:user>
Apr 14 01:52:28 user nova-compute[71498]:         <nova:project uuid="219c39c8299e46368012a947fdfbe5fd">tempest-ServerBootFromVolumeStableRescueTest-85797606</nova:project>
Apr 14 01:52:28 user nova-compute[71498]:       </nova:owner>
Apr 14 01:52:28 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:52:28 user nova-compute[71498]:       <nova:ports>
Apr 14 01:52:28 user nova-compute[71498]:         <nova:port uuid="6568fde8-2639-4cee-8527-e3ca028f42fd">
Apr 14 01:52:28 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 01:52:28 user nova-compute[71498]:         </nova:port>
Apr 14 01:52:28 user nova-compute[71498]:       </nova:ports>
Apr 14 01:52:28 user nova-compute[71498]:     </nova:instance>
Apr 14 01:52:28 user nova-compute[71498]:   </metadata>
Apr 14 01:52:28 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:52:28 user nova-compute[71498]:     <system>
Apr 14 01:52:28 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:52:28 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:52:28 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:52:28 user nova-compute[71498]:       <entry name="serial">7ff438f4-54e1-44b9-bb5a-1b42d48a37ed</entry>
Apr 14 01:52:28 user nova-compute[71498]:       <entry name="uuid">7ff438f4-54e1-44b9-bb5a-1b42d48a37ed</entry>
Apr 14 01:52:28 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:52:28 user nova-compute[71498]:     </system>
Apr 14 01:52:28 user nova-compute[71498]:   </sysinfo>
Apr 14 01:52:28 user nova-compute[71498]:   <os>
Apr 14 01:52:28 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:52:28 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:52:28 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:52:28 user nova-compute[71498]:   </os>
Apr 14 01:52:28 user nova-compute[71498]:   <features>
Apr 14 01:52:28 user nova-compute[71498]:     <acpi/>
Apr 14 01:52:28 user nova-compute[71498]:     <apic/>
Apr 14 01:52:28 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:52:28 user nova-compute[71498]:   </features>
Apr 14 01:52:28 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:52:28 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:52:28 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:52:28 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:52:28 user nova-compute[71498]:   </clock>
Apr 14 01:52:28 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:52:28 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:52:28 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:52:28 user nova-compute[71498]:   </cpu>
Apr 14 01:52:28 user nova-compute[71498]:   <devices>
Apr 14 01:52:28 user nova-compute[71498]:     <disk type="block" device="disk">
Apr 14 01:52:28 user nova-compute[71498]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:52:28 user nova-compute[71498]:       <source dev="/dev/sdc"/>
Apr 14 01:52:28 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:52:28 user nova-compute[71498]:       <serial>2f2f2823-8b6e-49ae-ad4e-ed05a02421ae</serial>
Apr 14 01:52:28 user nova-compute[71498]:     </disk>
Apr 14 01:52:28 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:52:28 user nova-compute[71498]:       <mac address="fa:16:3e:69:f8:89"/>
Apr 14 01:52:28 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:52:28 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:52:28 user nova-compute[71498]:       <target dev="tap6568fde8-26"/>
Apr 14 01:52:28 user nova-compute[71498]:     </interface>
Apr 14 01:52:28 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:52:28 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed/console.log" append="off"/>
Apr 14 01:52:28 user nova-compute[71498]:     </serial>
Apr 14 01:52:28 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:52:28 user nova-compute[71498]:     <video>
Apr 14 01:52:28 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:52:28 user nova-compute[71498]:     </video>
Apr 14 01:52:28 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:52:28 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:52:28 user nova-compute[71498]:     </rng>
Apr 14 01:52:28 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:52:28 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:52:28 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:52:28 user nova-compute[71498]:     </memballoon>
Apr 14 01:52:28 user nova-compute[71498]:   </devices>
Apr 14 01:52:28 user nova-compute[71498]: </domain>
Apr 14 01:52:28 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:52:28 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:52:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-831752770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-831752770',id=28,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='219c39c8299e46368012a947fdfbe5fd',ramdisk_id='',reservation_id='r-h4xgnsfu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-85797606',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:52:16Z,user_data=None,user_id='7ed01a83531f4c6bb18a4593284baf05',uuid=7ff438f4-54e1-44b9-bb5a-1b42d48a37ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6568fde8-2639-4cee-8527-e3ca028f42fd", "address": "fa:16:3e:69:f8:89", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6568fde8-26", "ovs_interfaceid": "6568fde8-2639-4cee-8527-e3ca028f42fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:52:28 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Converting VIF {"id": "6568fde8-2639-4cee-8527-e3ca028f42fd", "address": "fa:16:3e:69:f8:89", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6568fde8-26", "ovs_interfaceid": "6568fde8-2639-4cee-8527-e3ca028f42fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:52:28 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:f8:89,bridge_name='br-int',has_traffic_filtering=True,id=6568fde8-2639-4cee-8527-e3ca028f42fd,network=Network(365cbeec-3756-4258-a135-04112bdda4b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6568fde8-26') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:52:28 user nova-compute[71498]: DEBUG os_vif [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:f8:89,bridge_name='br-int',has_traffic_filtering=True,id=6568fde8-2639-4cee-8527-e3ca028f42fd,network=Network(365cbeec-3756-4258-a135-04112bdda4b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6568fde8-26') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:52:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:52:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:52:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6568fde8-26, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:52:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6568fde8-26, col_values=(('external_ids', {'iface-id': '6568fde8-2639-4cee-8527-e3ca028f42fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:f8:89', 'vm-uuid': '7ff438f4-54e1-44b9-bb5a-1b42d48a37ed'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:52:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:52:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:28 user nova-compute[71498]: INFO os_vif [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:f8:89,bridge_name='br-int',has_traffic_filtering=True,id=6568fde8-2639-4cee-8527-e3ca028f42fd,network=Network(365cbeec-3756-4258-a135-04112bdda4b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6568fde8-26')
Apr 14 01:52:28 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:52:28 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] No VIF found with MAC fa:16:3e:69:f8:89, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:52:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:29 user nova-compute[71498]: DEBUG nova.compute.manager [req-b81b03d1-eeb3-4bb7-a1d5-b4d48e5ef18d req-53200f8c-e8c9-41bf-aa3a-4bc7c57f5198 service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Received event network-vif-plugged-6568fde8-2639-4cee-8527-e3ca028f42fd {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:52:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b81b03d1-eeb3-4bb7-a1d5-b4d48e5ef18d req-53200f8c-e8c9-41bf-aa3a-4bc7c57f5198 service nova] Acquiring lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:52:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b81b03d1-eeb3-4bb7-a1d5-b4d48e5ef18d req-53200f8c-e8c9-41bf-aa3a-4bc7c57f5198 service nova] Lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:52:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b81b03d1-eeb3-4bb7-a1d5-b4d48e5ef18d req-53200f8c-e8c9-41bf-aa3a-4bc7c57f5198 service nova] Lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:52:29 user nova-compute[71498]: DEBUG nova.compute.manager [req-b81b03d1-eeb3-4bb7-a1d5-b4d48e5ef18d req-53200f8c-e8c9-41bf-aa3a-4bc7c57f5198 service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] No waiting events found dispatching network-vif-plugged-6568fde8-2639-4cee-8527-e3ca028f42fd {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:52:29 user nova-compute[71498]: WARNING nova.compute.manager [req-b81b03d1-eeb3-4bb7-a1d5-b4d48e5ef18d req-53200f8c-e8c9-41bf-aa3a-4bc7c57f5198 service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Received unexpected event network-vif-plugged-6568fde8-2639-4cee-8527-e3ca028f42fd for instance with vm_state building and task_state spawning.
Apr 14 01:52:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:31 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437151.8027902, 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:52:31 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] VM Resumed (Lifecycle Event)
Apr 14 01:52:31 user nova-compute[71498]: DEBUG nova.compute.manager [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:52:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:52:31 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Instance spawned successfully.
Apr 14 01:52:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:52:31 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:52:31 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:52:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:52:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:52:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:52:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:52:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:52:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:52:31 user nova-compute[71498]: DEBUG nova.compute.manager [req-8a373b64-90a2-4431-bc05-a5ad9af87116 req-32920c4b-62ef-4854-8b99-7e43b4d4cc34 service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Received event network-vif-plugged-6568fde8-2639-4cee-8527-e3ca028f42fd {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:52:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8a373b64-90a2-4431-bc05-a5ad9af87116 req-32920c4b-62ef-4854-8b99-7e43b4d4cc34 service nova] Acquiring lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:52:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8a373b64-90a2-4431-bc05-a5ad9af87116 req-32920c4b-62ef-4854-8b99-7e43b4d4cc34 service nova] Lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:52:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8a373b64-90a2-4431-bc05-a5ad9af87116 req-32920c4b-62ef-4854-8b99-7e43b4d4cc34 service nova] Lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:52:31 user nova-compute[71498]: DEBUG nova.compute.manager [req-8a373b64-90a2-4431-bc05-a5ad9af87116 req-32920c4b-62ef-4854-8b99-7e43b4d4cc34 service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] No waiting events found dispatching network-vif-plugged-6568fde8-2639-4cee-8527-e3ca028f42fd {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:52:31 user nova-compute[71498]: WARNING nova.compute.manager [req-8a373b64-90a2-4431-bc05-a5ad9af87116 req-32920c4b-62ef-4854-8b99-7e43b4d4cc34 service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Received unexpected event network-vif-plugged-6568fde8-2639-4cee-8527-e3ca028f42fd for instance with vm_state building and task_state spawning.
Apr 14 01:52:31 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:52:31 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437151.8064308, 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:52:31 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] VM Started (Lifecycle Event)
Apr 14 01:52:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:52:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'txGYAkUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:52:31 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:52:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:52:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:52:31 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:52:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:52:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:52:31 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:52:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:31 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83817f6-0e91-42da-87ce-7af39cf8a8fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:32 user nova-compute[71498]: INFO nova.compute.manager [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Took 5.45 seconds to spawn the instance on the hypervisor.
Apr 14 01:52:32 user nova-compute[71498]: DEBUG nova.compute.manager [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:52:32 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38ff285-62df-4cf9-baab-70f668660b8b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10] added
Apr 14 01:52:32 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:32 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:52:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3c305b-046c-4e17-a31f-5ba20a92d488]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[518cfaee-337f-4949-9d7c-67e94f87b228]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v txGYAkUr {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v txGYAkUr" returned: 0 in 0.028s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[653d1f73-cadf-4711-a10a-269f63ecaefa]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'txGYAkUr'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:32 user nova-compute[71498]: INFO nova.compute.manager [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Took 16.80 seconds to build instance.
Apr 14 01:52:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6329ad-959c-479c-98d0-6f5c44538372]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2ea067a1-94a3-40e4-bd9c-b1d125585546 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.908s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a3de19-72f7-4886-b121-6db63fa4c2ee]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:52:32 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:52:32 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:52:32 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:52:32 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5a9eb2-98c4-4d4b-9dc1-ae5f67737a2f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10, portal: 172.16.0.220,3260]
Apr 14 01:52:32 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10, portal: 172.16.0.220,3260] successful.
Apr 14 01:52:32 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[607eb68e-c6a6-4cd8-b38c-1e40083d7a2c]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f0ef9f-d3eb-4f7a-99b9-af0167a31371]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:52:32 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:52:32 user nova-compute[71498]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:52:32 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:52:32 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:52:32 user nova-compute[71498]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:52:32 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.668s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f9b95c-0237-4f4f-b6d7-f3dac0bc5672]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'txGYAkUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:52:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.705s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:52:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] <== connect_volume: return (1708ms) {'type': 'block', 'scsi_wwn': '23135376331363361', 'path': '/dev/sdd'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:52:33 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135376331363361', 'path': '/dev/sdd'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:52:33 user nova-compute[71498]: DEBUG nova.objects.instance [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'flavor' on Instance uuid 85b399dc-62df-480d-8561-5d9d1ab75c52 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:52:33 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 01:52:33 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:52:33 user nova-compute[71498]:   <source dev="/dev/sdd"/>
Apr 14 01:52:33 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:52:33 user nova-compute[71498]:   <serial>4d2a082d-59f8-4081-9ace-fc3ae1219b10</serial>
Apr 14 01:52:33 user nova-compute[71498]: </disk>
Apr 14 01:52:33 user nova-compute[71498]:  {{(pid=71498) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 01:52:34 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:52:34 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:52:34 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] No VIF found with MAC fa:16:3e:c2:1d:7f, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:52:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d1f68cdb-d8e6-46aa-a9d3-a457e7c3301a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.131s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:52:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3030da32-4348-420a-911b-d86709acd2f5 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "85b399dc-62df-480d-8561-5d9d1ab75c52" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:52:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3030da32-4348-420a-911b-d86709acd2f5 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:52:34 user nova-compute[71498]: DEBUG nova.compute.manager [None req-3030da32-4348-420a-911b-d86709acd2f5 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:52:34 user nova-compute[71498]: DEBUG nova.compute.manager [None req-3030da32-4348-420a-911b-d86709acd2f5 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71498) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 14 01:52:34 user nova-compute[71498]: DEBUG nova.objects.instance [None req-3030da32-4348-420a-911b-d86709acd2f5 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'flavor' on Instance uuid 85b399dc-62df-480d-8561-5d9d1ab75c52 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:52:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:35 user nova-compute[71498]: DEBUG nova.compute.manager [req-c38787ec-533c-4a3d-a32c-449bd7e837d6 req-23ddbd17-294c-40d2-bb79-75f097d422fb service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Received event network-vif-unplugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:52:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c38787ec-533c-4a3d-a32c-449bd7e837d6 req-23ddbd17-294c-40d2-bb79-75f097d422fb service nova] Acquiring lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:52:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c38787ec-533c-4a3d-a32c-449bd7e837d6 req-23ddbd17-294c-40d2-bb79-75f097d422fb service nova] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:52:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c38787ec-533c-4a3d-a32c-449bd7e837d6 req-23ddbd17-294c-40d2-bb79-75f097d422fb service nova] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:52:35 user nova-compute[71498]: DEBUG nova.compute.manager [req-c38787ec-533c-4a3d-a32c-449bd7e837d6 req-23ddbd17-294c-40d2-bb79-75f097d422fb service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] No waiting events found dispatching network-vif-unplugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:52:35 user nova-compute[71498]: WARNING nova.compute.manager [req-c38787ec-533c-4a3d-a32c-449bd7e837d6 req-23ddbd17-294c-40d2-bb79-75f097d422fb service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Received unexpected event network-vif-unplugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf for instance with vm_state active and task_state powering-off.
Apr 14 01:52:35 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:52:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:52:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:52:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:52:35 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 01:52:35 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Instance destroyed successfully.
Apr 14 01:52:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-3030da32-4348-420a-911b-d86709acd2f5 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:52:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-3030da32-4348-420a-911b-d86709acd2f5 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.874s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:52:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:52:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:52:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:37 user nova-compute[71498]: DEBUG nova.compute.manager [req-110cb192-4530-4135-af9c-4190f6b3b554 req-0c732d3a-2250-48fb-bb76-fab262655336 service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Received event network-vif-plugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:52:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-110cb192-4530-4135-af9c-4190f6b3b554 req-0c732d3a-2250-48fb-bb76-fab262655336 service nova] Acquiring lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:52:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-110cb192-4530-4135-af9c-4190f6b3b554 req-0c732d3a-2250-48fb-bb76-fab262655336 service nova] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:52:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-110cb192-4530-4135-af9c-4190f6b3b554 req-0c732d3a-2250-48fb-bb76-fab262655336 service nova] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:52:37 user nova-compute[71498]: DEBUG nova.compute.manager [req-110cb192-4530-4135-af9c-4190f6b3b554 req-0c732d3a-2250-48fb-bb76-fab262655336 service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] No waiting events found dispatching network-vif-plugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:52:37 user nova-compute[71498]: WARNING nova.compute.manager [req-110cb192-4530-4135-af9c-4190f6b3b554 req-0c732d3a-2250-48fb-bb76-fab262655336 service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Received unexpected event network-vif-plugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf for instance with vm_state stopped and task_state None.
Apr 14 01:52:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:52:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:37 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681437142.950071, 74311da6-d6b8-4aea-b6ce-97db8da53800 => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:52:37 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] VM Stopped (Lifecycle Event)
Apr 14 01:52:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:37 user nova-compute[71498]: DEBUG nova.compute.manager [None req-2c16730b-086a-4366-88e3-5a73c3daf322 None None] [instance: 74311da6-d6b8-4aea-b6ce-97db8da53800] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:52:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:38 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:52:38 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:52:38 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=8210MB free_disk=26.254329681396484GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 01:52:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:52:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:52:38 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:52:38 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:52:38 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance a19a1c08-5454-481b-bb5a-70c39ead9afc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:52:38 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance fa29c144-0ff9-4efb-a574-f521d18f08fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:52:38 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:52:38 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance ae82789e-1bed-419b-a580-68ff7ed03ef2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:52:38 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 85b399dc-62df-480d-8561-5d9d1ab75c52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:52:38 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:52:38 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 01:52:38 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 01:52:38 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:52:38 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:52:38 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 01:52:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.369s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:52:40 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:52:40 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 01:52:40 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Didn't find any instances for network info cache update. {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 01:52:40 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:52:40 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:52:40 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:52:42 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:52:42 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:52:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:43 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:52:43 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 01:52:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:44 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:52:44 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:52:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:50 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681437155.7621028, 85b399dc-62df-480d-8561-5d9d1ab75c52 => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:52:50 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] VM Stopped (Lifecycle Event)
Apr 14 01:52:50 user nova-compute[71498]: DEBUG nova.compute.manager [None req-a593d04a-fe72-4cef-a3d9-79574e070f89 None None] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:52:50 user nova-compute[71498]: DEBUG nova.compute.manager [None req-a593d04a-fe72-4cef-a3d9-79574e070f89 None None] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:52:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:52:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:52:54 user nova-compute[71498]: INFO nova.compute.manager [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Unshelving
Apr 14 01:52:54 user nova-compute[71498]: INFO nova.virt.block_device [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Booting with volume 26c6e12f-4381-4acd-a6e5-a979a6886f25 at /dev/vdc
Apr 14 01:52:54 user nova-compute[71498]: DEBUG os_brick.utils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:52:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:54 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a112a5c-997c-47a5-9eda-7e38c6d11525]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:54 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87e11c0-e502-4993-a17d-2b13ef820587]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:52:54 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8635b5-4f08-4328-ad5c-71e53ca0754f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:54 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e332ebdb-c54d-4846-8da0-85750f4f6bcc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:52:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:52:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:52:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:52:54 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:52:54 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b04966-91fe-4dd5-9113-3ab979db6df4]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:52:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:52:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:52:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:52:54 user nova-compute[71498]: DEBUG os_brick.utils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:52:54 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Updating existing volume attachment record: 305d36e4-5d4d-4f36-b6f3-a03def2532bf {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:52:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:52:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:52:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:52:59 user nova-compute[71498]: DEBUG nova.objects.instance [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lazy-loading 'pci_requests' on Instance uuid 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:52:59 user nova-compute[71498]: DEBUG nova.objects.instance [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lazy-loading 'numa_topology' on Instance uuid 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:52:59 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:52:59 user nova-compute[71498]: INFO nova.compute.claims [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Claim successful on node user
Apr 14 01:52:59 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:52:59 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:52:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:52:59 user nova-compute[71498]: INFO nova.network.neutron [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Updating port db433bb1-8c59-4e6b-ae87-f6fab836df0f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 14 01:53:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "refresh_cache-18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:53:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquired lock "refresh_cache-18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:53:00 user nova-compute[71498]: DEBUG nova.network.neutron [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:53:00 user nova-compute[71498]: DEBUG nova.compute.manager [req-05efd6d1-bae2-4358-bb94-a2e4afb9ce56 req-32f01535-c8f5-42d4-8e74-f5d6ab23298b service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Received event network-changed-db433bb1-8c59-4e6b-ae87-f6fab836df0f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:53:00 user nova-compute[71498]: DEBUG nova.compute.manager [req-05efd6d1-bae2-4358-bb94-a2e4afb9ce56 req-32f01535-c8f5-42d4-8e74-f5d6ab23298b service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Refreshing instance network info cache due to event network-changed-db433bb1-8c59-4e6b-ae87-f6fab836df0f. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:53:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-05efd6d1-bae2-4358-bb94-a2e4afb9ce56 req-32f01535-c8f5-42d4-8e74-f5d6ab23298b service nova] Acquiring lock "refresh_cache-18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:53:01 user nova-compute[71498]: DEBUG nova.network.neutron [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Updating instance_info_cache with network_info: [{"id": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "address": "fa:16:3e:d5:f1:51", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb433bb1-8c", "ovs_interfaceid": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:53:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Releasing lock "refresh_cache-18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:53:01 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:53:01 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Creating image(s)
Apr 14 01:53:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "/opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:53:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "/opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:53:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "/opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:53:01 user nova-compute[71498]: DEBUG nova.objects.instance [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lazy-loading 'trusted_certs' on Instance uuid 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:53:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-05efd6d1-bae2-4358-bb94-a2e4afb9ce56 req-32f01535-c8f5-42d4-8e74-f5d6ab23298b service nova] Acquired lock "refresh_cache-18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:53:01 user nova-compute[71498]: DEBUG nova.network.neutron [req-05efd6d1-bae2-4358-bb94-a2e4afb9ce56 req-32f01535-c8f5-42d4-8e74-f5d6ab23298b service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Refreshing network info cache for port db433bb1-8c59-4e6b-ae87-f6fab836df0f {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:53:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "785d099e7e7a771ffb63981c950f57d8802827a2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:53:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "785d099e7e7a771ffb63981c950f57d8802827a2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:53:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/785d099e7e7a771ffb63981c950f57d8802827a2.part --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/785d099e7e7a771ffb63981c950f57d8802827a2.part --force-share --output=json" returned: 0 in 0.143s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:02 user nova-compute[71498]: DEBUG nova.virt.images [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 9449b6a2-115f-4228-8d3c-236393420350 was qcow2, converting to raw {{(pid=71498) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 01:53:02 user nova-compute[71498]: DEBUG nova.privsep.utils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71498) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 01:53:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/785d099e7e7a771ffb63981c950f57d8802827a2.part /opt/stack/data/nova/instances/_base/785d099e7e7a771ffb63981c950f57d8802827a2.converted {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "410c2004-b2c8-4274-b1d3-9b48585c644f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:53:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "410c2004-b2c8-4274-b1d3-9b48585c644f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:53:02 user nova-compute[71498]: DEBUG nova.compute.manager [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 01:53:02 user nova-compute[71498]: DEBUG nova.network.neutron [req-05efd6d1-bae2-4358-bb94-a2e4afb9ce56 req-32f01535-c8f5-42d4-8e74-f5d6ab23298b service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Updated VIF entry in instance network info cache for port db433bb1-8c59-4e6b-ae87-f6fab836df0f. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:53:02 user nova-compute[71498]: DEBUG nova.network.neutron [req-05efd6d1-bae2-4358-bb94-a2e4afb9ce56 req-32f01535-c8f5-42d4-8e74-f5d6ab23298b service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Updating instance_info_cache with network_info: [{"id": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "address": "fa:16:3e:d5:f1:51", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb433bb1-8c", "ovs_interfaceid": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:53:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-05efd6d1-bae2-4358-bb94-a2e4afb9ce56 req-32f01535-c8f5-42d4-8e74-f5d6ab23298b service nova] Releasing lock "refresh_cache-18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:53:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/785d099e7e7a771ffb63981c950f57d8802827a2.part /opt/stack/data/nova/instances/_base/785d099e7e7a771ffb63981c950f57d8802827a2.converted" returned: 0 in 0.407s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/785d099e7e7a771ffb63981c950f57d8802827a2.converted --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:53:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:53:02 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:53:02 user nova-compute[71498]: INFO nova.compute.claims [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Claim successful on node user
Apr 14 01:53:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/785d099e7e7a771ffb63981c950f57d8802827a2.converted --force-share --output=json" returned: 0 in 0.236s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "785d099e7e7a771ffb63981c950f57d8802827a2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.760s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/785d099e7e7a771ffb63981c950f57d8802827a2 --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/785d099e7e7a771ffb63981c950f57d8802827a2 --force-share --output=json" returned: 0 in 0.148s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "785d099e7e7a771ffb63981c950f57d8802827a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "785d099e7e7a771ffb63981c950f57d8802827a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/785d099e7e7a771ffb63981c950f57d8802827a2 --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/785d099e7e7a771ffb63981c950f57d8802827a2 --force-share --output=json" returned: 0 in 0.137s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/785d099e7e7a771ffb63981c950f57d8802827a2,backing_fmt=raw /opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/785d099e7e7a771ffb63981c950f57d8802827a2,backing_fmt=raw /opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk 1073741824" returned: 0 in 0.055s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "785d099e7e7a771ffb63981c950f57d8802827a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/785d099e7e7a771ffb63981c950f57d8802827a2 --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.631s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG nova.compute.manager [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/785d099e7e7a771ffb63981c950f57d8802827a2 --force-share --output=json" returned: 0 in 0.132s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG nova.objects.instance [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lazy-loading 'migration_context' on Instance uuid 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG nova.compute.manager [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG nova.network.neutron [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:53:03 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Rebasing disk image.
Apr 14 01:53:03 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:03 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 01:53:03 user nova-compute[71498]: DEBUG nova.compute.manager [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG nova.policy [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50e3354ac1a84c59a7dee8e1ae6e771a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f4117a4adb4aa3b42951cf1fc84237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.144s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab -F raw /opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:03 user nova-compute[71498]: INFO nova.virt.block_device [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Booting with volume 450914a2-96ae-4c21-a717-2b391be59860 at /dev/vda
Apr 14 01:53:03 user nova-compute[71498]: DEBUG os_brick.utils [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7148dfc-c730-4b87-9f5e-09a591ceba9e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9d7a36-2413-4716-8bb0-e971ff9f7b3b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbe29d4-0dcb-449e-9fee-6788a5e88d87]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf060fa-a84c-4c05-99f9-09d661be7d12]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:53:03 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:53:03 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6316c789-b713-458f-9eaa-355203e11ff0]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG os_brick.utils [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:53:03 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Updating existing volume attachment record: 9c1b7e06-3262-4333-9a68-96d7ee34a919 {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:53:04 user nova-compute[71498]: DEBUG nova.network.neutron [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Successfully created port: 369a4435-3639-47bc-8a63-1c6c3f25df9b {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:53:05 user nova-compute[71498]: DEBUG nova.network.neutron [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Successfully updated port: 369a4435-3639-47bc-8a63-1c6c3f25df9b {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:53:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "refresh_cache-410c2004-b2c8-4274-b1d3-9b48585c644f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:53:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquired lock "refresh_cache-410c2004-b2c8-4274-b1d3-9b48585c644f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:53:05 user nova-compute[71498]: DEBUG nova.network.neutron [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:53:05 user nova-compute[71498]: DEBUG nova.compute.manager [req-a576fe29-13a2-4fa2-aa67-e324b1c1ec03 req-e3cda03f-5fbf-4cff-85f0-f80082d8025b service nova] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Received event network-changed-369a4435-3639-47bc-8a63-1c6c3f25df9b {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:53:05 user nova-compute[71498]: DEBUG nova.compute.manager [req-a576fe29-13a2-4fa2-aa67-e324b1c1ec03 req-e3cda03f-5fbf-4cff-85f0-f80082d8025b service nova] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Refreshing instance network info cache due to event network-changed-369a4435-3639-47bc-8a63-1c6c3f25df9b. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:53:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a576fe29-13a2-4fa2-aa67-e324b1c1ec03 req-e3cda03f-5fbf-4cff-85f0-f80082d8025b service nova] Acquiring lock "refresh_cache-410c2004-b2c8-4274-b1d3-9b48585c644f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:53:05 user nova-compute[71498]: DEBUG nova.network.neutron [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG nova.network.neutron [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Updating instance_info_cache with network_info: [{"id": "369a4435-3639-47bc-8a63-1c6c3f25df9b", "address": "fa:16:3e:98:19:b2", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap369a4435-36", "ovs_interfaceid": "369a4435-3639-47bc-8a63-1c6c3f25df9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Releasing lock "refresh_cache-410c2004-b2c8-4274-b1d3-9b48585c644f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG nova.compute.manager [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Instance network_info: |[{"id": "369a4435-3639-47bc-8a63-1c6c3f25df9b", "address": "fa:16:3e:98:19:b2", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap369a4435-36", "ovs_interfaceid": "369a4435-3639-47bc-8a63-1c6c3f25df9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a576fe29-13a2-4fa2-aa67-e324b1c1ec03 req-e3cda03f-5fbf-4cff-85f0-f80082d8025b service nova] Acquired lock "refresh_cache-410c2004-b2c8-4274-b1d3-9b48585c644f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG nova.network.neutron [req-a576fe29-13a2-4fa2-aa67-e324b1c1ec03 req-e3cda03f-5fbf-4cff-85f0-f80082d8025b service nova] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Refreshing network info cache for port 369a4435-3639-47bc-8a63-1c6c3f25df9b {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab -F raw /opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk" returned: 0 in 2.704s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Ensure instance console log exists: /opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Start _get_guest_xml network_info=[{"id": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "address": "fa:16:3e:d5:f1:51", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb433bb1-8c", "ovs_interfaceid": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='3195bc2959236c30c0871ccc9f508b46',container_format='bare',created_at=2023-04-14T01:51:03Z,direct_url=<?>,disk_format='qcow2',id=9449b6a2-115f-4228-8d3c-236393420350,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1301145911-shelved',owner='a6d05ca328d64f2aa1d19550475edba3',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T01:51:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '305d36e4-5d4d-4f36-b6f3-a03def2532bf', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zameKywh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80', 'attached_at': '', 'detached_at': '', 'volume_id': '26c6e12f-4381-4acd-a6e5-a979a6886f25', 'serial': '26c6e12f-4381-4acd-a6e5-a979a6886f25'}, 'mount_device': '/dev/vdc', 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:53:06 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:53:06 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:53:06 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='3195bc2959236c30c0871ccc9f508b46',container_format='bare',created_at=2023-04-14T01:51:03Z,direct_url=<?>,disk_format='qcow2',id=9449b6a2-115f-4228-8d3c-236393420350,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1301145911-shelved',owner='a6d05ca328d64f2aa1d19550475edba3',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T01:51:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG nova.objects.instance [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lazy-loading 'vcpu_model' on Instance uuid 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zameKywh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:53:06 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:53:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:53:06 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:53:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:53:06 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d98a0b0-9d73-4e8e-a6b1-a15a4cb871d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:53:06 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[44595660-bfbd-4dcd-9037-9d77280dcae4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25] added
Apr 14 01:53:06 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[302daa9d-9d32-43ff-8593-e2cb13a46274]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b348e600-e302-4ac7-bddc-f7d7c937071c]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zameKywh {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zameKywh" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb73ab2-930f-47f6-8904-46145972ecf8]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zameKywh'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8767237e-8a60-4e8d-865e-6d4b2b7c4ae5]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f989f3c2-2a8c-42c4-af94-6c12552e3344]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:53:06 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:53:06 user nova-compute[71498]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:53:06 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:53:06 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:53:06 user nova-compute[71498]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:53:06 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[881166c5-8e29-4791-b06c-2b0630024c7a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25, portal: 172.16.0.220,3260]
Apr 14 01:53:06 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25, portal: 172.16.0.220,3260] successful.
Apr 14 01:53:06 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG nova.network.neutron [req-a576fe29-13a2-4fa2-aa67-e324b1c1ec03 req-e3cda03f-5fbf-4cff-85f0-f80082d8025b service nova] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Updated VIF entry in instance network info cache for port 369a4435-3639-47bc-8a63-1c6c3f25df9b. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG nova.network.neutron [req-a576fe29-13a2-4fa2-aa67-e324b1c1ec03 req-e3cda03f-5fbf-4cff-85f0-f80082d8025b service nova] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Updating instance_info_cache with network_info: [{"id": "369a4435-3639-47bc-8a63-1c6c3f25df9b", "address": "fa:16:3e:98:19:b2", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap369a4435-36", "ovs_interfaceid": "369a4435-3639-47bc-8a63-1c6c3f25df9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[58342110-8bd4-4cfa-b5ee-840bb9ef4559]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a576fe29-13a2-4fa2-aa67-e324b1c1ec03 req-e3cda03f-5fbf-4cff-85f0-f80082d8025b service nova] Releasing lock "refresh_cache-410c2004-b2c8-4274-b1d3-9b48585c644f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7a8261-5a1e-49eb-94a0-28f99da6e6c0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:53:06 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:53:06 user nova-compute[71498]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:53:06 user nova-compute[71498]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)
Apr 14 01:53:06 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:53:06 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:53:06 user nova-compute[71498]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:53:06 user nova-compute[71498]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)
Apr 14 01:53:06 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9c3432-5331-4c86-9a4a-7f30e384f3a6]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:53:06 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: None {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:53:07 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:53:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zameKywh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:53:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:53:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23166393839363634', 'path': '/dev/sde'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:53:07 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166393839363634', 'path': '/dev/sde'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:53:07 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T01:49:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1301145911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1301145911',id=24,image_ref='9449b6a2-115f-4228-8d3c-236393420350',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1472759355',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:49:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a6d05ca328d64f2aa1d19550475edba3',ramdisk_id='',reservation_id='r-dkqwl1kl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2042065984',owner_user_name='tempest-AttachVolumeShelveTestJSON-2042065984-project-member',shelved_at='2023-04-14T01:51:06.526160',shelved_host='user',shelved_image_id='9449b6a2-115f-4228-8d3c-236393420350'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:52:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a5da3e233c74524a953ce0d4e074077',uuid=18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "address": "fa:16:3e:d5:f1:51", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb433bb1-8c", "ovs_interfaceid": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:53:07 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Converting VIF {"id": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "address": "fa:16:3e:d5:f1:51", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb433bb1-8c", "ovs_interfaceid": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:53:07 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f1:51,bridge_name='br-int',has_traffic_filtering=True,id=db433bb1-8c59-4e6b-ae87-f6fab836df0f,network=Network(a7b6c0bc-d2de-4431-821b-c2917738e556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb433bb1-8c') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:53:07 user nova-compute[71498]: DEBUG nova.objects.instance [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lazy-loading 'pci_devices' on Instance uuid 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:53:07 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:53:07 user nova-compute[71498]:   <uuid>18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80</uuid>
Apr 14 01:53:07 user nova-compute[71498]:   <name>instance-00000018</name>
Apr 14 01:53:07 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:53:07 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:53:07 user nova-compute[71498]:   <metadata>
Apr 14 01:53:07 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:53:07 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:53:07 user nova-compute[71498]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1301145911</nova:name>
Apr 14 01:53:07 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:53:06</nova:creationTime>
Apr 14 01:53:07 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:53:07 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:53:07 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:53:07 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:53:07 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:53:07 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:53:07 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:53:07 user nova-compute[71498]:       <nova:owner>
Apr 14 01:53:07 user nova-compute[71498]:         <nova:user uuid="2a5da3e233c74524a953ce0d4e074077">tempest-AttachVolumeShelveTestJSON-2042065984-project-member</nova:user>
Apr 14 01:53:07 user nova-compute[71498]:         <nova:project uuid="a6d05ca328d64f2aa1d19550475edba3">tempest-AttachVolumeShelveTestJSON-2042065984</nova:project>
Apr 14 01:53:07 user nova-compute[71498]:       </nova:owner>
Apr 14 01:53:07 user nova-compute[71498]:       <nova:root type="image" uuid="9449b6a2-115f-4228-8d3c-236393420350"/>
Apr 14 01:53:07 user nova-compute[71498]:       <nova:ports>
Apr 14 01:53:07 user nova-compute[71498]:         <nova:port uuid="db433bb1-8c59-4e6b-ae87-f6fab836df0f">
Apr 14 01:53:07 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 01:53:07 user nova-compute[71498]:         </nova:port>
Apr 14 01:53:07 user nova-compute[71498]:       </nova:ports>
Apr 14 01:53:07 user nova-compute[71498]:     </nova:instance>
Apr 14 01:53:07 user nova-compute[71498]:   </metadata>
Apr 14 01:53:07 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:53:07 user nova-compute[71498]:     <system>
Apr 14 01:53:07 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:53:07 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:53:07 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:53:07 user nova-compute[71498]:       <entry name="serial">18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80</entry>
Apr 14 01:53:07 user nova-compute[71498]:       <entry name="uuid">18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80</entry>
Apr 14 01:53:07 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:53:07 user nova-compute[71498]:     </system>
Apr 14 01:53:07 user nova-compute[71498]:   </sysinfo>
Apr 14 01:53:07 user nova-compute[71498]:   <os>
Apr 14 01:53:07 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:53:07 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:53:07 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:53:07 user nova-compute[71498]:   </os>
Apr 14 01:53:07 user nova-compute[71498]:   <features>
Apr 14 01:53:07 user nova-compute[71498]:     <acpi/>
Apr 14 01:53:07 user nova-compute[71498]:     <apic/>
Apr 14 01:53:07 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:53:07 user nova-compute[71498]:   </features>
Apr 14 01:53:07 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:53:07 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:53:07 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:53:07 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:53:07 user nova-compute[71498]:   </clock>
Apr 14 01:53:07 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:53:07 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:53:07 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:53:07 user nova-compute[71498]:   </cpu>
Apr 14 01:53:07 user nova-compute[71498]:   <devices>
Apr 14 01:53:07 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:53:07 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:53:07 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk"/>
Apr 14 01:53:07 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:53:07 user nova-compute[71498]:     </disk>
Apr 14 01:53:07 user nova-compute[71498]:     <disk type="block" device="disk">
Apr 14 01:53:07 user nova-compute[71498]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:53:07 user nova-compute[71498]:       <source dev="/dev/sde"/>
Apr 14 01:53:07 user nova-compute[71498]:       <target dev="vdc" bus="virtio"/>
Apr 14 01:53:07 user nova-compute[71498]:       <serial>26c6e12f-4381-4acd-a6e5-a979a6886f25</serial>
Apr 14 01:53:07 user nova-compute[71498]:     </disk>
Apr 14 01:53:07 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:53:07 user nova-compute[71498]:       <mac address="fa:16:3e:d5:f1:51"/>
Apr 14 01:53:07 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:53:07 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:53:07 user nova-compute[71498]:       <target dev="tapdb433bb1-8c"/>
Apr 14 01:53:07 user nova-compute[71498]:     </interface>
Apr 14 01:53:07 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:53:07 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/console.log" append="off"/>
Apr 14 01:53:07 user nova-compute[71498]:     </serial>
Apr 14 01:53:07 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:53:07 user nova-compute[71498]:     <video>
Apr 14 01:53:07 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:53:07 user nova-compute[71498]:     </video>
Apr 14 01:53:07 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:53:07 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:53:07 user nova-compute[71498]:     </rng>
Apr 14 01:53:07 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:53:07 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:53:07 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:53:07 user nova-compute[71498]:     </memballoon>
Apr 14 01:53:07 user nova-compute[71498]:   </devices>
Apr 14 01:53:07 user nova-compute[71498]: </domain>
Apr 14 01:53:07 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:53:07 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T01:49:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1301145911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1301145911',id=24,image_ref='9449b6a2-115f-4228-8d3c-236393420350',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1472759355',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:49:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a6d05ca328d64f2aa1d19550475edba3',ramdisk_id='',reservation_id='r-dkqwl1kl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2042065984',owner_user_name='tempest-AttachVolumeShelveTestJSON-2042065984-project-member',shelved_at='2023-04-14T01:51:06.526160',shelved_host='user',shelved_image_id='9449b6a2-115f-4228-8d3c-236393420350'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:52:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a5da3e233c74524a953ce0d4e074077',uuid=18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "address": "fa:16:3e:d5:f1:51", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb433bb1-8c", "ovs_interfaceid": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:53:07 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Converting VIF {"id": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "address": "fa:16:3e:d5:f1:51", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb433bb1-8c", "ovs_interfaceid": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:53:07 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f1:51,bridge_name='br-int',has_traffic_filtering=True,id=db433bb1-8c59-4e6b-ae87-f6fab836df0f,network=Network(a7b6c0bc-d2de-4431-821b-c2917738e556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb433bb1-8c') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:53:07 user nova-compute[71498]: DEBUG os_vif [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f1:51,bridge_name='br-int',has_traffic_filtering=True,id=db433bb1-8c59-4e6b-ae87-f6fab836df0f,network=Network(a7b6c0bc-d2de-4431-821b-c2917738e556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb433bb1-8c') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:53:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:53:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:53:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb433bb1-8c, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:53:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdb433bb1-8c, col_values=(('external_ids', {'iface-id': 'db433bb1-8c59-4e6b-ae87-f6fab836df0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:f1:51', 'vm-uuid': '18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:53:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:53:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:07 user nova-compute[71498]: INFO os_vif [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f1:51,bridge_name='br-int',has_traffic_filtering=True,id=db433bb1-8c59-4e6b-ae87-f6fab836df0f,network=Network(a7b6c0bc-d2de-4431-821b-c2917738e556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb433bb1-8c')
Apr 14 01:53:07 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:53:07 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:53:07 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] No VIF found with MAC fa:16:3e:d5:f1:51, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG nova.compute.manager [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:53:08 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Creating image(s)
Apr 14 01:53:08 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Did not create local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Ensure instance console log exists: /opt/stack/data/nova/instances/410c2004-b2c8-4274-b1d3-9b48585c644f/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Start _get_guest_xml network_info=[{"id": "369a4435-3639-47bc-8a63-1c6c3f25df9b", "address": "fa:16:3e:98:19:b2", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap369a4435-36", "ovs_interfaceid": "369a4435-3639-47bc-8a63-1c6c3f25df9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9c1b7e06-3262-4333-9a68-96d7ee34a919', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XIKaoMjg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '410c2004-b2c8-4274-b1d3-9b48585c644f', 'attached_at': '', 'detached_at': '', 'volume_id': '450914a2-96ae-4c21-a717-2b391be59860', 'serial': '450914a2-96ae-4c21-a717-2b391be59860'}, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:53:08 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:53:08 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:53:08 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XIKaoMjg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:53:08 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:53:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:53:08 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:53:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:53:08 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[352f1398-e0ce-4ccd-9cc0-ba70cbad2034]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:53:08 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5de452-5547-4bbf-b4af-c9b2a03985e6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860] added
Apr 14 01:53:08 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdce5743-2334-4d07-869f-e5754c8eaef3]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a081cc43-a57e-4525-9d7b-303d1f5cd098]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XIKaoMjg {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XIKaoMjg" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa93f62b-def5-47d1-b916-93e4ac92c8ee]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XIKaoMjg'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1e1912-506f-4efa-8cc9-68c8e9917189]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8113f9-0a17-4002-81b7-2b8560e46efd]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:53:08 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:53:08 user nova-compute[71498]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:53:08 user nova-compute[71498]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)
Apr 14 01:53:08 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:53:08 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:53:08 user nova-compute[71498]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:53:08 user nova-compute[71498]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)
Apr 14 01:53:08 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ad7403-e4f5-46ef-8d18-01fd93a4a275]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860, portal: 172.16.0.220,3260]
Apr 14 01:53:08 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860, portal: 172.16.0.220,3260] successful.
Apr 14 01:53:08 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0533b1-a947-4a30-9006-168f94d81c43]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[108102d1-688e-4797-98f2-180cd08f34bf]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:53:08 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:53:08 user nova-compute[71498]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:53:08 user nova-compute[71498]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)
Apr 14 01:53:08 user nova-compute[71498]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:53:08 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:53:08 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:53:08 user nova-compute[71498]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:53:08 user nova-compute[71498]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)
Apr 14 01:53:08 user nova-compute[71498]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:53:08 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] HCTL ('37', '-', '-', 0) found on session 32 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b12b301-7140-4b58-8c43-a76771bc5205]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:53:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XIKaoMjg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:53:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:09 user nova-compute[71498]: DEBUG nova.compute.manager [req-1b46dad6-d5dc-4c01-950e-d07e676083ac req-c3e6ec74-97f1-4721-882c-ab87d7107842 service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Received event network-vif-plugged-db433bb1-8c59-4e6b-ae87-f6fab836df0f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:53:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1b46dad6-d5dc-4c01-950e-d07e676083ac req-c3e6ec74-97f1-4721-882c-ab87d7107842 service nova] Acquiring lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:53:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1b46dad6-d5dc-4c01-950e-d07e676083ac req-c3e6ec74-97f1-4721-882c-ab87d7107842 service nova] Lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:53:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1b46dad6-d5dc-4c01-950e-d07e676083ac req-c3e6ec74-97f1-4721-882c-ab87d7107842 service nova] Lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:53:09 user nova-compute[71498]: DEBUG nova.compute.manager [req-1b46dad6-d5dc-4c01-950e-d07e676083ac req-c3e6ec74-97f1-4721-882c-ab87d7107842 service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] No waiting events found dispatching network-vif-plugged-db433bb1-8c59-4e6b-ae87-f6fab836df0f {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:53:09 user nova-compute[71498]: WARNING nova.compute.manager [req-1b46dad6-d5dc-4c01-950e-d07e676083ac req-c3e6ec74-97f1-4721-882c-ab87d7107842 service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Received unexpected event network-vif-plugged-db433bb1-8c59-4e6b-ae87-f6fab836df0f for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 01:53:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:53:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23637373038376566', 'path': '/dev/sdf'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:53:09 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637373038376566', 'path': '/dev/sdf'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:53:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:53:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1737844387',display_name='tempest-TestVolumeBootPattern-server-1737844387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1737844387',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcODdjkXb9vqfJo6mLTbOXnPLP2HdwXcPxYgRVEM78ApSpFWKxeZveFravQCk22JVH3n1PXZDKAyefoGYrsPczv6zWWLW2pkXjL46/zFdGhb8s3BmOyjVZHJdx/Y2ktUg==',key_name='tempest-TestVolumeBootPattern-824995165',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1f4117a4adb4aa3b42951cf1fc84237',ramdisk_id='',reservation_id='r-nmvrx03i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-224521177',owner_user_name='tempest-TestVolumeBootPattern-224521177-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:53:04Z,user_data=None,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',uuid=410c2004-b2c8-4274-b1d3-9b48585c644f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "369a4435-3639-47bc-8a63-1c6c3f25df9b", "address": "fa:16:3e:98:19:b2", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap369a4435-36", "ovs_interfaceid": "369a4435-3639-47bc-8a63-1c6c3f25df9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:53:10 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converting VIF {"id": "369a4435-3639-47bc-8a63-1c6c3f25df9b", "address": "fa:16:3e:98:19:b2", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap369a4435-36", "ovs_interfaceid": "369a4435-3639-47bc-8a63-1c6c3f25df9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:53:10 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:19:b2,bridge_name='br-int',has_traffic_filtering=True,id=369a4435-3639-47bc-8a63-1c6c3f25df9b,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap369a4435-36') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:53:10 user nova-compute[71498]: DEBUG nova.objects.instance [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lazy-loading 'pci_devices' on Instance uuid 410c2004-b2c8-4274-b1d3-9b48585c644f {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:53:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:53:10 user nova-compute[71498]:   <uuid>410c2004-b2c8-4274-b1d3-9b48585c644f</uuid>
Apr 14 01:53:10 user nova-compute[71498]:   <name>instance-0000001d</name>
Apr 14 01:53:10 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:53:10 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:53:10 user nova-compute[71498]:   <metadata>
Apr 14 01:53:10 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:53:10 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:53:10 user nova-compute[71498]:       <nova:name>tempest-TestVolumeBootPattern-server-1737844387</nova:name>
Apr 14 01:53:10 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:53:08</nova:creationTime>
Apr 14 01:53:10 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:53:10 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:53:10 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:53:10 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:53:10 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:53:10 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:53:10 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:53:10 user nova-compute[71498]:       <nova:owner>
Apr 14 01:53:10 user nova-compute[71498]:         <nova:user uuid="50e3354ac1a84c59a7dee8e1ae6e771a">tempest-TestVolumeBootPattern-224521177-project-member</nova:user>
Apr 14 01:53:10 user nova-compute[71498]:         <nova:project uuid="c1f4117a4adb4aa3b42951cf1fc84237">tempest-TestVolumeBootPattern-224521177</nova:project>
Apr 14 01:53:10 user nova-compute[71498]:       </nova:owner>
Apr 14 01:53:10 user nova-compute[71498]:       <nova:ports>
Apr 14 01:53:10 user nova-compute[71498]:         <nova:port uuid="369a4435-3639-47bc-8a63-1c6c3f25df9b">
Apr 14 01:53:10 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 01:53:10 user nova-compute[71498]:         </nova:port>
Apr 14 01:53:10 user nova-compute[71498]:       </nova:ports>
Apr 14 01:53:10 user nova-compute[71498]:     </nova:instance>
Apr 14 01:53:10 user nova-compute[71498]:   </metadata>
Apr 14 01:53:10 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:53:10 user nova-compute[71498]:     <system>
Apr 14 01:53:10 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:53:10 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:53:10 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:53:10 user nova-compute[71498]:       <entry name="serial">410c2004-b2c8-4274-b1d3-9b48585c644f</entry>
Apr 14 01:53:10 user nova-compute[71498]:       <entry name="uuid">410c2004-b2c8-4274-b1d3-9b48585c644f</entry>
Apr 14 01:53:10 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:53:10 user nova-compute[71498]:     </system>
Apr 14 01:53:10 user nova-compute[71498]:   </sysinfo>
Apr 14 01:53:10 user nova-compute[71498]:   <os>
Apr 14 01:53:10 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:53:10 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:53:10 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:53:10 user nova-compute[71498]:   </os>
Apr 14 01:53:10 user nova-compute[71498]:   <features>
Apr 14 01:53:10 user nova-compute[71498]:     <acpi/>
Apr 14 01:53:10 user nova-compute[71498]:     <apic/>
Apr 14 01:53:10 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:53:10 user nova-compute[71498]:   </features>
Apr 14 01:53:10 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:53:10 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:53:10 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:53:10 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:53:10 user nova-compute[71498]:   </clock>
Apr 14 01:53:10 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:53:10 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:53:10 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:53:10 user nova-compute[71498]:   </cpu>
Apr 14 01:53:10 user nova-compute[71498]:   <devices>
Apr 14 01:53:10 user nova-compute[71498]:     <disk type="block" device="disk">
Apr 14 01:53:10 user nova-compute[71498]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:53:10 user nova-compute[71498]:       <source dev="/dev/sdf"/>
Apr 14 01:53:10 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:53:10 user nova-compute[71498]:       <serial>450914a2-96ae-4c21-a717-2b391be59860</serial>
Apr 14 01:53:10 user nova-compute[71498]:     </disk>
Apr 14 01:53:10 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:53:10 user nova-compute[71498]:       <mac address="fa:16:3e:98:19:b2"/>
Apr 14 01:53:10 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:53:10 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:53:10 user nova-compute[71498]:       <target dev="tap369a4435-36"/>
Apr 14 01:53:10 user nova-compute[71498]:     </interface>
Apr 14 01:53:10 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:53:10 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/410c2004-b2c8-4274-b1d3-9b48585c644f/console.log" append="off"/>
Apr 14 01:53:10 user nova-compute[71498]:     </serial>
Apr 14 01:53:10 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:53:10 user nova-compute[71498]:     <video>
Apr 14 01:53:10 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:53:10 user nova-compute[71498]:     </video>
Apr 14 01:53:10 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:53:10 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:53:10 user nova-compute[71498]:     </rng>
Apr 14 01:53:10 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:53:10 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:53:10 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:53:10 user nova-compute[71498]:     </memballoon>
Apr 14 01:53:10 user nova-compute[71498]:   </devices>
Apr 14 01:53:10 user nova-compute[71498]: </domain>
Apr 14 01:53:10 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:53:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:53:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1737844387',display_name='tempest-TestVolumeBootPattern-server-1737844387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1737844387',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcODdjkXb9vqfJo6mLTbOXnPLP2HdwXcPxYgRVEM78ApSpFWKxeZveFravQCk22JVH3n1PXZDKAyefoGYrsPczv6zWWLW2pkXjL46/zFdGhb8s3BmOyjVZHJdx/Y2ktUg==',key_name='tempest-TestVolumeBootPattern-824995165',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1f4117a4adb4aa3b42951cf1fc84237',ramdisk_id='',reservation_id='r-nmvrx03i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-224521177',owner_user_name='tempest-TestVolumeBootPattern-224521177-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:53:04Z,user_data=None,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',uuid=410c2004-b2c8-4274-b1d3-9b48585c644f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "369a4435-3639-47bc-8a63-1c6c3f25df9b", "address": "fa:16:3e:98:19:b2", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap369a4435-36", "ovs_interfaceid": "369a4435-3639-47bc-8a63-1c6c3f25df9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:53:10 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converting VIF {"id": "369a4435-3639-47bc-8a63-1c6c3f25df9b", "address": "fa:16:3e:98:19:b2", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap369a4435-36", "ovs_interfaceid": "369a4435-3639-47bc-8a63-1c6c3f25df9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:53:10 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:19:b2,bridge_name='br-int',has_traffic_filtering=True,id=369a4435-3639-47bc-8a63-1c6c3f25df9b,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap369a4435-36') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:53:10 user nova-compute[71498]: DEBUG os_vif [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:19:b2,bridge_name='br-int',has_traffic_filtering=True,id=369a4435-3639-47bc-8a63-1c6c3f25df9b,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap369a4435-36') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:53:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:53:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:53:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap369a4435-36, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:53:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap369a4435-36, col_values=(('external_ids', {'iface-id': '369a4435-3639-47bc-8a63-1c6c3f25df9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:19:b2', 'vm-uuid': '410c2004-b2c8-4274-b1d3-9b48585c644f'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:53:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:53:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:10 user nova-compute[71498]: INFO os_vif [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:19:b2,bridge_name='br-int',has_traffic_filtering=True,id=369a4435-3639-47bc-8a63-1c6c3f25df9b,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap369a4435-36')
Apr 14 01:53:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:53:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] No VIF found with MAC fa:16:3e:98:19:b2, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:53:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:11 user nova-compute[71498]: DEBUG nova.compute.manager [req-b28b9f02-02ce-46e0-b8fd-ab2c28177046 req-1dfd5d24-72c8-47c3-89b1-e450fc58cc83 service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Received event network-vif-plugged-db433bb1-8c59-4e6b-ae87-f6fab836df0f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:53:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b28b9f02-02ce-46e0-b8fd-ab2c28177046 req-1dfd5d24-72c8-47c3-89b1-e450fc58cc83 service nova] Acquiring lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:53:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b28b9f02-02ce-46e0-b8fd-ab2c28177046 req-1dfd5d24-72c8-47c3-89b1-e450fc58cc83 service nova] Lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:53:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b28b9f02-02ce-46e0-b8fd-ab2c28177046 req-1dfd5d24-72c8-47c3-89b1-e450fc58cc83 service nova] Lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:53:11 user nova-compute[71498]: DEBUG nova.compute.manager [req-b28b9f02-02ce-46e0-b8fd-ab2c28177046 req-1dfd5d24-72c8-47c3-89b1-e450fc58cc83 service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] No waiting events found dispatching network-vif-plugged-db433bb1-8c59-4e6b-ae87-f6fab836df0f {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:53:11 user nova-compute[71498]: WARNING nova.compute.manager [req-b28b9f02-02ce-46e0-b8fd-ab2c28177046 req-1dfd5d24-72c8-47c3-89b1-e450fc58cc83 service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Received unexpected event network-vif-plugged-db433bb1-8c59-4e6b-ae87-f6fab836df0f for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 01:53:11 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437191.6153357, 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:53:11 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] VM Resumed (Lifecycle Event)
Apr 14 01:53:11 user nova-compute[71498]: DEBUG nova.compute.manager [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:53:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:53:11 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Instance spawned successfully.
Apr 14 01:53:11 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:53:11 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:53:11 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:53:11 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437191.617549, 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:53:11 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] VM Started (Lifecycle Event)
Apr 14 01:53:11 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:53:11 user nova-compute[71498]: DEBUG nova.compute.manager [req-bdf3b54b-9874-4fba-afaf-400414f38f81 req-df9689a4-53dc-4cd1-b74d-cf700447259f service nova] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Received event network-vif-plugged-369a4435-3639-47bc-8a63-1c6c3f25df9b {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:53:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-bdf3b54b-9874-4fba-afaf-400414f38f81 req-df9689a4-53dc-4cd1-b74d-cf700447259f service nova] Acquiring lock "410c2004-b2c8-4274-b1d3-9b48585c644f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:53:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-bdf3b54b-9874-4fba-afaf-400414f38f81 req-df9689a4-53dc-4cd1-b74d-cf700447259f service nova] Lock "410c2004-b2c8-4274-b1d3-9b48585c644f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:53:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-bdf3b54b-9874-4fba-afaf-400414f38f81 req-df9689a4-53dc-4cd1-b74d-cf700447259f service nova] Lock "410c2004-b2c8-4274-b1d3-9b48585c644f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:53:11 user nova-compute[71498]: DEBUG nova.compute.manager [req-bdf3b54b-9874-4fba-afaf-400414f38f81 req-df9689a4-53dc-4cd1-b74d-cf700447259f service nova] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] No waiting events found dispatching network-vif-plugged-369a4435-3639-47bc-8a63-1c6c3f25df9b {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:53:11 user nova-compute[71498]: WARNING nova.compute.manager [req-bdf3b54b-9874-4fba-afaf-400414f38f81 req-df9689a4-53dc-4cd1-b74d-cf700447259f service nova] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Received unexpected event network-vif-plugged-369a4435-3639-47bc-8a63-1c6c3f25df9b for instance with vm_state building and task_state spawning.
Apr 14 01:53:11 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:53:11 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:53:11 user nova-compute[71498]: DEBUG nova.compute.manager [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:53:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a02bb4e5-3a35-4f3b-9dc1-ae22938477bb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 17.297s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:53:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:13 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437193.6703649, 410c2004-b2c8-4274-b1d3-9b48585c644f => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:53:13 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] VM Resumed (Lifecycle Event)
Apr 14 01:53:13 user nova-compute[71498]: DEBUG nova.compute.manager [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:53:13 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:53:13 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Instance spawned successfully.
Apr 14 01:53:13 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:53:13 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:53:13 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:53:13 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:53:13 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:53:13 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:53:13 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:53:13 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:53:13 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:53:13 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:53:13 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437193.671864, 410c2004-b2c8-4274-b1d3-9b48585c644f => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:53:13 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] VM Started (Lifecycle Event)
Apr 14 01:53:13 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:53:13 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:53:13 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:53:13 user nova-compute[71498]: DEBUG nova.compute.manager [req-4d360523-1979-49e5-889d-d9a084e1cc75 req-23ba5597-372b-4504-b260-033157c6b9a5 service nova] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Received event network-vif-plugged-369a4435-3639-47bc-8a63-1c6c3f25df9b {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:53:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4d360523-1979-49e5-889d-d9a084e1cc75 req-23ba5597-372b-4504-b260-033157c6b9a5 service nova] Acquiring lock "410c2004-b2c8-4274-b1d3-9b48585c644f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:53:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4d360523-1979-49e5-889d-d9a084e1cc75 req-23ba5597-372b-4504-b260-033157c6b9a5 service nova] Lock "410c2004-b2c8-4274-b1d3-9b48585c644f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:53:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4d360523-1979-49e5-889d-d9a084e1cc75 req-23ba5597-372b-4504-b260-033157c6b9a5 service nova] Lock "410c2004-b2c8-4274-b1d3-9b48585c644f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:53:13 user nova-compute[71498]: DEBUG nova.compute.manager [req-4d360523-1979-49e5-889d-d9a084e1cc75 req-23ba5597-372b-4504-b260-033157c6b9a5 service nova] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] No waiting events found dispatching network-vif-plugged-369a4435-3639-47bc-8a63-1c6c3f25df9b {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:53:13 user nova-compute[71498]: WARNING nova.compute.manager [req-4d360523-1979-49e5-889d-d9a084e1cc75 req-23ba5597-372b-4504-b260-033157c6b9a5 service nova] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Received unexpected event network-vif-plugged-369a4435-3639-47bc-8a63-1c6c3f25df9b for instance with vm_state building and task_state spawning.
Apr 14 01:53:13 user nova-compute[71498]: INFO nova.compute.manager [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Took 5.15 seconds to spawn the instance on the hypervisor.
Apr 14 01:53:13 user nova-compute[71498]: DEBUG nova.compute.manager [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:53:13 user nova-compute[71498]: INFO nova.compute.manager [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Took 11.11 seconds to build instance.
Apr 14 01:53:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5f4dc817-6826-42c6-924f-9cbc2b02d67d tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "410c2004-b2c8-4274-b1d3-9b48585c644f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.279s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:53:15 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:15 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:20 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:53:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:35 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:53:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:53:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:53:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:53:35 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 01:53:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:53:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:53:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:53:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:53:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:53:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:38 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:53:38 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:53:38 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=7988MB free_disk=26.23318862915039GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 01:53:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:53:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:53:38 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:53:38 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:53:38 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance a19a1c08-5454-481b-bb5a-70c39ead9afc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:53:38 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance fa29c144-0ff9-4efb-a574-f521d18f08fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:53:38 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:53:38 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance ae82789e-1bed-419b-a580-68ff7ed03ef2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:53:38 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 85b399dc-62df-480d-8561-5d9d1ab75c52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:53:38 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:53:38 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:53:38 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 410c2004-b2c8-4274-b1d3-9b48585c644f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:53:38 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 01:53:38 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 01:53:38 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:53:38 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:53:38 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 01:53:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.516s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:53:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:53:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:53:39 user nova-compute[71498]: DEBUG nova.compute.manager [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 01:53:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:53:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:53:39 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:53:39 user nova-compute[71498]: INFO nova.compute.claims [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Claim successful on node user
Apr 14 01:53:39 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:53:39 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:53:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:53:39 user nova-compute[71498]: DEBUG nova.compute.manager [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 01:53:39 user nova-compute[71498]: DEBUG nova.compute.manager [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 01:53:39 user nova-compute[71498]: DEBUG nova.network.neutron [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:53:39 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 01:53:39 user nova-compute[71498]: DEBUG nova.compute.manager [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 01:53:39 user nova-compute[71498]: DEBUG nova.policy [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eeb5f26be86e43b3b61fff98fdc83cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3de04739384e3ea3a475fee28be3c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:53:39 user nova-compute[71498]: DEBUG nova.compute.manager [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 01:53:39 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:53:39 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Creating image(s)
Apr 14 01:53:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "/opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:53:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "/opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:53:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "/opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:53:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.152s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:53:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:53:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.140s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk 1073741824" returned: 0 in 0.203s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.351s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:53:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.134s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:40 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Checking if we can resize image /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 01:53:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:53:40 user nova-compute[71498]: DEBUG nova.network.neutron [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Successfully created port: 69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:53:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:53:40 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Cannot resize image /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 01:53:40 user nova-compute[71498]: DEBUG nova.objects.instance [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'migration_context' on Instance uuid 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:53:40 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 01:53:40 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Ensure instance console log exists: /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:53:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:53:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:53:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:53:40 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:53:40 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 01:53:40 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Rebuilding the list of instances to heal {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 01:53:40 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Skipping network cache update for instance because it is Building. {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 14 01:53:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-8e042a42-7cc2-4d72-b7ed-2b80339f2c85" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:53:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-8e042a42-7cc2-4d72-b7ed-2b80339f2c85" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:53:41 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 01:53:41 user nova-compute[71498]: DEBUG nova.objects.instance [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lazy-loading 'info_cache' on Instance uuid 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:53:41 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Updating instance_info_cache with network_info: [{"id": "ed749832-992f-44d3-8316-87f59088b737", "address": "fa:16:3e:98:9d:2e", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped749832-99", "ovs_interfaceid": "ed749832-992f-44d3-8316-87f59088b737", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:53:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-8e042a42-7cc2-4d72-b7ed-2b80339f2c85" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:53:41 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 01:53:41 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:53:41 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:53:41 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:53:41 user nova-compute[71498]: DEBUG nova.network.neutron [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Successfully updated port: 69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:53:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "refresh_cache-92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:53:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquired lock "refresh_cache-92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:53:41 user nova-compute[71498]: DEBUG nova.network.neutron [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:53:41 user nova-compute[71498]: DEBUG nova.compute.manager [req-680ea3b4-d60b-4b44-b75e-47a9d5de05b3 req-38cbaaf4-e77f-46e0-9c3c-cb6aa1ad8f35 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received event network-changed-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:53:41 user nova-compute[71498]: DEBUG nova.compute.manager [req-680ea3b4-d60b-4b44-b75e-47a9d5de05b3 req-38cbaaf4-e77f-46e0-9c3c-cb6aa1ad8f35 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Refreshing instance network info cache due to event network-changed-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:53:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-680ea3b4-d60b-4b44-b75e-47a9d5de05b3 req-38cbaaf4-e77f-46e0-9c3c-cb6aa1ad8f35 service nova] Acquiring lock "refresh_cache-92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG nova.network.neutron [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG nova.network.neutron [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Updating instance_info_cache with network_info: [{"id": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "address": "fa:16:3e:84:32:3a", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ad9be5-f1", "ovs_interfaceid": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Releasing lock "refresh_cache-92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Instance network_info: |[{"id": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "address": "fa:16:3e:84:32:3a", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ad9be5-f1", "ovs_interfaceid": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-680ea3b4-d60b-4b44-b75e-47a9d5de05b3 req-38cbaaf4-e77f-46e0-9c3c-cb6aa1ad8f35 service nova] Acquired lock "refresh_cache-92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG nova.network.neutron [req-680ea3b4-d60b-4b44-b75e-47a9d5de05b3 req-38cbaaf4-e77f-46e0-9c3c-cb6aa1ad8f35 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Refreshing network info cache for port 69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Start _get_guest_xml network_info=[{"id": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "address": "fa:16:3e:84:32:3a", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ad9be5-f1", "ovs_interfaceid": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:53:42 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:53:42 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:53:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:53:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2091181391',display_name='tempest-ServerRescueNegativeTestJSON-server-2091181391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2091181391',id=30,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+OdZSGBEkWqqj7kuDmKwl/+l4bHkD0nIQkpmr7DuvkGkz+hkeVv46cz6D3tLWZ7TOclqa0k/xgkvW1kl0/hacLGQfyoaWAHTyjX568DZBdMmvuK27rWMMV+9zvHM6h7g==',key_name='tempest-keypair-843861517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d3de04739384e3ea3a475fee28be3c0',ramdisk_id='',reservation_id='r-4mnwzjvx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1453869246',owner_user_name='tempest-ServerRescueNegativeTestJSON-1453869246-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:53:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeb5f26be86e43b3b61fff98fdc83cf3',uuid=92e640b7-a222-4b2f-8d9f-7151cfc7dcc7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "address": "fa:16:3e:84:32:3a", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ad9be5-f1", "ovs_interfaceid": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Converting VIF {"id": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "address": "fa:16:3e:84:32:3a", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ad9be5-f1", "ovs_interfaceid": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:32:3a,bridge_name='br-int',has_traffic_filtering=True,id=69ad9be5-f12b-4f3b-8a10-1e4c5f09264d,network=Network(2c4fba9e-0217-4e37-af1c-065b3f0cd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69ad9be5-f1') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG nova.objects.instance [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'pci_devices' on Instance uuid 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:53:42 user nova-compute[71498]:   <uuid>92e640b7-a222-4b2f-8d9f-7151cfc7dcc7</uuid>
Apr 14 01:53:42 user nova-compute[71498]:   <name>instance-0000001e</name>
Apr 14 01:53:42 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:53:42 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:53:42 user nova-compute[71498]:   <metadata>
Apr 14 01:53:42 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:53:42 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:53:42 user nova-compute[71498]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2091181391</nova:name>
Apr 14 01:53:42 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:53:42</nova:creationTime>
Apr 14 01:53:42 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:53:42 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:53:42 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:53:42 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:53:42 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:53:42 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:53:42 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:53:42 user nova-compute[71498]:       <nova:owner>
Apr 14 01:53:42 user nova-compute[71498]:         <nova:user uuid="eeb5f26be86e43b3b61fff98fdc83cf3">tempest-ServerRescueNegativeTestJSON-1453869246-project-member</nova:user>
Apr 14 01:53:42 user nova-compute[71498]:         <nova:project uuid="6d3de04739384e3ea3a475fee28be3c0">tempest-ServerRescueNegativeTestJSON-1453869246</nova:project>
Apr 14 01:53:42 user nova-compute[71498]:       </nova:owner>
Apr 14 01:53:42 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:53:42 user nova-compute[71498]:       <nova:ports>
Apr 14 01:53:42 user nova-compute[71498]:         <nova:port uuid="69ad9be5-f12b-4f3b-8a10-1e4c5f09264d">
Apr 14 01:53:42 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 01:53:42 user nova-compute[71498]:         </nova:port>
Apr 14 01:53:42 user nova-compute[71498]:       </nova:ports>
Apr 14 01:53:42 user nova-compute[71498]:     </nova:instance>
Apr 14 01:53:42 user nova-compute[71498]:   </metadata>
Apr 14 01:53:42 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:53:42 user nova-compute[71498]:     <system>
Apr 14 01:53:42 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:53:42 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:53:42 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:53:42 user nova-compute[71498]:       <entry name="serial">92e640b7-a222-4b2f-8d9f-7151cfc7dcc7</entry>
Apr 14 01:53:42 user nova-compute[71498]:       <entry name="uuid">92e640b7-a222-4b2f-8d9f-7151cfc7dcc7</entry>
Apr 14 01:53:42 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:53:42 user nova-compute[71498]:     </system>
Apr 14 01:53:42 user nova-compute[71498]:   </sysinfo>
Apr 14 01:53:42 user nova-compute[71498]:   <os>
Apr 14 01:53:42 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:53:42 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:53:42 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:53:42 user nova-compute[71498]:   </os>
Apr 14 01:53:42 user nova-compute[71498]:   <features>
Apr 14 01:53:42 user nova-compute[71498]:     <acpi/>
Apr 14 01:53:42 user nova-compute[71498]:     <apic/>
Apr 14 01:53:42 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:53:42 user nova-compute[71498]:   </features>
Apr 14 01:53:42 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:53:42 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:53:42 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:53:42 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:53:42 user nova-compute[71498]:   </clock>
Apr 14 01:53:42 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:53:42 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:53:42 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:53:42 user nova-compute[71498]:   </cpu>
Apr 14 01:53:42 user nova-compute[71498]:   <devices>
Apr 14 01:53:42 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:53:42 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:53:42 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk"/>
Apr 14 01:53:42 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:53:42 user nova-compute[71498]:     </disk>
Apr 14 01:53:42 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:53:42 user nova-compute[71498]:       <mac address="fa:16:3e:84:32:3a"/>
Apr 14 01:53:42 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:53:42 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:53:42 user nova-compute[71498]:       <target dev="tap69ad9be5-f1"/>
Apr 14 01:53:42 user nova-compute[71498]:     </interface>
Apr 14 01:53:42 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:53:42 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/console.log" append="off"/>
Apr 14 01:53:42 user nova-compute[71498]:     </serial>
Apr 14 01:53:42 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:53:42 user nova-compute[71498]:     <video>
Apr 14 01:53:42 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:53:42 user nova-compute[71498]:     </video>
Apr 14 01:53:42 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:53:42 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:53:42 user nova-compute[71498]:     </rng>
Apr 14 01:53:42 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:53:42 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:53:42 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:53:42 user nova-compute[71498]:     </memballoon>
Apr 14 01:53:42 user nova-compute[71498]:   </devices>
Apr 14 01:53:42 user nova-compute[71498]: </domain>
Apr 14 01:53:42 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:53:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2091181391',display_name='tempest-ServerRescueNegativeTestJSON-server-2091181391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2091181391',id=30,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+OdZSGBEkWqqj7kuDmKwl/+l4bHkD0nIQkpmr7DuvkGkz+hkeVv46cz6D3tLWZ7TOclqa0k/xgkvW1kl0/hacLGQfyoaWAHTyjX568DZBdMmvuK27rWMMV+9zvHM6h7g==',key_name='tempest-keypair-843861517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d3de04739384e3ea3a475fee28be3c0',ramdisk_id='',reservation_id='r-4mnwzjvx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1453869246',owner_user_name='tempest-ServerRescueNegativeTestJSON-1453869246-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:53:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeb5f26be86e43b3b61fff98fdc83cf3',uuid=92e640b7-a222-4b2f-8d9f-7151cfc7dcc7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "address": "fa:16:3e:84:32:3a", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ad9be5-f1", "ovs_interfaceid": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Converting VIF {"id": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "address": "fa:16:3e:84:32:3a", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ad9be5-f1", "ovs_interfaceid": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:32:3a,bridge_name='br-int',has_traffic_filtering=True,id=69ad9be5-f12b-4f3b-8a10-1e4c5f09264d,network=Network(2c4fba9e-0217-4e37-af1c-065b3f0cd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69ad9be5-f1') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG os_vif [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:32:3a,bridge_name='br-int',has_traffic_filtering=True,id=69ad9be5-f12b-4f3b-8a10-1e4c5f09264d,network=Network(2c4fba9e-0217-4e37-af1c-065b3f0cd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69ad9be5-f1') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69ad9be5-f1, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap69ad9be5-f1, col_values=(('external_ids', {'iface-id': '69ad9be5-f12b-4f3b-8a10-1e4c5f09264d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:32:3a', 'vm-uuid': '92e640b7-a222-4b2f-8d9f-7151cfc7dcc7'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:42 user nova-compute[71498]: INFO os_vif [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:32:3a,bridge_name='br-int',has_traffic_filtering=True,id=69ad9be5-f12b-4f3b-8a10-1e4c5f09264d,network=Network(2c4fba9e-0217-4e37-af1c-065b3f0cd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69ad9be5-f1')
Apr 14 01:53:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] No VIF found with MAC fa:16:3e:84:32:3a, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG nova.network.neutron [req-680ea3b4-d60b-4b44-b75e-47a9d5de05b3 req-38cbaaf4-e77f-46e0-9c3c-cb6aa1ad8f35 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Updated VIF entry in instance network info cache for port 69ad9be5-f12b-4f3b-8a10-1e4c5f09264d. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG nova.network.neutron [req-680ea3b4-d60b-4b44-b75e-47a9d5de05b3 req-38cbaaf4-e77f-46e0-9c3c-cb6aa1ad8f35 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Updating instance_info_cache with network_info: [{"id": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "address": "fa:16:3e:84:32:3a", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ad9be5-f1", "ovs_interfaceid": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:53:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-680ea3b4-d60b-4b44-b75e-47a9d5de05b3 req-38cbaaf4-e77f-46e0-9c3c-cb6aa1ad8f35 service nova] Releasing lock "refresh_cache-92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:53:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:43 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:53:43 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:53:43 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:53:43 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 01:53:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:44 user nova-compute[71498]: DEBUG nova.compute.manager [req-37329555-fa6a-49fc-a56a-ef56c94e8510 req-f0721d66-123e-48e4-9220-1307278327c5 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received event network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:53:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-37329555-fa6a-49fc-a56a-ef56c94e8510 req-f0721d66-123e-48e4-9220-1307278327c5 service nova] Acquiring lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:53:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-37329555-fa6a-49fc-a56a-ef56c94e8510 req-f0721d66-123e-48e4-9220-1307278327c5 service nova] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:53:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-37329555-fa6a-49fc-a56a-ef56c94e8510 req-f0721d66-123e-48e4-9220-1307278327c5 service nova] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:53:44 user nova-compute[71498]: DEBUG nova.compute.manager [req-37329555-fa6a-49fc-a56a-ef56c94e8510 req-f0721d66-123e-48e4-9220-1307278327c5 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] No waiting events found dispatching network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:53:44 user nova-compute[71498]: WARNING nova.compute.manager [req-37329555-fa6a-49fc-a56a-ef56c94e8510 req-f0721d66-123e-48e4-9220-1307278327c5 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received unexpected event network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance with vm_state building and task_state spawning.
Apr 14 01:53:46 user nova-compute[71498]: DEBUG nova.compute.manager [req-f726df08-218b-4bee-9121-a0343c61784b req-04ceefaf-4dc5-4aec-88c4-daf21a6bdaf0 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received event network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:53:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f726df08-218b-4bee-9121-a0343c61784b req-04ceefaf-4dc5-4aec-88c4-daf21a6bdaf0 service nova] Acquiring lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:53:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f726df08-218b-4bee-9121-a0343c61784b req-04ceefaf-4dc5-4aec-88c4-daf21a6bdaf0 service nova] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:53:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f726df08-218b-4bee-9121-a0343c61784b req-04ceefaf-4dc5-4aec-88c4-daf21a6bdaf0 service nova] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:53:46 user nova-compute[71498]: DEBUG nova.compute.manager [req-f726df08-218b-4bee-9121-a0343c61784b req-04ceefaf-4dc5-4aec-88c4-daf21a6bdaf0 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] No waiting events found dispatching network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:53:46 user nova-compute[71498]: WARNING nova.compute.manager [req-f726df08-218b-4bee-9121-a0343c61784b req-04ceefaf-4dc5-4aec-88c4-daf21a6bdaf0 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received unexpected event network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance with vm_state building and task_state spawning.
Apr 14 01:53:46 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437226.1071749, 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:53:46 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] VM Resumed (Lifecycle Event)
Apr 14 01:53:46 user nova-compute[71498]: DEBUG nova.compute.manager [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:53:46 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:53:46 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Instance spawned successfully.
Apr 14 01:53:46 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:53:46 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:53:46 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:53:46 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:53:46 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:53:46 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:53:46 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:53:46 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:53:46 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:53:46 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:53:46 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437226.1083782, 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:53:46 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] VM Started (Lifecycle Event)
Apr 14 01:53:46 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:53:46 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:53:46 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:53:46 user nova-compute[71498]: INFO nova.compute.manager [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Took 6.28 seconds to spawn the instance on the hypervisor.
Apr 14 01:53:46 user nova-compute[71498]: DEBUG nova.compute.manager [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:53:46 user nova-compute[71498]: INFO nova.compute.manager [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Took 7.05 seconds to build instance.
Apr 14 01:53:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-40e7b611-3c61-4201-b458-e8fedaea02be tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.140s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:53:46 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:53:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:53:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:06 user nova-compute[71498]: INFO nova.compute.manager [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Rescuing
Apr 14 01:54:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "refresh_cache-7ff438f4-54e1-44b9-bb5a-1b42d48a37ed" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:54:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquired lock "refresh_cache-7ff438f4-54e1-44b9-bb5a-1b42d48a37ed" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:54:06 user nova-compute[71498]: DEBUG nova.network.neutron [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:54:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:54:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:54:06 user nova-compute[71498]: DEBUG nova.objects.instance [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lazy-loading 'flavor' on Instance uuid 73cc8ede-babd-4281-bf1d-c5a3f8bad440 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:54:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:54:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:54:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:54:06 user nova-compute[71498]: INFO nova.compute.manager [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Attaching volume 55aa3df5-b363-4e8f-ac2e-f46bea9ca67f to /dev/vdb
Apr 14 01:54:06 user nova-compute[71498]: DEBUG os_brick.utils [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:54:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:06 user nova-compute[71498]: DEBUG nova.network.neutron [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Updating instance_info_cache with network_info: [{"id": "6568fde8-2639-4cee-8527-e3ca028f42fd", "address": "fa:16:3e:69:f8:89", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6568fde8-26", "ovs_interfaceid": "6568fde8-2639-4cee-8527-e3ca028f42fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:54:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e6b379-22dd-419f-acf4-fde5f37fead5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Releasing lock "refresh_cache-7ff438f4-54e1-44b9-bb5a-1b42d48a37ed" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:54:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e572f30-38d1-443c-86b8-153e614fcad9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08ed0ab-9514-49fd-b796-968c3b424578]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:06 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e3946d-3ba3-481b-a43c-9356c5d1aa1e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:06 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:54:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:54:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:54:07 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:54:07 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2e0b44-b785-4588-bdf0-0142b051d635]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:54:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:54:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:54:07 user nova-compute[71498]: DEBUG os_brick.utils [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:54:07 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Updating existing volume attachment record: 613e5d74-a21e-42d7-8ed3-3e64d8e621d2 {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:54:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:07 user nova-compute[71498]: DEBUG nova.compute.manager [req-f53b4b3a-5f7c-4a6c-a62e-7d0c6b0cdadc req-61378628-4b90-4965-8e22-fd5e8a8cfb5b service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Received event network-vif-unplugged-6568fde8-2639-4cee-8527-e3ca028f42fd {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:54:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f53b4b3a-5f7c-4a6c-a62e-7d0c6b0cdadc req-61378628-4b90-4965-8e22-fd5e8a8cfb5b service nova] Acquiring lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:54:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f53b4b3a-5f7c-4a6c-a62e-7d0c6b0cdadc req-61378628-4b90-4965-8e22-fd5e8a8cfb5b service nova] Lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:54:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f53b4b3a-5f7c-4a6c-a62e-7d0c6b0cdadc req-61378628-4b90-4965-8e22-fd5e8a8cfb5b service nova] Lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:54:07 user nova-compute[71498]: DEBUG nova.compute.manager [req-f53b4b3a-5f7c-4a6c-a62e-7d0c6b0cdadc req-61378628-4b90-4965-8e22-fd5e8a8cfb5b service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] No waiting events found dispatching network-vif-unplugged-6568fde8-2639-4cee-8527-e3ca028f42fd {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:54:07 user nova-compute[71498]: WARNING nova.compute.manager [req-f53b4b3a-5f7c-4a6c-a62e-7d0c6b0cdadc req-61378628-4b90-4965-8e22-fd5e8a8cfb5b service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Received unexpected event network-vif-unplugged-6568fde8-2639-4cee-8527-e3ca028f42fd for instance with vm_state active and task_state rescuing.
Apr 14 01:54:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:07 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Instance destroyed successfully.
Apr 14 01:54:07 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Attempting a stable device rescue
Apr 14 01:54:07 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71498) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 01:54:07 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Instance directory exists: not creating {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 01:54:07 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Creating image(s)
Apr 14 01:54:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:54:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "/opt/stack/data/nova/instances/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:54:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "/opt/stack/data/nova/instances/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:54:07 user nova-compute[71498]: DEBUG nova.objects.instance [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:54:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "787dbab95fe72633643288c6e5cea6cb33e34252" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:54:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "787dbab95fe72633643288c6e5cea6cb33e34252" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:54:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/787dbab95fe72633643288c6e5cea6cb33e34252.part --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/787dbab95fe72633643288c6e5cea6cb33e34252.part --force-share --output=json" returned: 0 in 0.148s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:08 user nova-compute[71498]: DEBUG nova.virt.images [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] 0732ba1d-fc49-4c86-93b6-c5bd4572a1f9 was qcow2, converting to raw {{(pid=71498) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 01:54:08 user nova-compute[71498]: DEBUG nova.privsep.utils [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71498) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 01:54:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/787dbab95fe72633643288c6e5cea6cb33e34252.part /opt/stack/data/nova/instances/_base/787dbab95fe72633643288c6e5cea6cb33e34252.converted {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/787dbab95fe72633643288c6e5cea6cb33e34252.part /opt/stack/data/nova/instances/_base/787dbab95fe72633643288c6e5cea6cb33e34252.converted" returned: 0 in 0.363s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/787dbab95fe72633643288c6e5cea6cb33e34252.converted --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG nova.compute.manager [req-df77ab75-d9b8-431f-b7f8-af29d53dfb61 req-5c6a5a08-4eea-4380-8070-4d0855ce260b service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Received event network-vif-plugged-6568fde8-2639-4cee-8527-e3ca028f42fd {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-df77ab75-d9b8-431f-b7f8-af29d53dfb61 req-5c6a5a08-4eea-4380-8070-4d0855ce260b service nova] Acquiring lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-df77ab75-d9b8-431f-b7f8-af29d53dfb61 req-5c6a5a08-4eea-4380-8070-4d0855ce260b service nova] Lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-df77ab75-d9b8-431f-b7f8-af29d53dfb61 req-5c6a5a08-4eea-4380-8070-4d0855ce260b service nova] Lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG nova.compute.manager [req-df77ab75-d9b8-431f-b7f8-af29d53dfb61 req-5c6a5a08-4eea-4380-8070-4d0855ce260b service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] No waiting events found dispatching network-vif-plugged-6568fde8-2639-4cee-8527-e3ca028f42fd {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:54:09 user nova-compute[71498]: WARNING nova.compute.manager [req-df77ab75-d9b8-431f-b7f8-af29d53dfb61 req-5c6a5a08-4eea-4380-8070-4d0855ce260b service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Received unexpected event network-vif-plugged-6568fde8-2639-4cee-8527-e3ca028f42fd for instance with vm_state active and task_state rescuing.
Apr 14 01:54:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/787dbab95fe72633643288c6e5cea6cb33e34252.converted --force-share --output=json" returned: 0 in 0.159s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "787dbab95fe72633643288c6e5cea6cb33e34252" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.588s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "787dbab95fe72633643288c6e5cea6cb33e34252" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "787dbab95fe72633643288c6e5cea6cb33e34252" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/787dbab95fe72633643288c6e5cea6cb33e34252 --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/787dbab95fe72633643288c6e5cea6cb33e34252 --force-share --output=json" returned: 0 in 0.137s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/787dbab95fe72633643288c6e5cea6cb33e34252,backing_fmt=raw /opt/stack/data/nova/instances/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed/disk.rescue {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/787dbab95fe72633643288c6e5cea6cb33e34252,backing_fmt=raw /opt/stack/data/nova/instances/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed/disk.rescue" returned: 0 in 0.066s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "787dbab95fe72633643288c6e5cea6cb33e34252" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG nova.objects.instance [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lazy-loading 'migration_context' on Instance uuid 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Start _get_guest_xml network_info=[{"id": "6568fde8-2639-4cee-8527-e3ca028f42fd", "address": "fa:16:3e:69:f8:89", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "vif_mac": "fa:16:3e:69:f8:89"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6568fde8-26", "ovs_interfaceid": "6568fde8-2639-4cee-8527-e3ca028f42fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0732ba1d-fc49-4c86-93b6-c5bd4572a1f9', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '552eb2d1-8cf4-4fea-88fd-1f7f5222eb5b', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AUTEzbSm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '7ff438f4-54e1-44b9-bb5a-1b42d48a37ed', 'attached_at': '', 'detached_at': '', 'volume_id': '2f2f2823-8b6e-49ae-ad4e-ed05a02421ae', 'serial': '2f2f2823-8b6e-49ae-ad4e-ed05a02421ae'}, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG nova.objects.instance [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lazy-loading 'resources' on Instance uuid 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG nova.objects.instance [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lazy-loading 'numa_topology' on Instance uuid 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:54:09 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:54:09 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:54:09 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG nova.objects.instance [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AUTEzbSm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:54:09 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:54:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:54:09 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:54:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:54:09 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:54:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf317ec-c07c-4111-8a0b-0fa176e744b0]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = AUTEzbSm\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 14 01:54:09 user nova-compute[71498]: node.name = iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae
Apr 14 01:54:09 user nova-compute[71498]: node.tpgt = -1
Apr 14 01:54:09 user nova-compute[71498]: node.startup = automatic
Apr 14 01:54:09 user nova-compute[71498]: node.leading_login = No
Apr 14 01:54:09 user nova-compute[71498]: iface.iscsi_ifacename = default
Apr 14 01:54:09 user nova-compute[71498]: iface.net_ifacename = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.ipaddress = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.prefix_len = 0
Apr 14 01:54:09 user nova-compute[71498]: iface.hwaddress = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.transport_name = tcp
Apr 14 01:54:09 user nova-compute[71498]: iface.initiatorname = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.state = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.vlan_id = 0
Apr 14 01:54:09 user nova-compute[71498]: iface.vlan_priority = 0
Apr 14 01:54:09 user nova-compute[71498]: iface.vlan_state = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.iface_num = 0
Apr 14 01:54:09 user nova-compute[71498]: iface.mtu = 0
Apr 14 01:54:09 user nova-compute[71498]: iface.port = 0
Apr 14 01:54:09 user nova-compute[71498]: iface.bootproto = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.subnet_mask = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.gateway = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.dhcp_alt_client_id_state = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.dhcp_alt_client_id = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.dhcp_dns = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.dhcp_learn_iqn = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.dhcp_req_vendor_id_state = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.dhcp_vendor_id_state = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.dhcp_vendor_id = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.dhcp_slp_da = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.fragmentation = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.gratuitous_arp = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.incoming_forwarding = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.tos_state = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.tos = 0
Apr 14 01:54:09 user nova-compute[71498]: iface.ttl = 0
Apr 14 01:54:09 user nova-compute[71498]: iface.delayed_ack = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.tcp_nagle = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.tcp_wsf_state = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.tcp_wsf = 0
Apr 14 01:54:09 user nova-compute[71498]: iface.tcp_timer_scale = 0
Apr 14 01:54:09 user nova-compute[71498]: iface.tcp_timestamp = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.redirect = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.def_task_mgmt_timeout = 0
Apr 14 01:54:09 user nova-compute[71498]: iface.header_digest = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.data_digest = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.immediate_data = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.initial_r2t = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.data_seq_inorder = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.data_pdu_inorder = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.erl = 0
Apr 14 01:54:09 user nova-compute[71498]: iface.max_receive_data_len = 0
Apr 14 01:54:09 user nova-compute[71498]: iface.first_burst_len = 0
Apr 14 01:54:09 user nova-compute[71498]: iface.max_outstanding_r2t = 0
Apr 14 01:54:09 user nova-compute[71498]: iface.max_burst_len = 0
Apr 14 01:54:09 user nova-compute[71498]: iface.chap_auth = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.bidi_chap = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.strict_login_compliance = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.discovery_auth = <empty>
Apr 14 01:54:09 user nova-compute[71498]: iface.discovery_logout = <empty>
Apr 14 01:54:09 user nova-compute[71498]: node.discovery_address = <empty>
Apr 14 01:54:09 user nova-compute[71498]: node.discovery_port = 0
Apr 14 01:54:09 user nova-compute[71498]: node.discovery_type = static
Apr 14 01:54:09 user nova-compute[71498]: node.session.initial_cmdsn = 0
Apr 14 01:54:09 user nova-compute[71498]: node.session.initial_login_retry_max = 8
Apr 14 01:54:09 user nova-compute[71498]: node.session.xmit_thread_priority = -20
Apr 14 01:54:09 user nova-compute[71498]: node.session.cmds_max = 128
Apr 14 01:54:09 user nova-compute[71498]: node.session.queue_depth = 32
Apr 14 01:54:09 user nova-compute[71498]: node.session.nr_sessions = 1
Apr 14 01:54:09 user nova-compute[71498]: node.session.auth.authmethod = CHAP
Apr 14 01:54:09 user nova-compute[71498]: node.session.auth.username = AUTEzbSm
Apr 14 01:54:09 user nova-compute[71498]: node.session.auth.password = ***
Apr 14 01:54:09 user nova-compute[71498]: node.session.auth.username_in = <empty>
Apr 14 01:54:09 user nova-compute[71498]: node.session.auth.password_in = <empty>
Apr 14 01:54:09 user nova-compute[71498]: node.session.auth.chap_algs = MD5
Apr 14 01:54:09 user nova-compute[71498]: node.session.timeo.replacement_timeout = 120
Apr 14 01:54:09 user nova-compute[71498]: node.session.err_timeo.abort_timeout = 15
Apr 14 01:54:09 user nova-compute[71498]: node.session.err_timeo.lu_reset_timeout = 30
Apr 14 01:54:09 user nova-compute[71498]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 14 01:54:09 user nova-compute[71498]: node.session.err_timeo.host_reset_timeout = 60
Apr 14 01:54:09 user nova-compute[71498]: node.session.iscsi.FastAbort = Yes
Apr 14 01:54:09 user nova-compute[71498]: node.session.iscsi.InitialR2T = No
Apr 14 01:54:09 user nova-compute[71498]: node.session.iscsi.ImmediateData = Yes
Apr 14 01:54:09 user nova-compute[71498]: node.session.iscsi.FirstBurstLength = 262144
Apr 14 01:54:09 user nova-compute[71498]: node.session.iscsi.MaxBurstLength = 16776192
Apr 14 01:54:09 user nova-compute[71498]: node.session.iscsi.DefaultTime2Retain = 0
Apr 14 01:54:09 user nova-compute[71498]: node.session.iscsi.DefaultTime2Wait = 2
Apr 14 01:54:09 user nova-compute[71498]: node.session.iscsi.MaxConnections = 1
Apr 14 01:54:09 user nova-compute[71498]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 14 01:54:09 user nova-compute[71498]: node.session.iscsi.ERL = 0
Apr 14 01:54:09 user nova-compute[71498]: node.session.scan = manual
Apr 14 01:54:09 user nova-compute[71498]: node.session.reopen_max = 0
Apr 14 01:54:09 user nova-compute[71498]: node.conn[0].address = 172.16.0.220
Apr 14 01:54:09 user nova-compute[71498]: node.conn[0].port = 3260
Apr 14 01:54:09 user nova-compute[71498]: node.conn[0].startup = manual
Apr 14 01:54:09 user nova-compute[71498]: node.conn[0].tcp.window_size = 524288
Apr 14 01:54:09 user nova-compute[71498]: node.conn[0].tcp.type_of_service = 0
Apr 14 01:54:09 user nova-compute[71498]: node.conn[0].timeo.logout_timeout = 15
Apr 14 01:54:09 user nova-compute[71498]: node.conn[0].timeo.login_timeout = 15
Apr 14 01:54:09 user nova-compute[71498]: node.conn[0].timeo.auth_timeout = 45
Apr 14 01:54:09 user nova-compute[71498]: node.conn[0].timeo.noop_out_interval = 5
Apr 14 01:54:09 user nova-compute[71498]: node.conn[0].timeo.noop_out_timeout = 5
Apr 14 01:54:09 user nova-compute[71498]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 14 01:54:09 user nova-compute[71498]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 14 01:54:09 user nova-compute[71498]: node.conn[0].iscsi.HeaderDigest = None
Apr 14 01:54:09 user nova-compute[71498]: node.conn[0].iscsi.DataDigest = None
Apr 14 01:54:09 user nova-compute[71498]: node.conn[0].iscsi.IFMarker = No
Apr 14 01:54:09 user nova-compute[71498]: node.conn[0].iscsi.OFMarker = No
Apr 14 01:54:09 user nova-compute[71498]: # END RECORD
Apr 14 01:54:09 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d778c07e-1a9b-4796-82ad-621ece486cf0]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6908477-6e90-4c3a-bc6e-821007788e27]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AUTEzbSm {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AUTEzbSm" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c659654-8d74-4a89-8a97-ec2fc7109da7]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AUTEzbSm'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.037s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9341bb94-e91b-4d47-a8b3-cf84ea92a1d8]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed05b91-0012-475d-a68d-4cb8d9ad129b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:54:09 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:54:09 user nova-compute[71498]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:54:09 user nova-compute[71498]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)
Apr 14 01:54:09 user nova-compute[71498]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:54:09 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:54:09 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:54:09 user nova-compute[71498]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:54:09 user nova-compute[71498]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)
Apr 14 01:54:09 user nova-compute[71498]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:54:09 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.159s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] HCTL ('34', '0', '0', 0) found on session 29 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[18afb351-c59f-4d1b-8816-546113a301f6]: (4, ('0 0 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Searching for a device in session 29 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AUTEzbSm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.181s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] <== connect_volume: return (183ms) {'type': 'block', 'scsi_wwn': '23166633433633965', 'path': '/dev/sdc'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:54:09 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166633433633965', 'path': '/dev/sdc'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:54:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:52:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-831752770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-831752770',id=28,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:52:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='219c39c8299e46368012a947fdfbe5fd',ramdisk_id='',reservation_id='r-h4xgnsfu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-85797606',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:52:32Z,user_data=None,user_id='7ed01a83531f4c6bb18a4593284baf05',uuid=7ff438f4-54e1-44b9-bb5a-1b42d48a37ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6568fde8-2639-4cee-8527-e3ca028f42fd", "address": "fa:16:3e:69:f8:89", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "vif_mac": "fa:16:3e:69:f8:89"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6568fde8-26", "ovs_interfaceid": "6568fde8-2639-4cee-8527-e3ca028f42fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:54:10 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Converting VIF {"id": "6568fde8-2639-4cee-8527-e3ca028f42fd", "address": "fa:16:3e:69:f8:89", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "vif_mac": "fa:16:3e:69:f8:89"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6568fde8-26", "ovs_interfaceid": "6568fde8-2639-4cee-8527-e3ca028f42fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:54:10 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:f8:89,bridge_name='br-int',has_traffic_filtering=True,id=6568fde8-2639-4cee-8527-e3ca028f42fd,network=Network(365cbeec-3756-4258-a135-04112bdda4b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6568fde8-26') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:54:10 user nova-compute[71498]: DEBUG nova.objects.instance [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:54:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:54:10 user nova-compute[71498]:   <uuid>7ff438f4-54e1-44b9-bb5a-1b42d48a37ed</uuid>
Apr 14 01:54:10 user nova-compute[71498]:   <name>instance-0000001c</name>
Apr 14 01:54:10 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:54:10 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:54:10 user nova-compute[71498]:   <metadata>
Apr 14 01:54:10 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:54:10 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:54:10 user nova-compute[71498]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-831752770</nova:name>
Apr 14 01:54:10 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:54:09</nova:creationTime>
Apr 14 01:54:10 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:54:10 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:54:10 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:54:10 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:54:10 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:54:10 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:54:10 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:54:10 user nova-compute[71498]:       <nova:owner>
Apr 14 01:54:10 user nova-compute[71498]:         <nova:user uuid="7ed01a83531f4c6bb18a4593284baf05">tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member</nova:user>
Apr 14 01:54:10 user nova-compute[71498]:         <nova:project uuid="219c39c8299e46368012a947fdfbe5fd">tempest-ServerBootFromVolumeStableRescueTest-85797606</nova:project>
Apr 14 01:54:10 user nova-compute[71498]:       </nova:owner>
Apr 14 01:54:10 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:54:10 user nova-compute[71498]:       <nova:ports>
Apr 14 01:54:10 user nova-compute[71498]:         <nova:port uuid="6568fde8-2639-4cee-8527-e3ca028f42fd">
Apr 14 01:54:10 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 01:54:10 user nova-compute[71498]:         </nova:port>
Apr 14 01:54:10 user nova-compute[71498]:       </nova:ports>
Apr 14 01:54:10 user nova-compute[71498]:     </nova:instance>
Apr 14 01:54:10 user nova-compute[71498]:   </metadata>
Apr 14 01:54:10 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:54:10 user nova-compute[71498]:     <system>
Apr 14 01:54:10 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:54:10 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:54:10 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:54:10 user nova-compute[71498]:       <entry name="serial">7ff438f4-54e1-44b9-bb5a-1b42d48a37ed</entry>
Apr 14 01:54:10 user nova-compute[71498]:       <entry name="uuid">7ff438f4-54e1-44b9-bb5a-1b42d48a37ed</entry>
Apr 14 01:54:10 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:54:10 user nova-compute[71498]:     </system>
Apr 14 01:54:10 user nova-compute[71498]:   </sysinfo>
Apr 14 01:54:10 user nova-compute[71498]:   <os>
Apr 14 01:54:10 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:54:10 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:54:10 user nova-compute[71498]:   </os>
Apr 14 01:54:10 user nova-compute[71498]:   <features>
Apr 14 01:54:10 user nova-compute[71498]:     <acpi/>
Apr 14 01:54:10 user nova-compute[71498]:     <apic/>
Apr 14 01:54:10 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:54:10 user nova-compute[71498]:   </features>
Apr 14 01:54:10 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:54:10 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:54:10 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:54:10 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:54:10 user nova-compute[71498]:   </clock>
Apr 14 01:54:10 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:54:10 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:54:10 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:54:10 user nova-compute[71498]:   </cpu>
Apr 14 01:54:10 user nova-compute[71498]:   <devices>
Apr 14 01:54:10 user nova-compute[71498]:     <disk type="block" device="disk">
Apr 14 01:54:10 user nova-compute[71498]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:54:10 user nova-compute[71498]:       <source dev="/dev/sdc"/>
Apr 14 01:54:10 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:54:10 user nova-compute[71498]:       <serial>2f2f2823-8b6e-49ae-ad4e-ed05a02421ae</serial>
Apr 14 01:54:10 user nova-compute[71498]:     </disk>
Apr 14 01:54:10 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:54:10 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:54:10 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed/disk.rescue"/>
Apr 14 01:54:10 user nova-compute[71498]:       <target dev="vdb" bus="virtio"/>
Apr 14 01:54:10 user nova-compute[71498]:       <boot order="1"/>
Apr 14 01:54:10 user nova-compute[71498]:     </disk>
Apr 14 01:54:10 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:54:10 user nova-compute[71498]:       <mac address="fa:16:3e:69:f8:89"/>
Apr 14 01:54:10 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:54:10 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:54:10 user nova-compute[71498]:       <target dev="tap6568fde8-26"/>
Apr 14 01:54:10 user nova-compute[71498]:     </interface>
Apr 14 01:54:10 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:54:10 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed/console.log" append="off"/>
Apr 14 01:54:10 user nova-compute[71498]:     </serial>
Apr 14 01:54:10 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:54:10 user nova-compute[71498]:     <video>
Apr 14 01:54:10 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:54:10 user nova-compute[71498]:     </video>
Apr 14 01:54:10 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:54:10 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:54:10 user nova-compute[71498]:     </rng>
Apr 14 01:54:10 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:54:10 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:54:10 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:54:10 user nova-compute[71498]:     </memballoon>
Apr 14 01:54:10 user nova-compute[71498]:   </devices>
Apr 14 01:54:10 user nova-compute[71498]: </domain>
Apr 14 01:54:10 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:54:10 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Instance destroyed successfully.
Apr 14 01:54:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:54:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:54:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] No VIF found with MAC fa:16:3e:69:f8:89, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG nova.compute.manager [req-0d2dd465-4027-42ce-af11-e374fa508210 req-e0754841-fe74-4d64-a019-1813d4a57ff9 service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Received event network-vif-plugged-6568fde8-2639-4cee-8527-e3ca028f42fd {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0d2dd465-4027-42ce-af11-e374fa508210 req-e0754841-fe74-4d64-a019-1813d4a57ff9 service nova] Acquiring lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0d2dd465-4027-42ce-af11-e374fa508210 req-e0754841-fe74-4d64-a019-1813d4a57ff9 service nova] Lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0d2dd465-4027-42ce-af11-e374fa508210 req-e0754841-fe74-4d64-a019-1813d4a57ff9 service nova] Lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG nova.compute.manager [req-0d2dd465-4027-42ce-af11-e374fa508210 req-e0754841-fe74-4d64-a019-1813d4a57ff9 service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] No waiting events found dispatching network-vif-plugged-6568fde8-2639-4cee-8527-e3ca028f42fd {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:54:11 user nova-compute[71498]: WARNING nova.compute.manager [req-0d2dd465-4027-42ce-af11-e374fa508210 req-e0754841-fe74-4d64-a019-1813d4a57ff9 service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Received unexpected event network-vif-plugged-6568fde8-2639-4cee-8527-e3ca028f42fd for instance with vm_state active and task_state rescuing.
Apr 14 01:54:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vNWpMtFL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:54:11 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:54:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:54:11 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:54:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:54:11 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:54:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d1dd96-926b-480e-909a-9b46bb3ba0da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:54:11 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97b169f-1ffd-4199-a3ee-d67a521b698b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f] added
Apr 14 01:54:11 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e6c409-335c-4731-9baf-7c547035c78d]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a23620-f0ff-4da5-be20-ddf675b69956]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vNWpMtFL {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vNWpMtFL" returned: 0 in 0.068s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e18d2d-6523-4054-b43a-044a157c4396]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vNWpMtFL'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4077908c-91a0-477c-8aa8-54d30f0bd7ce]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57d667e-f30d-49cf-9a9e-2bf74564a453]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:54:11 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:54:11 user nova-compute[71498]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:54:11 user nova-compute[71498]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)
Apr 14 01:54:11 user nova-compute[71498]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:54:11 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:54:11 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:54:11 user nova-compute[71498]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:54:11 user nova-compute[71498]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)
Apr 14 01:54:11 user nova-compute[71498]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:54:11 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:54:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[264bcc43-fdf8-47a0-8f40-50f86e515efe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f, portal: 172.16.0.220,3260]
Apr 14 01:54:12 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f, portal: 172.16.0.220,3260] successful.
Apr 14 01:54:12 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[133c68f7-ee6f-4590-b288-c307ea98cd22]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd6eec4-bd3a-4c2e-8f0f-ec1ca08f3e8b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:54:12 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:54:12 user nova-compute[71498]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:54:12 user nova-compute[71498]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)
Apr 14 01:54:12 user nova-compute[71498]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:54:12 user nova-compute[71498]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:54:12 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:54:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:54:12 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:54:12 user nova-compute[71498]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:54:12 user nova-compute[71498]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)
Apr 14 01:54:12 user nova-compute[71498]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:54:12 user nova-compute[71498]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:54:12 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:54:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.406s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:54:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:54:12 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] HCTL ('38', '-', '-', 0) found on session 33 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:54:12 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:54:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a264357-eb19-459f-ad21-ce60b36b9ac0]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:12 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Searching for a device in session 33 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:54:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vNWpMtFL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:54:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.438s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:54:13 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] <== connect_volume: return (1439ms) {'type': 'block', 'scsi_wwn': '23133633338326462', 'path': '/dev/sdg'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:54:13 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133633338326462', 'path': '/dev/sdg'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:54:13 user nova-compute[71498]: DEBUG nova.objects.instance [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lazy-loading 'flavor' on Instance uuid 73cc8ede-babd-4281-bf1d-c5a3f8bad440 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:54:13 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 01:54:13 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:54:13 user nova-compute[71498]:   <source dev="/dev/sdg"/>
Apr 14 01:54:13 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:54:13 user nova-compute[71498]:   <serial>55aa3df5-b363-4e8f-ac2e-f46bea9ca67f</serial>
Apr 14 01:54:13 user nova-compute[71498]: </disk>
Apr 14 01:54:13 user nova-compute[71498]:  {{(pid=71498) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 01:54:13 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:54:13 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:54:13 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] No VIF found with MAC fa:16:3e:b2:d1:94, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:54:13 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Removed pending event for 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed due to event {{(pid=71498) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 01:54:13 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437253.630391, 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:54:13 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] VM Resumed (Lifecycle Event)
Apr 14 01:54:13 user nova-compute[71498]: DEBUG nova.compute.manager [None req-71c34040-fda7-482d-aca7-4e96962dbcf9 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:54:13 user nova-compute[71498]: DEBUG nova.compute.manager [req-044c0758-5ad2-4b81-8afc-263cf9271ca9 req-dfcfb992-a6b7-496d-9d30-0ae0e71d7886 service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Received event network-vif-plugged-6568fde8-2639-4cee-8527-e3ca028f42fd {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:54:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-044c0758-5ad2-4b81-8afc-263cf9271ca9 req-dfcfb992-a6b7-496d-9d30-0ae0e71d7886 service nova] Acquiring lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:54:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-044c0758-5ad2-4b81-8afc-263cf9271ca9 req-dfcfb992-a6b7-496d-9d30-0ae0e71d7886 service nova] Lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:54:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-044c0758-5ad2-4b81-8afc-263cf9271ca9 req-dfcfb992-a6b7-496d-9d30-0ae0e71d7886 service nova] Lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:54:13 user nova-compute[71498]: DEBUG nova.compute.manager [req-044c0758-5ad2-4b81-8afc-263cf9271ca9 req-dfcfb992-a6b7-496d-9d30-0ae0e71d7886 service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] No waiting events found dispatching network-vif-plugged-6568fde8-2639-4cee-8527-e3ca028f42fd {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:54:13 user nova-compute[71498]: WARNING nova.compute.manager [req-044c0758-5ad2-4b81-8afc-263cf9271ca9 req-dfcfb992-a6b7-496d-9d30-0ae0e71d7886 service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Received unexpected event network-vif-plugged-6568fde8-2639-4cee-8527-e3ca028f42fd for instance with vm_state active and task_state rescuing.
Apr 14 01:54:13 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:54:13 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:54:13 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 01:54:13 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437253.6316955, 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:54:13 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] VM Started (Lifecycle Event)
Apr 14 01:54:13 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:54:13 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:54:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a1cebd51-b651-415e-9d3e-612557424009 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.903s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:54:15 user nova-compute[71498]: DEBUG nova.compute.manager [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Stashing vm_state: active {{(pid=71498) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 14 01:54:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:54:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:54:15 user nova-compute[71498]: DEBUG nova.objects.instance [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lazy-loading 'pci_requests' on Instance uuid 73cc8ede-babd-4281-bf1d-c5a3f8bad440 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:54:15 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:54:15 user nova-compute[71498]: INFO nova.compute.claims [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Claim successful on node user
Apr 14 01:54:15 user nova-compute[71498]: DEBUG nova.objects.instance [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lazy-loading 'resources' on Instance uuid 73cc8ede-babd-4281-bf1d-c5a3f8bad440 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:54:15 user nova-compute[71498]: DEBUG nova.objects.instance [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lazy-loading 'pci_devices' on Instance uuid 73cc8ede-babd-4281-bf1d-c5a3f8bad440 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:54:15 user nova-compute[71498]: INFO nova.compute.resource_tracker [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Updating resource usage from migration fffda8d2-cec8-4809-a410-4bc405a28d5c
Apr 14 01:54:15 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:54:16 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:54:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.500s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:54:16 user nova-compute[71498]: INFO nova.compute.manager [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Migrating
Apr 14 01:54:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:54:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquired lock "compute-rpcapi-router" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:54:16 user nova-compute[71498]: INFO nova.compute.rpcapi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Apr 14 01:54:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Releasing lock "compute-rpcapi-router" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:54:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "refresh_cache-73cc8ede-babd-4281-bf1d-c5a3f8bad440" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:54:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquired lock "refresh_cache-73cc8ede-babd-4281-bf1d-c5a3f8bad440" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:54:16 user nova-compute[71498]: DEBUG nova.network.neutron [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:54:16 user nova-compute[71498]: DEBUG nova.network.neutron [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Updating instance_info_cache with network_info: [{"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:54:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Releasing lock "refresh_cache-73cc8ede-babd-4281-bf1d-c5a3f8bad440" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:54:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Starting migrate_disk_and_power_off {{(pid=71498) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 14 01:54:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG nova.compute.manager [req-6dd929fa-6f4a-4b4b-8014-e1d80817244f req-ffd980c8-b414-434f-8e08-0731a9f130f6 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Received event network-vif-unplugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6dd929fa-6f4a-4b4b-8014-e1d80817244f req-ffd980c8-b414-434f-8e08-0731a9f130f6 service nova] Acquiring lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6dd929fa-6f4a-4b4b-8014-e1d80817244f req-ffd980c8-b414-434f-8e08-0731a9f130f6 service nova] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6dd929fa-6f4a-4b4b-8014-e1d80817244f req-ffd980c8-b414-434f-8e08-0731a9f130f6 service nova] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG nova.compute.manager [req-6dd929fa-6f4a-4b4b-8014-e1d80817244f req-ffd980c8-b414-434f-8e08-0731a9f130f6 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] No waiting events found dispatching network-vif-unplugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:54:17 user nova-compute[71498]: WARNING nova.compute.manager [req-6dd929fa-6f4a-4b4b-8014-e1d80817244f req-ffd980c8-b414-434f-8e08-0731a9f130f6 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Received unexpected event network-vif-unplugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 for instance with vm_state active and task_state resize_migrating.
Apr 14 01:54:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:17 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Instance destroyed successfully.
Apr 14 01:54:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T01:45:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-889087873',display_name='tempest-ServerActionsTestJSON-server-311342760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-889087873',id=20,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7iIvlhM+wCditCRaonOriLx8WWyehY8kYxTUZ36Z1Q4VGm2JnuefQ18D+1ncnGXJXgbpg/EWHmDPRQFx9TQ2PBQ5aNgSGRUcq/Ovi+zGjOYQDNVYkQyEvsulSNtijWoQ==',key_name='tempest-keypair-165395776',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:49:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2ed4ed4ab2fd4c14b3e2afe343fd7256',ramdisk_id='',reservation_id='r-1656hccc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2035821517',owner_user_name='tempest-ServerActionsTestJSON-2035821517-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:54:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78ccd1a1ec1b486981d850881734fe02',uuid=73cc8ede-babd-4281-bf1d-c5a3f8bad440,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1797376284-network", "vif_mac": "fa:16:3e:b2:d1:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converting VIF {"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1797376284-network", "vif_mac": "fa:16:3e:b2:d1:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:d1:94,bridge_name='br-int',has_traffic_filtering=True,id=84d281bf-164e-48f3-a3ee-ca796d9a48e7,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d281bf-16') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG os_vif [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:d1:94,bridge_name='br-int',has_traffic_filtering=True,id=84d281bf-164e-48f3-a3ee-ca796d9a48e7,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d281bf-16') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84d281bf-16, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:17 user nova-compute[71498]: INFO os_vif [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:d1:94,bridge_name='br-int',has_traffic_filtering=True,id=84d281bf-164e-48f3-a3ee-ca796d9a48e7,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d281bf-16')
Apr 14 01:54:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vNWpMtFL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:54:17 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:54:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11520c8-dce9-460e-9d99-161899b2f658]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:54:17 user nova-compute[71498]: No targets found.
Apr 14 01:54:17 user nova-compute[71498]: iSNS:
Apr 14 01:54:17 user nova-compute[71498]: No targets found.
Apr 14 01:54:17 user nova-compute[71498]: STATIC:
Apr 14 01:54:17 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f
Apr 14 01:54:17 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:54:17 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:54:17 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860
Apr 14 01:54:17 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:54:17 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:54:17 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae
Apr 14 01:54:17 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:54:17 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:54:17 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25
Apr 14 01:54:17 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:54:17 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:54:17 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10
Apr 14 01:54:17 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:54:17 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:54:17 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22
Apr 14 01:54:17 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:54:17 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:54:17 user nova-compute[71498]: FIRMWARE:
Apr 14 01:54:17 user nova-compute[71498]: No targets found.
Apr 14 01:54:17 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:54:17 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:54:17 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[216a9751-0c28-4181-a32c-7dd99e092e0a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[18482a2a-6b99-4fba-bbe4-a7b1cc2e280a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:54:17 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:54:17 user nova-compute[71498]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:54:17 user nova-compute[71498]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)
Apr 14 01:54:17 user nova-compute[71498]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:54:17 user nova-compute[71498]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:54:17 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:54:17 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:54:17 user nova-compute[71498]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:54:17 user nova-compute[71498]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)
Apr 14 01:54:17 user nova-compute[71498]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:54:17 user nova-compute[71498]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:54:17 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51c469f2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f'): ({'sdg'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Removing single pathed devices sdg {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3397ae6c-4bc7-4d4f-a721-d209dda87a38]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1286cb29-8f4a-4582-903a-70be37cbc4c9]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Flushing IO for device /dev/sdg {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[27529d54-83dc-40c4-9d65-b0f8ce3e5f15]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.038s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[480ec567-1b3f-498b-847e-19840990da43]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] SCSI volumes sdg have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28f33c4-4c99-427b-9720-9a285e3b6896]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9269f14a-f59d-4608-8088-54b8fee6f6aa]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f, portal: 172.16.0.220,3260]
Apr 14 01:54:17 user nova-compute[71498]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f, portal: 172.16.0.220,3260] successful.
Apr 14 01:54:17 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b955bc1-e0ba-436f-b56d-ce63cf5b9cc2]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] <== disconnect_volume: return (324ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:54:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:18 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:54:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440_resize/disk /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] CMD "cp -r /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440_resize/disk /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk" returned: 0 in 0.254s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440_resize/disk.info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk.info {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] CMD "cp -r /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440_resize/disk.info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk.info" returned: 0 in 0.043s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:19 user nova-compute[71498]: DEBUG nova.compute.manager [req-6077e4fc-baa1-4a7f-9025-75b878ecdb6c req-1d0981e6-64bf-4e7c-b130-d67b6fed7ad2 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Received event network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:54:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6077e4fc-baa1-4a7f-9025-75b878ecdb6c req-1d0981e6-64bf-4e7c-b130-d67b6fed7ad2 service nova] Acquiring lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:54:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6077e4fc-baa1-4a7f-9025-75b878ecdb6c req-1d0981e6-64bf-4e7c-b130-d67b6fed7ad2 service nova] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:54:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6077e4fc-baa1-4a7f-9025-75b878ecdb6c req-1d0981e6-64bf-4e7c-b130-d67b6fed7ad2 service nova] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:54:19 user nova-compute[71498]: DEBUG nova.compute.manager [req-6077e4fc-baa1-4a7f-9025-75b878ecdb6c req-1d0981e6-64bf-4e7c-b130-d67b6fed7ad2 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] No waiting events found dispatching network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:54:19 user nova-compute[71498]: WARNING nova.compute.manager [req-6077e4fc-baa1-4a7f-9025-75b878ecdb6c req-1d0981e6-64bf-4e7c-b130-d67b6fed7ad2 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Received unexpected event network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 for instance with vm_state active and task_state resize_migrating.
Apr 14 01:54:19 user nova-compute[71498]: DEBUG nova.network.neutron [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Port 84d281bf-164e-48f3-a3ee-ca796d9a48e7 binding to destination host user is already ACTIVE {{(pid=71498) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 14 01:54:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:54:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:54:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:54:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "refresh_cache-73cc8ede-babd-4281-bf1d-c5a3f8bad440" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:54:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquired lock "refresh_cache-73cc8ede-babd-4281-bf1d-c5a3f8bad440" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:54:19 user nova-compute[71498]: DEBUG nova.network.neutron [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:54:20 user nova-compute[71498]: DEBUG nova.network.neutron [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Updating instance_info_cache with network_info: [{"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:54:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Releasing lock "refresh_cache-73cc8ede-babd-4281-bf1d-c5a3f8bad440" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:54:20 user nova-compute[71498]: DEBUG os_brick.utils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:54:20 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:20 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:20 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90db767-5466-45b8-9285-cad1c72a215c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:20 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:20 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:20 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b12dc5-d420-4544-a74d-4bb3740cc764]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:20 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:20 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:20 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dca866-3eae-42b5-9cfa-11b74a8f951c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:20 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcacdfa-4ab7-4235-943c-684ecc2e61e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:20 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:20 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:54:20 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:54:20 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:20 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:54:20 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:54:20 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be1d79e-3032-4eed-9673-5aa4a33e61d3]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:20 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:54:20 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:54:20 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:54:20 user nova-compute[71498]: DEBUG os_brick.utils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:54:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:24 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Starting finish_migration {{(pid=71498) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 14 01:54:24 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Instance directory exists: not creating {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 01:54:24 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Creating image(s)
Apr 14 01:54:24 user nova-compute[71498]: DEBUG nova.objects.instance [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lazy-loading 'trusted_certs' on Instance uuid 73cc8ede-babd-4281-bf1d-c5a3f8bad440 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:54:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.135s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Checking if we can resize image /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Cannot resize image /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Did not create local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Ensure instance console log exists: /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Start _get_guest_xml network_info=[{"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1797376284-network", "vif_mac": "fa:16:3e:b2:d1:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '4469cfd0-7af5-4ba9-855e-7d4028f7bdbc', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vNWpMtFL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '73cc8ede-babd-4281-bf1d-c5a3f8bad440', 'attached_at': '2023-04-14T01:54:25.000000', 'detached_at': '', 'volume_id': '55aa3df5-b363-4e8f-ac2e-f46bea9ca67f', 'serial': '55aa3df5-b363-4e8f-ac2e-f46bea9ca67f'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:54:25 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:54:25 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:54:25 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:05Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG nova.objects.instance [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lazy-loading 'vcpu_model' on Instance uuid 73cc8ede-babd-4281-bf1d-c5a3f8bad440 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vNWpMtFL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:54:25 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:54:25 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:54:25 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:54:25 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:54:25 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[95716d37-82b6-42c8-8691-fb00e184cb33]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:54:25 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f937b411-c52b-48a9-ac55-c7362ddc6b39]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f] added
Apr 14 01:54:25 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e906082c-b486-48a1-ba25-d330604fe1b5]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9255dc79-a8fe-4403-98a9-ec5a362f39a3]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vNWpMtFL {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vNWpMtFL" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8921236c-8849-4582-8f2f-31df165a3e38]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vNWpMtFL'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d919b6-cb2e-4d89-8cd5-ea1d302d3d0b]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[466cd14d-3c20-435c-aa5a-5d8503d5c842]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:54:25 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:54:25 user nova-compute[71498]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:54:25 user nova-compute[71498]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)
Apr 14 01:54:25 user nova-compute[71498]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:54:25 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:54:25 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:54:25 user nova-compute[71498]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:54:25 user nova-compute[71498]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)
Apr 14 01:54:25 user nova-compute[71498]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:54:25 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[840ae0a9-0215-4122-8fae-6e02ce5cf912]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f, portal: 172.16.0.220,3260]
Apr 14 01:54:25 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f, portal: 172.16.0.220,3260] successful.
Apr 14 01:54:25 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c14ee56-97bb-478c-be27-8e0aa8e161c2]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG nova.objects.instance [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'flavor' on Instance uuid 85b399dc-62df-480d-8561-5d9d1ab75c52 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cda722-0fcc-49c0-930f-2267cbf07a4b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:54:25 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:54:25 user nova-compute[71498]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:54:25 user nova-compute[71498]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)
Apr 14 01:54:25 user nova-compute[71498]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:54:25 user nova-compute[71498]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:54:25 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:54:25 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:54:25 user nova-compute[71498]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:54:25 user nova-compute[71498]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)
Apr 14 01:54:25 user nova-compute[71498]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:54:25 user nova-compute[71498]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:54:25 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] HCTL ('38', '-', '-', 0) found on session 34 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae7e8a3-c322-4bf8-8c05-87eb7508ad42]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Searching for a device in session 34 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vNWpMtFL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "refresh_cache-85b399dc-62df-480d-8561-5d9d1ab75c52" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquired lock "refresh_cache-85b399dc-62df-480d-8561-5d9d1ab75c52" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG nova.network.neutron [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:54:25 user nova-compute[71498]: DEBUG nova.objects.instance [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'info_cache' on Instance uuid 85b399dc-62df-480d-8561-5d9d1ab75c52 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG nova.network.neutron [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Updating instance_info_cache with network_info: [{"id": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "address": "fa:16:3e:c2:1d:7f", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31ffaf4-6b", "ovs_interfaceid": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Releasing lock "refresh_cache-85b399dc-62df-480d-8561-5d9d1ab75c52" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:54:26 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Instance destroyed successfully.
Apr 14 01:54:26 user nova-compute[71498]: DEBUG nova.objects.instance [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'resources' on Instance uuid 85b399dc-62df-480d-8561-5d9d1ab75c52 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:50:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-325708357',display_name='tempest-AttachVolumeTestJSON-server-325708357',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-325708357',id=27,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvk+JYMt+HZ39UKnyK9XjRAYXFTfLUFV2C7qQoN4BD8jI9jpYJTV8jA9OgD5QAxdNshSqirCRpZ3xA98RiAsOOX3u/3A0BiHL6YVfgoocjrtHZ6NQNKyL6LjNBDUv8OmA==',key_name='tempest-keypair-2007571811',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:50:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0f650e04d2c947498b9e7a8d002862ad',ramdisk_id='',reservation_id='r-d003i0bm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-296004410',owner_user_name='tempest-AttachVolumeTestJSON-296004410-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:52:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba0894753a074f99ab226fde0565dd28',uuid=85b399dc-62df-480d-8561-5d9d1ab75c52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "address": "fa:16:3e:c2:1d:7f", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31ffaf4-6b", "ovs_interfaceid": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Converting VIF {"id": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "address": "fa:16:3e:c2:1d:7f", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31ffaf4-6b", "ovs_interfaceid": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1d:7f,bridge_name='br-int',has_traffic_filtering=True,id=e31ffaf4-6b2b-4099-88b5-683bc51ccfdf,network=Network(fe9d57b9-96e8-424e-8dc9-0c95f1aff03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape31ffaf4-6b') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG os_vif [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1d:7f,bridge_name='br-int',has_traffic_filtering=True,id=e31ffaf4-6b2b-4099-88b5-683bc51ccfdf,network=Network(fe9d57b9-96e8-424e-8dc9-0c95f1aff03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape31ffaf4-6b') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape31ffaf4-6b, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:54:26 user nova-compute[71498]: INFO os_vif [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1d:7f,bridge_name='br-int',has_traffic_filtering=True,id=e31ffaf4-6b2b-4099-88b5-683bc51ccfdf,network=Network(fe9d57b9-96e8-424e-8dc9-0c95f1aff03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape31ffaf4-6b')
Apr 14 01:54:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'txGYAkUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:54:26 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:54:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23133633338326462', 'path': '/dev/sdg'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133633338326462', 'path': '/dev/sdg'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.375s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T01:45:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-889087873',display_name='tempest-ServerActionsTestJSON-server-311342760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-889087873',id=20,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7iIvlhM+wCditCRaonOriLx8WWyehY8kYxTUZ36Z1Q4VGm2JnuefQ18D+1ncnGXJXgbpg/EWHmDPRQFx9TQ2PBQ5aNgSGRUcq/Ovi+zGjOYQDNVYkQyEvsulSNtijWoQ==',key_name='tempest-keypair-165395776',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:49:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2ed4ed4ab2fd4c14b3e2afe343fd7256',ramdisk_id='',reservation_id='r-1656hccc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2035821517',owner_user_name='tempest-ServerActionsTestJSON-2035821517-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:54:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78ccd1a1ec1b486981d850881734fe02',uuid=73cc8ede-babd-4281-bf1d-c5a3f8bad440,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1797376284-network", "vif_mac": "fa:16:3e:b2:d1:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converting VIF {"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1797376284-network", "vif_mac": "fa:16:3e:b2:d1:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d1:94,bridge_name='br-int',has_traffic_filtering=True,id=84d281bf-164e-48f3-a3ee-ca796d9a48e7,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d281bf-16') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:54:26 user nova-compute[71498]:   <uuid>73cc8ede-babd-4281-bf1d-c5a3f8bad440</uuid>
Apr 14 01:54:26 user nova-compute[71498]:   <name>instance-00000014</name>
Apr 14 01:54:26 user nova-compute[71498]:   <memory>196608</memory>
Apr 14 01:54:26 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:54:26 user nova-compute[71498]:   <metadata>
Apr 14 01:54:26 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:54:26 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:54:26 user nova-compute[71498]:       <nova:name>tempest-ServerActionsTestJSON-server-311342760</nova:name>
Apr 14 01:54:26 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:54:25</nova:creationTime>
Apr 14 01:54:26 user nova-compute[71498]:       <nova:flavor name="m1.micro">
Apr 14 01:54:26 user nova-compute[71498]:         <nova:memory>192</nova:memory>
Apr 14 01:54:26 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:54:26 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:54:26 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:54:26 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:54:26 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:54:26 user nova-compute[71498]:       <nova:owner>
Apr 14 01:54:26 user nova-compute[71498]:         <nova:user uuid="78ccd1a1ec1b486981d850881734fe02">tempest-ServerActionsTestJSON-2035821517-project-member</nova:user>
Apr 14 01:54:26 user nova-compute[71498]:         <nova:project uuid="2ed4ed4ab2fd4c14b3e2afe343fd7256">tempest-ServerActionsTestJSON-2035821517</nova:project>
Apr 14 01:54:26 user nova-compute[71498]:       </nova:owner>
Apr 14 01:54:26 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:54:26 user nova-compute[71498]:       <nova:ports>
Apr 14 01:54:26 user nova-compute[71498]:         <nova:port uuid="84d281bf-164e-48f3-a3ee-ca796d9a48e7">
Apr 14 01:54:26 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 01:54:26 user nova-compute[71498]:         </nova:port>
Apr 14 01:54:26 user nova-compute[71498]:       </nova:ports>
Apr 14 01:54:26 user nova-compute[71498]:     </nova:instance>
Apr 14 01:54:26 user nova-compute[71498]:   </metadata>
Apr 14 01:54:26 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:54:26 user nova-compute[71498]:     <system>
Apr 14 01:54:26 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:54:26 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:54:26 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:54:26 user nova-compute[71498]:       <entry name="serial">73cc8ede-babd-4281-bf1d-c5a3f8bad440</entry>
Apr 14 01:54:26 user nova-compute[71498]:       <entry name="uuid">73cc8ede-babd-4281-bf1d-c5a3f8bad440</entry>
Apr 14 01:54:26 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:54:26 user nova-compute[71498]:     </system>
Apr 14 01:54:26 user nova-compute[71498]:   </sysinfo>
Apr 14 01:54:26 user nova-compute[71498]:   <os>
Apr 14 01:54:26 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:54:26 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:54:26 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:54:26 user nova-compute[71498]:   </os>
Apr 14 01:54:26 user nova-compute[71498]:   <features>
Apr 14 01:54:26 user nova-compute[71498]:     <acpi/>
Apr 14 01:54:26 user nova-compute[71498]:     <apic/>
Apr 14 01:54:26 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:54:26 user nova-compute[71498]:   </features>
Apr 14 01:54:26 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:54:26 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:54:26 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:54:26 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:54:26 user nova-compute[71498]:   </clock>
Apr 14 01:54:26 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:54:26 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:54:26 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:54:26 user nova-compute[71498]:   </cpu>
Apr 14 01:54:26 user nova-compute[71498]:   <devices>
Apr 14 01:54:26 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:54:26 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:54:26 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk"/>
Apr 14 01:54:26 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:54:26 user nova-compute[71498]:     </disk>
Apr 14 01:54:26 user nova-compute[71498]:     <disk type="block" device="disk">
Apr 14 01:54:26 user nova-compute[71498]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:54:26 user nova-compute[71498]:       <source dev="/dev/sdg"/>
Apr 14 01:54:26 user nova-compute[71498]:       <target dev="vdb" bus="virtio"/>
Apr 14 01:54:26 user nova-compute[71498]:       <serial>55aa3df5-b363-4e8f-ac2e-f46bea9ca67f</serial>
Apr 14 01:54:26 user nova-compute[71498]:     </disk>
Apr 14 01:54:26 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:54:26 user nova-compute[71498]:       <mac address="fa:16:3e:b2:d1:94"/>
Apr 14 01:54:26 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:54:26 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:54:26 user nova-compute[71498]:       <target dev="tap84d281bf-16"/>
Apr 14 01:54:26 user nova-compute[71498]:     </interface>
Apr 14 01:54:26 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:54:26 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/console.log" append="off"/>
Apr 14 01:54:26 user nova-compute[71498]:     </serial>
Apr 14 01:54:26 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:54:26 user nova-compute[71498]:     <video>
Apr 14 01:54:26 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:54:26 user nova-compute[71498]:     </video>
Apr 14 01:54:26 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:54:26 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:54:26 user nova-compute[71498]:     </rng>
Apr 14 01:54:26 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:54:26 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:54:26 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:54:26 user nova-compute[71498]:     </memballoon>
Apr 14 01:54:26 user nova-compute[71498]:   </devices>
Apr 14 01:54:26 user nova-compute[71498]: </domain>
Apr 14 01:54:26 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T01:45:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-889087873',display_name='tempest-ServerActionsTestJSON-server-311342760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-889087873',id=20,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7iIvlhM+wCditCRaonOriLx8WWyehY8kYxTUZ36Z1Q4VGm2JnuefQ18D+1ncnGXJXgbpg/EWHmDPRQFx9TQ2PBQ5aNgSGRUcq/Ovi+zGjOYQDNVYkQyEvsulSNtijWoQ==',key_name='tempest-keypair-165395776',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:49:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2ed4ed4ab2fd4c14b3e2afe343fd7256',ramdisk_id='',reservation_id='r-1656hccc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2035821517',owner_user_name='tempest-ServerActionsTestJSON-2035821517-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:54:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78ccd1a1ec1b486981d850881734fe02',uuid=73cc8ede-babd-4281-bf1d-c5a3f8bad440,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1797376284-network", "vif_mac": "fa:16:3e:b2:d1:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converting VIF {"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1797376284-network", "vif_mac": "fa:16:3e:b2:d1:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d1:94,bridge_name='br-int',has_traffic_filtering=True,id=84d281bf-164e-48f3-a3ee-ca796d9a48e7,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d281bf-16') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG os_vif [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d1:94,bridge_name='br-int',has_traffic_filtering=True,id=84d281bf-164e-48f3-a3ee-ca796d9a48e7,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d281bf-16') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7f105c-d3e2-4f9a-95f3-5015d4bf08b4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:54:26 user nova-compute[71498]: No targets found.
Apr 14 01:54:26 user nova-compute[71498]: iSNS:
Apr 14 01:54:26 user nova-compute[71498]: No targets found.
Apr 14 01:54:26 user nova-compute[71498]: STATIC:
Apr 14 01:54:26 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f
Apr 14 01:54:26 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:54:26 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:54:26 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860
Apr 14 01:54:26 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:54:26 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:54:26 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae
Apr 14 01:54:26 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:54:26 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:54:26 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25
Apr 14 01:54:26 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:54:26 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:54:26 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10
Apr 14 01:54:26 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:54:26 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:54:26 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22
Apr 14 01:54:26 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:54:26 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:54:26 user nova-compute[71498]: FIRMWARE:
Apr 14 01:54:26 user nova-compute[71498]: No targets found.
Apr 14 01:54:26 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:54:26 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:54:26 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84d281bf-16, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap84d281bf-16, col_values=(('external_ids', {'iface-id': '84d281bf-164e-48f3-a3ee-ca796d9a48e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:d1:94', 'vm-uuid': '73cc8ede-babd-4281-bf1d-c5a3f8bad440'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:26 user nova-compute[71498]: INFO os_vif [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d1:94,bridge_name='br-int',has_traffic_filtering=True,id=84d281bf-164e-48f3-a3ee-ca796d9a48e7,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d281bf-16')
Apr 14 01:54:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9283b29a-a93d-44fb-b873-40ca87566710]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b24b2d8-d960-4b95-9e3d-5dcc31f83cdf]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:54:26 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:54:26 user nova-compute[71498]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:54:26 user nova-compute[71498]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)
Apr 14 01:54:26 user nova-compute[71498]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:54:26 user nova-compute[71498]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:54:26 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:54:26 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:54:26 user nova-compute[71498]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:54:26 user nova-compute[71498]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)
Apr 14 01:54:26 user nova-compute[71498]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:54:26 user nova-compute[71498]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:54:26 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52013f8310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10'): ({'sdd'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Removing single pathed devices sdd {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7faaea4b-7756-4aab-bd5a-43c6b98eec55]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] No VIF found with MAC fa:16:3e:b2:d1:94, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[40827a1f-4391-4b71-998b-ad37860f8c6a]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Flushing IO for device /dev/sdd {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[472b2ff1-3cd9-4d86-bf06-75656f7951a0]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[31aa1148-8b88-4498-832c-f37efc081553]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] SCSI volumes sdd have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3122d7-8d4f-4fda-a07b-1480c741085a]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e1bd29-eeee-4335-854e-2fabd7a66d59]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10, portal: 172.16.0.220,3260]
Apr 14 01:54:26 user nova-compute[71498]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10, portal: 172.16.0.220,3260] successful.
Apr 14 01:54:26 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[64153c37-6bcb-43dc-8bbd-752e5ceeb1b9]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] <== disconnect_volume: return (702ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Start _get_guest_xml network_info=[{"id": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "address": "fa:16:3e:c2:1d:7f", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31ffaf4-6b", "ovs_interfaceid": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3aa66fd4-3a21-4583-b2fb-ccf9bc8e7387', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'txGYAkUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '85b399dc-62df-480d-8561-5d9d1ab75c52', 'attached_at': '', 'detached_at': '', 'volume_id': '4d2a082d-59f8-4081-9ace-fc3ae1219b10', 'serial': '4d2a082d-59f8-4081-9ace-fc3ae1219b10'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG nova.objects.instance [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'numa_topology' on Instance uuid 85b399dc-62df-480d-8561-5d9d1ab75c52 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:54:26 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:54:26 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:54:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:54:26 user nova-compute[71498]: DEBUG nova.objects.instance [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'vcpu_model' on Instance uuid 85b399dc-62df-480d-8561-5d9d1ab75c52 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'txGYAkUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:54:27 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:54:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:54:27 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:54:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:54:27 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:54:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70a641e-5545-4bd4-8500-cf3ef11e0aa2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:54:27 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c130b0-6de7-4c8b-8bc1-3c9775ed9f3b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10] added
Apr 14 01:54:27 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8ea5b8-63c8-4015-b0f9-345fedc797d2]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d263e2bd-e37c-4492-8187-573bc8edaaf4]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v txGYAkUr {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v txGYAkUr" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2804e6-397a-41ee-a428-feb0f32eaf44]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'txGYAkUr'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[db635f71-5690-499b-a6c9-7f0617585c47]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfe2b34-9985-4553-8ac6-2e15378b1dfa]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:54:27 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:54:27 user nova-compute[71498]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)
Apr 14 01:54:27 user nova-compute[71498]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:54:27 user nova-compute[71498]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:54:27 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:54:27 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:54:27 user nova-compute[71498]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)
Apr 14 01:54:27 user nova-compute[71498]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:54:27 user nova-compute[71498]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:54:27 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e75fed-c730-40c3-9cb5-ee5bb788b571]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10, portal: 172.16.0.220,3260]
Apr 14 01:54:27 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10, portal: 172.16.0.220,3260] successful.
Apr 14 01:54:27 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2cf835-87fa-4adb-ad61-558725c70657]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[421839b1-3e42-44b1-ad40-0b8d69aff528]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:54:27 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:54:27 user nova-compute[71498]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)
Apr 14 01:54:27 user nova-compute[71498]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:54:27 user nova-compute[71498]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:54:27 user nova-compute[71498]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:54:27 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:54:27 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:54:27 user nova-compute[71498]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)
Apr 14 01:54:27 user nova-compute[71498]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:54:27 user nova-compute[71498]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:54:27 user nova-compute[71498]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:54:27 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d92d2ee-4e34-401f-934d-ad240f3d3ae1]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'txGYAkUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:54:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:28 user nova-compute[71498]: DEBUG nova.compute.manager [req-5b5928cd-8aa6-4923-b8ba-ee9ce3696329 req-07d54b54-4d2a-4b54-bbad-29c4b334c890 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Received event network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:54:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5b5928cd-8aa6-4923-b8ba-ee9ce3696329 req-07d54b54-4d2a-4b54-bbad-29c4b334c890 service nova] Acquiring lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:54:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5b5928cd-8aa6-4923-b8ba-ee9ce3696329 req-07d54b54-4d2a-4b54-bbad-29c4b334c890 service nova] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:54:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5b5928cd-8aa6-4923-b8ba-ee9ce3696329 req-07d54b54-4d2a-4b54-bbad-29c4b334c890 service nova] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:54:28 user nova-compute[71498]: DEBUG nova.compute.manager [req-5b5928cd-8aa6-4923-b8ba-ee9ce3696329 req-07d54b54-4d2a-4b54-bbad-29c4b334c890 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] No waiting events found dispatching network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:54:28 user nova-compute[71498]: WARNING nova.compute.manager [req-5b5928cd-8aa6-4923-b8ba-ee9ce3696329 req-07d54b54-4d2a-4b54-bbad-29c4b334c890 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Received unexpected event network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 for instance with vm_state active and task_state resize_finish.
Apr 14 01:54:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:54:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23135376331363361', 'path': '/dev/sdd'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:54:28 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135376331363361', 'path': '/dev/sdd'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:54:28 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:50:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-325708357',display_name='tempest-AttachVolumeTestJSON-server-325708357',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-325708357',id=27,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvk+JYMt+HZ39UKnyK9XjRAYXFTfLUFV2C7qQoN4BD8jI9jpYJTV8jA9OgD5QAxdNshSqirCRpZ3xA98RiAsOOX3u/3A0BiHL6YVfgoocjrtHZ6NQNKyL6LjNBDUv8OmA==',key_name='tempest-keypair-2007571811',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:50:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0f650e04d2c947498b9e7a8d002862ad',ramdisk_id='',reservation_id='r-d003i0bm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-296004410',owner_user_name='tempest-AttachVolumeTestJSON-296004410-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:52:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba0894753a074f99ab226fde0565dd28',uuid=85b399dc-62df-480d-8561-5d9d1ab75c52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "address": "fa:16:3e:c2:1d:7f", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31ffaf4-6b", "ovs_interfaceid": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:54:28 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Converting VIF {"id": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "address": "fa:16:3e:c2:1d:7f", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31ffaf4-6b", "ovs_interfaceid": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:54:28 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1d:7f,bridge_name='br-int',has_traffic_filtering=True,id=e31ffaf4-6b2b-4099-88b5-683bc51ccfdf,network=Network(fe9d57b9-96e8-424e-8dc9-0c95f1aff03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape31ffaf4-6b') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:54:28 user nova-compute[71498]: DEBUG nova.objects.instance [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'pci_devices' on Instance uuid 85b399dc-62df-480d-8561-5d9d1ab75c52 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:54:28 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:54:28 user nova-compute[71498]:   <uuid>85b399dc-62df-480d-8561-5d9d1ab75c52</uuid>
Apr 14 01:54:28 user nova-compute[71498]:   <name>instance-0000001b</name>
Apr 14 01:54:28 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:54:28 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:54:28 user nova-compute[71498]:   <metadata>
Apr 14 01:54:28 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:54:28 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:54:28 user nova-compute[71498]:       <nova:name>tempest-AttachVolumeTestJSON-server-325708357</nova:name>
Apr 14 01:54:28 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:54:26</nova:creationTime>
Apr 14 01:54:28 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:54:28 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:54:28 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:54:28 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:54:28 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:54:28 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:54:28 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:54:28 user nova-compute[71498]:       <nova:owner>
Apr 14 01:54:28 user nova-compute[71498]:         <nova:user uuid="ba0894753a074f99ab226fde0565dd28">tempest-AttachVolumeTestJSON-296004410-project-member</nova:user>
Apr 14 01:54:28 user nova-compute[71498]:         <nova:project uuid="0f650e04d2c947498b9e7a8d002862ad">tempest-AttachVolumeTestJSON-296004410</nova:project>
Apr 14 01:54:28 user nova-compute[71498]:       </nova:owner>
Apr 14 01:54:28 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:54:28 user nova-compute[71498]:       <nova:ports>
Apr 14 01:54:28 user nova-compute[71498]:         <nova:port uuid="e31ffaf4-6b2b-4099-88b5-683bc51ccfdf">
Apr 14 01:54:28 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 14 01:54:28 user nova-compute[71498]:         </nova:port>
Apr 14 01:54:28 user nova-compute[71498]:       </nova:ports>
Apr 14 01:54:28 user nova-compute[71498]:     </nova:instance>
Apr 14 01:54:28 user nova-compute[71498]:   </metadata>
Apr 14 01:54:28 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:54:28 user nova-compute[71498]:     <system>
Apr 14 01:54:28 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:54:28 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:54:28 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:54:28 user nova-compute[71498]:       <entry name="serial">85b399dc-62df-480d-8561-5d9d1ab75c52</entry>
Apr 14 01:54:28 user nova-compute[71498]:       <entry name="uuid">85b399dc-62df-480d-8561-5d9d1ab75c52</entry>
Apr 14 01:54:28 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:54:28 user nova-compute[71498]:     </system>
Apr 14 01:54:28 user nova-compute[71498]:   </sysinfo>
Apr 14 01:54:28 user nova-compute[71498]:   <os>
Apr 14 01:54:28 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:54:28 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:54:28 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:54:28 user nova-compute[71498]:   </os>
Apr 14 01:54:28 user nova-compute[71498]:   <features>
Apr 14 01:54:28 user nova-compute[71498]:     <acpi/>
Apr 14 01:54:28 user nova-compute[71498]:     <apic/>
Apr 14 01:54:28 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:54:28 user nova-compute[71498]:   </features>
Apr 14 01:54:28 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:54:28 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:54:28 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:54:28 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:54:28 user nova-compute[71498]:   </clock>
Apr 14 01:54:28 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:54:28 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:54:28 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:54:28 user nova-compute[71498]:   </cpu>
Apr 14 01:54:28 user nova-compute[71498]:   <devices>
Apr 14 01:54:28 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:54:28 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:54:28 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk"/>
Apr 14 01:54:28 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:54:28 user nova-compute[71498]:     </disk>
Apr 14 01:54:28 user nova-compute[71498]:     <disk type="block" device="disk">
Apr 14 01:54:28 user nova-compute[71498]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:54:28 user nova-compute[71498]:       <source dev="/dev/sdd"/>
Apr 14 01:54:28 user nova-compute[71498]:       <target dev="vdb" bus="virtio"/>
Apr 14 01:54:28 user nova-compute[71498]:       <serial>4d2a082d-59f8-4081-9ace-fc3ae1219b10</serial>
Apr 14 01:54:28 user nova-compute[71498]:     </disk>
Apr 14 01:54:28 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:54:28 user nova-compute[71498]:       <mac address="fa:16:3e:c2:1d:7f"/>
Apr 14 01:54:28 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:54:28 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:54:28 user nova-compute[71498]:       <target dev="tape31ffaf4-6b"/>
Apr 14 01:54:28 user nova-compute[71498]:     </interface>
Apr 14 01:54:28 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:54:28 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/console.log" append="off"/>
Apr 14 01:54:28 user nova-compute[71498]:     </serial>
Apr 14 01:54:28 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:54:28 user nova-compute[71498]:     <video>
Apr 14 01:54:28 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:54:28 user nova-compute[71498]:     </video>
Apr 14 01:54:28 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:54:28 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:54:28 user nova-compute[71498]:     </rng>
Apr 14 01:54:28 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:54:28 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:54:28 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:54:28 user nova-compute[71498]:     </memballoon>
Apr 14 01:54:28 user nova-compute[71498]:   </devices>
Apr 14 01:54:28 user nova-compute[71498]: </domain>
Apr 14 01:54:28 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:54:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:28 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:54:28 user nova-compute[71498]: DEBUG nova.objects.instance [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'trusted_certs' on Instance uuid 85b399dc-62df-480d-8561-5d9d1ab75c52 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:54:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.151s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:28 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 01:54:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:29 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Cannot resize image /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 01:54:29 user nova-compute[71498]: DEBUG nova.objects.instance [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'migration_context' on Instance uuid 85b399dc-62df-480d-8561-5d9d1ab75c52 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:54:29 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:50:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-325708357',display_name='tempest-AttachVolumeTestJSON-server-325708357',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-325708357',id=27,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvk+JYMt+HZ39UKnyK9XjRAYXFTfLUFV2C7qQoN4BD8jI9jpYJTV8jA9OgD5QAxdNshSqirCRpZ3xA98RiAsOOX3u/3A0BiHL6YVfgoocjrtHZ6NQNKyL6LjNBDUv8OmA==',key_name='tempest-keypair-2007571811',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:50:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='0f650e04d2c947498b9e7a8d002862ad',ramdisk_id='',reservation_id='r-d003i0bm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-296004410',owner_user_name='tempest-AttachVolumeTestJSON-296004410-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:52:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba0894753a074f99ab226fde0565dd28',uuid=85b399dc-62df-480d-8561-5d9d1ab75c52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "address": "fa:16:3e:c2:1d:7f", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31ffaf4-6b", "ovs_interfaceid": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:54:29 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Converting VIF {"id": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "address": "fa:16:3e:c2:1d:7f", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31ffaf4-6b", "ovs_interfaceid": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:54:29 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1d:7f,bridge_name='br-int',has_traffic_filtering=True,id=e31ffaf4-6b2b-4099-88b5-683bc51ccfdf,network=Network(fe9d57b9-96e8-424e-8dc9-0c95f1aff03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape31ffaf4-6b') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:54:29 user nova-compute[71498]: DEBUG os_vif [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1d:7f,bridge_name='br-int',has_traffic_filtering=True,id=e31ffaf4-6b2b-4099-88b5-683bc51ccfdf,network=Network(fe9d57b9-96e8-424e-8dc9-0c95f1aff03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape31ffaf4-6b') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:54:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:54:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:54:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape31ffaf4-6b, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:54:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape31ffaf4-6b, col_values=(('external_ids', {'iface-id': 'e31ffaf4-6b2b-4099-88b5-683bc51ccfdf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:1d:7f', 'vm-uuid': '85b399dc-62df-480d-8561-5d9d1ab75c52'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:54:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:54:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:29 user nova-compute[71498]: INFO os_vif [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1d:7f,bridge_name='br-int',has_traffic_filtering=True,id=e31ffaf4-6b2b-4099-88b5-683bc51ccfdf,network=Network(fe9d57b9-96e8-424e-8dc9-0c95f1aff03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape31ffaf4-6b')
Apr 14 01:54:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Removed pending event for 73cc8ede-babd-4281-bf1d-c5a3f8bad440 due to event {{(pid=71498) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 01:54:30 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437270.2039416, 73cc8ede-babd-4281-bf1d-c5a3f8bad440 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:54:30 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] VM Resumed (Lifecycle Event)
Apr 14 01:54:30 user nova-compute[71498]: DEBUG nova.compute.manager [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:54:30 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:54:30 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Instance running successfully.
Apr 14 01:54:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Failed to set time: agent not configured {{(pid=71498) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 14 01:54:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8c6c6b45-9d77-4b0f-aef3-a863cc7fae22 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] finish_migration finished successfully. {{(pid=71498) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 14 01:54:30 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:54:30 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 01:54:30 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437270.2058747, 73cc8ede-babd-4281-bf1d-c5a3f8bad440 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:54:30 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] VM Started (Lifecycle Event)
Apr 14 01:54:30 user nova-compute[71498]: DEBUG nova.compute.manager [req-f5a882d5-74fc-4bc0-9549-40cb9707dc4b req-e4cfa52d-1b24-47ba-bb3a-2dc90e6d2fe8 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Received event network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:54:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f5a882d5-74fc-4bc0-9549-40cb9707dc4b req-e4cfa52d-1b24-47ba-bb3a-2dc90e6d2fe8 service nova] Acquiring lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:54:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f5a882d5-74fc-4bc0-9549-40cb9707dc4b req-e4cfa52d-1b24-47ba-bb3a-2dc90e6d2fe8 service nova] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:54:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f5a882d5-74fc-4bc0-9549-40cb9707dc4b req-e4cfa52d-1b24-47ba-bb3a-2dc90e6d2fe8 service nova] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:54:30 user nova-compute[71498]: DEBUG nova.compute.manager [req-f5a882d5-74fc-4bc0-9549-40cb9707dc4b req-e4cfa52d-1b24-47ba-bb3a-2dc90e6d2fe8 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] No waiting events found dispatching network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:54:30 user nova-compute[71498]: WARNING nova.compute.manager [req-f5a882d5-74fc-4bc0-9549-40cb9707dc4b req-e4cfa52d-1b24-47ba-bb3a-2dc90e6d2fe8 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Received unexpected event network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 for instance with vm_state active and task_state resize_finish.
Apr 14 01:54:30 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:54:30 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:54:30 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 01:54:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:31 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:31 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:31 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:31 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:32 user nova-compute[71498]: DEBUG nova.compute.manager [req-13507481-dc72-415b-902c-e9d7a528d58e req-40c28cf1-1ef7-4bb7-a8d1-01d7f70342aa service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Received event network-vif-plugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:54:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-13507481-dc72-415b-902c-e9d7a528d58e req-40c28cf1-1ef7-4bb7-a8d1-01d7f70342aa service nova] Acquiring lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:54:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-13507481-dc72-415b-902c-e9d7a528d58e req-40c28cf1-1ef7-4bb7-a8d1-01d7f70342aa service nova] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:54:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-13507481-dc72-415b-902c-e9d7a528d58e req-40c28cf1-1ef7-4bb7-a8d1-01d7f70342aa service nova] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:54:32 user nova-compute[71498]: DEBUG nova.compute.manager [req-13507481-dc72-415b-902c-e9d7a528d58e req-40c28cf1-1ef7-4bb7-a8d1-01d7f70342aa service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] No waiting events found dispatching network-vif-plugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:54:32 user nova-compute[71498]: WARNING nova.compute.manager [req-13507481-dc72-415b-902c-e9d7a528d58e req-40c28cf1-1ef7-4bb7-a8d1-01d7f70342aa service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Received unexpected event network-vif-plugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf for instance with vm_state stopped and task_state powering-on.
Apr 14 01:54:32 user nova-compute[71498]: DEBUG nova.compute.manager [req-13507481-dc72-415b-902c-e9d7a528d58e req-40c28cf1-1ef7-4bb7-a8d1-01d7f70342aa service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Received event network-vif-plugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:54:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-13507481-dc72-415b-902c-e9d7a528d58e req-40c28cf1-1ef7-4bb7-a8d1-01d7f70342aa service nova] Acquiring lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:54:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-13507481-dc72-415b-902c-e9d7a528d58e req-40c28cf1-1ef7-4bb7-a8d1-01d7f70342aa service nova] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:54:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-13507481-dc72-415b-902c-e9d7a528d58e req-40c28cf1-1ef7-4bb7-a8d1-01d7f70342aa service nova] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:54:32 user nova-compute[71498]: DEBUG nova.compute.manager [req-13507481-dc72-415b-902c-e9d7a528d58e req-40c28cf1-1ef7-4bb7-a8d1-01d7f70342aa service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] No waiting events found dispatching network-vif-plugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:54:32 user nova-compute[71498]: WARNING nova.compute.manager [req-13507481-dc72-415b-902c-e9d7a528d58e req-40c28cf1-1ef7-4bb7-a8d1-01d7f70342aa service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Received unexpected event network-vif-plugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf for instance with vm_state stopped and task_state powering-on.
Apr 14 01:54:32 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437272.8931127, 85b399dc-62df-480d-8561-5d9d1ab75c52 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:54:32 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] VM Resumed (Lifecycle Event)
Apr 14 01:54:32 user nova-compute[71498]: DEBUG nova.compute.manager [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:54:32 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Instance rebooted successfully.
Apr 14 01:54:32 user nova-compute[71498]: DEBUG nova.compute.manager [None req-ad75fe20-59f4-48ac-b143-d269b36c962a tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:54:32 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:54:32 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:54:32 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 14 01:54:32 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437272.8944561, 85b399dc-62df-480d-8561-5d9d1ab75c52 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:54:32 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] VM Started (Lifecycle Event)
Apr 14 01:54:32 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:54:32 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:54:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:34 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:36 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:54:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:54:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:54:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:54:36 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 01:54:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:54:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:54:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:54:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:54:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:54:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:39 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:54:39 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:54:39 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:54:39 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=7860MB free_disk=26.112144470214844GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 01:54:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:54:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:54:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Applying migration context for instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 as it has an incoming, in-progress migration fffda8d2-cec8-4809-a410-4bc405a28d5c. Migration status is finished {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 01:54:40 user nova-compute[71498]: INFO nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Updating resource usage from migration fffda8d2-cec8-4809-a410-4bc405a28d5c
Apr 14 01:54:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:54:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:54:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance a19a1c08-5454-481b-bb5a-70c39ead9afc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:54:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance fa29c144-0ff9-4efb-a574-f521d18f08fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:54:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance ae82789e-1bed-419b-a580-68ff7ed03ef2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:54:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 85b399dc-62df-480d-8561-5d9d1ab75c52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:54:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:54:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:54:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 410c2004-b2c8-4274-b1d3-9b48585c644f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:54:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:54:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Migration fffda8d2-cec8-4809-a410-4bc405a28d5c is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 01:54:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:54:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 01:54:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=2112MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 01:54:40 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:54:40 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:54:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 01:54:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.522s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:54:41 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:54:41 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 01:54:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-73fd9bc1-af0f-41e9-adea-d73323b4a76c" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:54:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-73fd9bc1-af0f-41e9-adea-d73323b4a76c" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:54:41 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 01:54:42 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Updating instance_info_cache with network_info: [{"id": "4146457e-4b16-4c22-afd2-ffae8a58c0c5", "address": "fa:16:3e:4c:4f:e1", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4146457e-4b", "ovs_interfaceid": "4146457e-4b16-4c22-afd2-ffae8a58c0c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:54:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-73fd9bc1-af0f-41e9-adea-d73323b4a76c" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:54:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 01:54:42 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:54:42 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:54:42 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:54:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:44 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:44 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:54:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:54:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:54:44 user nova-compute[71498]: INFO nova.compute.manager [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Detaching volume 26c6e12f-4381-4acd-a6e5-a979a6886f25
Apr 14 01:54:45 user nova-compute[71498]: INFO nova.virt.block_device [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Attempting to driver detach volume 26c6e12f-4381-4acd-a6e5-a979a6886f25 from mountpoint /dev/vdc
Apr 14 01:54:45 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Attempting to detach device vdc from instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 from the persistent domain config. {{(pid=71498) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 01:54:45 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:54:45 user nova-compute[71498]:   <source dev="/dev/sde"/>
Apr 14 01:54:45 user nova-compute[71498]:   <target dev="vdc" bus="virtio"/>
Apr 14 01:54:45 user nova-compute[71498]:   <serial>26c6e12f-4381-4acd-a6e5-a979a6886f25</serial>
Apr 14 01:54:45 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 01:54:45 user nova-compute[71498]: </disk>
Apr 14 01:54:45 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:54:45 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Successfully detached device vdc from instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 from the persistent domain config.
Apr 14 01:54:45 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 from the live domain config. {{(pid=71498) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 01:54:45 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:54:45 user nova-compute[71498]:   <source dev="/dev/sde"/>
Apr 14 01:54:45 user nova-compute[71498]:   <target dev="vdc" bus="virtio"/>
Apr 14 01:54:45 user nova-compute[71498]:   <serial>26c6e12f-4381-4acd-a6e5-a979a6886f25</serial>
Apr 14 01:54:45 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 01:54:45 user nova-compute[71498]: </disk>
Apr 14 01:54:45 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Received event <DeviceRemovedEvent: 1681437285.5470548, 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71498) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 {{(pid=71498) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 01:54:45 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Successfully detached device vdc from instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 from the live domain config.
Apr 14 01:54:45 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zameKywh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:54:45 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:54:45 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcfd6c6-0aa2-44fc-95dc-1a650974482e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:54:45 user nova-compute[71498]: No targets found.
Apr 14 01:54:45 user nova-compute[71498]: iSNS:
Apr 14 01:54:45 user nova-compute[71498]: No targets found.
Apr 14 01:54:45 user nova-compute[71498]: STATIC:
Apr 14 01:54:45 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f
Apr 14 01:54:45 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:54:45 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:54:45 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860
Apr 14 01:54:45 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:54:45 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:54:45 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae
Apr 14 01:54:45 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:54:45 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:54:45 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25
Apr 14 01:54:45 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:54:45 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:54:45 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10
Apr 14 01:54:45 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:54:45 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:54:45 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22
Apr 14 01:54:45 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:54:45 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:54:45 user nova-compute[71498]: FIRMWARE:
Apr 14 01:54:45 user nova-compute[71498]: No targets found.
Apr 14 01:54:45 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:54:45 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:54:45 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f8902a-7c42-4bc5-9b7e-243bf9e2f2c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfd7e87-9ee6-41f2-b955-57feb2ecee03]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:54:45 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:54:45 user nova-compute[71498]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)
Apr 14 01:54:45 user nova-compute[71498]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:54:45 user nova-compute[71498]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:54:45 user nova-compute[71498]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:54:45 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:54:45 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:54:45 user nova-compute[71498]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 (non-flash)
Apr 14 01:54:45 user nova-compute[71498]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:54:45 user nova-compute[71498]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:54:45 user nova-compute[71498]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:54:45 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51c46ce440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25'): ({'sde'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Removing single pathed devices sde {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bb2482-48df-4631-aa01-4cf78f6ded89]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64af870-0637-497b-a242-207ffee364e2]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Flushing IO for device /dev/sde {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26a3019-cb50-4a21-9f8d-774c89dcfe0c]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.029s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7db7de-8c8c-4e10-9e35-9e4fc8f7252a]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] SCSI volumes sde have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d238688-5738-4549-959a-e16e53fe828d]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdde9436-e1d3-407a-961c-1123c3b8b312]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25, portal: 172.16.0.220,3260]
Apr 14 01:54:45 user nova-compute[71498]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25, portal: 172.16.0.220,3260] successful.
Apr 14 01:54:45 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c6e12f-4381-4acd-a6e5-a979a6886f25 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1f8f17-7798-4458-805d-366e10f2b54f]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] <== disconnect_volume: return (327ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:54:45 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:54:46 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:54:46 user nova-compute[71498]: DEBUG nova.objects.instance [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lazy-loading 'flavor' on Instance uuid 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:54:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-116d82ca-674b-4ed7-b604-8cbe5a3c42f9 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.808s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:54:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:48 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:54:49 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:54 user nova-compute[71498]: DEBUG nova.compute.manager [req-a9127fb8-0c69-4357-8bbf-07540d8b7adc req-2f27b5df-9dba-4f10-bf8c-259184d328d3 service nova] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Received event network-changed-369a4435-3639-47bc-8a63-1c6c3f25df9b {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:54:54 user nova-compute[71498]: DEBUG nova.compute.manager [req-a9127fb8-0c69-4357-8bbf-07540d8b7adc req-2f27b5df-9dba-4f10-bf8c-259184d328d3 service nova] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Refreshing instance network info cache due to event network-changed-369a4435-3639-47bc-8a63-1c6c3f25df9b. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:54:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a9127fb8-0c69-4357-8bbf-07540d8b7adc req-2f27b5df-9dba-4f10-bf8c-259184d328d3 service nova] Acquiring lock "refresh_cache-410c2004-b2c8-4274-b1d3-9b48585c644f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:54:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a9127fb8-0c69-4357-8bbf-07540d8b7adc req-2f27b5df-9dba-4f10-bf8c-259184d328d3 service nova] Acquired lock "refresh_cache-410c2004-b2c8-4274-b1d3-9b48585c644f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:54:54 user nova-compute[71498]: DEBUG nova.network.neutron [req-a9127fb8-0c69-4357-8bbf-07540d8b7adc req-2f27b5df-9dba-4f10-bf8c-259184d328d3 service nova] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Refreshing network info cache for port 369a4435-3639-47bc-8a63-1c6c3f25df9b {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "410c2004-b2c8-4274-b1d3-9b48585c644f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "410c2004-b2c8-4274-b1d3-9b48585c644f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "410c2004-b2c8-4274-b1d3-9b48585c644f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "410c2004-b2c8-4274-b1d3-9b48585c644f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "410c2004-b2c8-4274-b1d3-9b48585c644f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:54:55 user nova-compute[71498]: INFO nova.compute.manager [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Terminating instance
Apr 14 01:54:55 user nova-compute[71498]: DEBUG nova.compute.manager [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG nova.network.neutron [req-a9127fb8-0c69-4357-8bbf-07540d8b7adc req-2f27b5df-9dba-4f10-bf8c-259184d328d3 service nova] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Updated VIF entry in instance network info cache for port 369a4435-3639-47bc-8a63-1c6c3f25df9b. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG nova.network.neutron [req-a9127fb8-0c69-4357-8bbf-07540d8b7adc req-2f27b5df-9dba-4f10-bf8c-259184d328d3 service nova] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Updating instance_info_cache with network_info: [{"id": "369a4435-3639-47bc-8a63-1c6c3f25df9b", "address": "fa:16:3e:98:19:b2", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap369a4435-36", "ovs_interfaceid": "369a4435-3639-47bc-8a63-1c6c3f25df9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a9127fb8-0c69-4357-8bbf-07540d8b7adc req-2f27b5df-9dba-4f10-bf8c-259184d328d3 service nova] Releasing lock "refresh_cache-410c2004-b2c8-4274-b1d3-9b48585c644f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG nova.compute.manager [req-7f69ffe3-6ba0-4e59-b3f5-e483f8a88163 req-f4649b23-1934-49e5-810d-b726598c127f service nova] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Received event network-vif-unplugged-369a4435-3639-47bc-8a63-1c6c3f25df9b {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7f69ffe3-6ba0-4e59-b3f5-e483f8a88163 req-f4649b23-1934-49e5-810d-b726598c127f service nova] Acquiring lock "410c2004-b2c8-4274-b1d3-9b48585c644f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7f69ffe3-6ba0-4e59-b3f5-e483f8a88163 req-f4649b23-1934-49e5-810d-b726598c127f service nova] Lock "410c2004-b2c8-4274-b1d3-9b48585c644f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7f69ffe3-6ba0-4e59-b3f5-e483f8a88163 req-f4649b23-1934-49e5-810d-b726598c127f service nova] Lock "410c2004-b2c8-4274-b1d3-9b48585c644f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG nova.compute.manager [req-7f69ffe3-6ba0-4e59-b3f5-e483f8a88163 req-f4649b23-1934-49e5-810d-b726598c127f service nova] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] No waiting events found dispatching network-vif-unplugged-369a4435-3639-47bc-8a63-1c6c3f25df9b {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG nova.compute.manager [req-7f69ffe3-6ba0-4e59-b3f5-e483f8a88163 req-f4649b23-1934-49e5-810d-b726598c127f service nova] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Received event network-vif-unplugged-369a4435-3639-47bc-8a63-1c6c3f25df9b for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:54:55 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Instance destroyed successfully.
Apr 14 01:54:55 user nova-compute[71498]: DEBUG nova.objects.instance [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lazy-loading 'resources' on Instance uuid 410c2004-b2c8-4274-b1d3-9b48585c644f {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:53:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1737844387',display_name='tempest-TestVolumeBootPattern-server-1737844387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1737844387',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcODdjkXb9vqfJo6mLTbOXnPLP2HdwXcPxYgRVEM78ApSpFWKxeZveFravQCk22JVH3n1PXZDKAyefoGYrsPczv6zWWLW2pkXjL46/zFdGhb8s3BmOyjVZHJdx/Y2ktUg==',key_name='tempest-TestVolumeBootPattern-824995165',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:53:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1f4117a4adb4aa3b42951cf1fc84237',ramdisk_id='',reservation_id='r-nmvrx03i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-224521177',owner_user_name='tempest-TestVolumeBootPattern-224521177-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:53:14Z,user_data=None,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',uuid=410c2004-b2c8-4274-b1d3-9b48585c644f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "369a4435-3639-47bc-8a63-1c6c3f25df9b", "address": "fa:16:3e:98:19:b2", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap369a4435-36", "ovs_interfaceid": "369a4435-3639-47bc-8a63-1c6c3f25df9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converting VIF {"id": "369a4435-3639-47bc-8a63-1c6c3f25df9b", "address": "fa:16:3e:98:19:b2", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap369a4435-36", "ovs_interfaceid": "369a4435-3639-47bc-8a63-1c6c3f25df9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:19:b2,bridge_name='br-int',has_traffic_filtering=True,id=369a4435-3639-47bc-8a63-1c6c3f25df9b,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap369a4435-36') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG os_vif [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:19:b2,bridge_name='br-int',has_traffic_filtering=True,id=369a4435-3639-47bc-8a63-1c6c3f25df9b,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap369a4435-36') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap369a4435-36, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:54:55 user nova-compute[71498]: INFO os_vif [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:19:b2,bridge_name='br-int',has_traffic_filtering=True,id=369a4435-3639-47bc-8a63-1c6c3f25df9b,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap369a4435-36')
Apr 14 01:54:55 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XIKaoMjg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:54:55 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:54:55 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f1ad03-f020-413a-a41a-206432ebf5d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:54:55 user nova-compute[71498]: No targets found.
Apr 14 01:54:55 user nova-compute[71498]: iSNS:
Apr 14 01:54:55 user nova-compute[71498]: No targets found.
Apr 14 01:54:55 user nova-compute[71498]: STATIC:
Apr 14 01:54:55 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f
Apr 14 01:54:55 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:54:55 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:54:55 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860
Apr 14 01:54:55 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:54:55 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:54:55 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae
Apr 14 01:54:55 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:54:55 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:54:55 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10
Apr 14 01:54:55 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:54:55 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:54:55 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22
Apr 14 01:54:55 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:54:55 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:54:55 user nova-compute[71498]: FIRMWARE:
Apr 14 01:54:55 user nova-compute[71498]: No targets found.
Apr 14 01:54:55 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:54:55 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:54:55 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[06542f68-731e-4181-8395-73ec0692f0b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2eb2044-e9f9-42ea-8ed2-d12903a4600f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:54:55 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:54:55 user nova-compute[71498]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:54:55 user nova-compute[71498]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:54:55 user nova-compute[71498]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:54:55 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:54:55 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:54:55 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:54:55 user nova-compute[71498]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:54:55 user nova-compute[71498]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:54:55 user nova-compute[71498]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:54:55 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51c469f1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860'): ({'sdf'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Removing single pathed devices sdf {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[981d6485-4ec6-400f-8ff4-9e124848601a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb1b994-f258-4c10-9e4a-5d4652a865e6]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Flushing IO for device /dev/sdf {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a0492b-49aa-400e-a89c-621db9359026]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc07447e-ea24-405c-864b-94e1879b64f9]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] SCSI volumes sdf have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfeb793-1926-4156-85e9-dcae557dea6b]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6a76bd-a6e6-4440-9704-c6af2dd613db]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860, portal: 172.16.0.220,3260]
Apr 14 01:54:56 user nova-compute[71498]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860, portal: 172.16.0.220,3260] successful.
Apr 14 01:54:56 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b59c719-5c68-4748-b66a-93331658207b]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] <== disconnect_volume: return (340ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:54:56 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Deleting instance files /opt/stack/data/nova/instances/410c2004-b2c8-4274-b1d3-9b48585c644f_del
Apr 14 01:54:56 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Deletion of /opt/stack/data/nova/instances/410c2004-b2c8-4274-b1d3-9b48585c644f_del complete
Apr 14 01:54:56 user nova-compute[71498]: INFO nova.compute.manager [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Took 1.23 seconds to destroy the instance on the hypervisor.
Apr 14 01:54:56 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 01:54:56 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 01:54:57 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:54:57 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Took 0.77 seconds to deallocate network for instance.
Apr 14 01:54:57 user nova-compute[71498]: DEBUG nova.compute.manager [req-2d1adce1-ff01-4df3-a709-9b6f646d5ad4 req-33a70151-92d4-4a38-b654-1f7de5721993 service nova] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Received event network-vif-plugged-369a4435-3639-47bc-8a63-1c6c3f25df9b {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:54:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-2d1adce1-ff01-4df3-a709-9b6f646d5ad4 req-33a70151-92d4-4a38-b654-1f7de5721993 service nova] Acquiring lock "410c2004-b2c8-4274-b1d3-9b48585c644f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:54:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-2d1adce1-ff01-4df3-a709-9b6f646d5ad4 req-33a70151-92d4-4a38-b654-1f7de5721993 service nova] Lock "410c2004-b2c8-4274-b1d3-9b48585c644f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:54:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-2d1adce1-ff01-4df3-a709-9b6f646d5ad4 req-33a70151-92d4-4a38-b654-1f7de5721993 service nova] Lock "410c2004-b2c8-4274-b1d3-9b48585c644f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:54:57 user nova-compute[71498]: DEBUG nova.compute.manager [req-2d1adce1-ff01-4df3-a709-9b6f646d5ad4 req-33a70151-92d4-4a38-b654-1f7de5721993 service nova] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] No waiting events found dispatching network-vif-plugged-369a4435-3639-47bc-8a63-1c6c3f25df9b {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:54:57 user nova-compute[71498]: WARNING nova.compute.manager [req-2d1adce1-ff01-4df3-a709-9b6f646d5ad4 req-33a70151-92d4-4a38-b654-1f7de5721993 service nova] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Received unexpected event network-vif-plugged-369a4435-3639-47bc-8a63-1c6c3f25df9b for instance with vm_state active and task_state deleting.
Apr 14 01:54:57 user nova-compute[71498]: DEBUG nova.compute.manager [req-2d1adce1-ff01-4df3-a709-9b6f646d5ad4 req-33a70151-92d4-4a38-b654-1f7de5721993 service nova] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Received event network-vif-deleted-369a4435-3639-47bc-8a63-1c6c3f25df9b {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:54:57 user nova-compute[71498]: INFO nova.compute.manager [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Took 0.78 seconds to detach 1 volumes for instance.
Apr 14 01:54:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:54:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:54:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:54:58 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:54:58 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:54:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:54:58 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Deleted allocations for instance 410c2004-b2c8-4274-b1d3-9b48585c644f
Apr 14 01:54:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a4a02cb4-d0a4-472a-8195-bcb4e53dba19 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "410c2004-b2c8-4274-b1d3-9b48585c644f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.326s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:55:00 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:05 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:10 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681437295.8445733, 410c2004-b2c8-4274-b1d3-9b48585c644f => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:55:10 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] VM Stopped (Lifecycle Event)
Apr 14 01:55:10 user nova-compute[71498]: DEBUG nova.compute.manager [None req-f270ef36-a41e-4666-8e52-de65c03d805f None None] [instance: 410c2004-b2c8-4274-b1d3-9b48585c644f] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:55:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:55:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 01:55:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:55:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:55:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:15 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:20 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:55:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 01:55:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:55:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:55:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:30 user nova-compute[71498]: DEBUG nova.compute.manager [req-10643f2c-4a19-4222-b9ef-5428a3fba859 req-de8e1576-4193-4df6-b8dc-c4d466b7cd3b service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received event network-changed-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:55:30 user nova-compute[71498]: DEBUG nova.compute.manager [req-10643f2c-4a19-4222-b9ef-5428a3fba859 req-de8e1576-4193-4df6-b8dc-c4d466b7cd3b service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Refreshing instance network info cache due to event network-changed-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:55:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-10643f2c-4a19-4222-b9ef-5428a3fba859 req-de8e1576-4193-4df6-b8dc-c4d466b7cd3b service nova] Acquiring lock "refresh_cache-92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:55:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-10643f2c-4a19-4222-b9ef-5428a3fba859 req-de8e1576-4193-4df6-b8dc-c4d466b7cd3b service nova] Acquired lock "refresh_cache-92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:55:30 user nova-compute[71498]: DEBUG nova.network.neutron [req-10643f2c-4a19-4222-b9ef-5428a3fba859 req-de8e1576-4193-4df6-b8dc-c4d466b7cd3b service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Refreshing network info cache for port 69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:55:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:55:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:55:30 user nova-compute[71498]: DEBUG nova.objects.instance [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'flavor' on Instance uuid 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:55:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:55:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:55:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:55:30 user nova-compute[71498]: INFO nova.compute.manager [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Attaching volume 4c279a98-9587-47a8-a153-408cc1232415 to /dev/vdb
Apr 14 01:55:30 user nova-compute[71498]: DEBUG os_brick.utils [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:55:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:30 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8904c39-1fd4-42dd-9534-5b02a285cce7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:55:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:30 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[355fa791-178c-4762-b4ef-cef12eee2bb6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:55:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:30 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[06376191-b19c-466d-97e0-5a8f78259a12]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:55:30 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[de83e6f1-2792-4854-802b-0f657ab1e200]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:55:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:55:30 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:55:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:55:30 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:55:30 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d0466f-b5ee-4ff7-a710-1dcf54a37f57]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:55:30 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:55:30 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:55:30 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:55:30 user nova-compute[71498]: DEBUG os_brick.utils [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:55:30 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Updating existing volume attachment record: a980225e-8bc6-4bb0-a839-83ced4f291cc {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:55:30 user nova-compute[71498]: DEBUG nova.network.neutron [req-10643f2c-4a19-4222-b9ef-5428a3fba859 req-de8e1576-4193-4df6-b8dc-c4d466b7cd3b service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Updated VIF entry in instance network info cache for port 69ad9be5-f12b-4f3b-8a10-1e4c5f09264d. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:55:30 user nova-compute[71498]: DEBUG nova.network.neutron [req-10643f2c-4a19-4222-b9ef-5428a3fba859 req-de8e1576-4193-4df6-b8dc-c4d466b7cd3b service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Updating instance_info_cache with network_info: [{"id": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "address": "fa:16:3e:84:32:3a", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ad9be5-f1", "ovs_interfaceid": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:55:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-10643f2c-4a19-4222-b9ef-5428a3fba859 req-de8e1576-4193-4df6-b8dc-c4d466b7cd3b service nova] Releasing lock "refresh_cache-92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:55:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oHhbCuAY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:55:35 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:55:35 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:55:35 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:55:35 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:55:35 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a0adba-a2d3-4f02-80dd-dcc10a6555cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:55:35 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcc6cd2-1743-4486-8f2d-4f0579c85d03]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415] added
Apr 14 01:55:35 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[679b0779-055c-4083-8c9c-b8fc69a4d986]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db6d0b4-eadd-4122-88d7-ceb1a460dffa]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oHhbCuAY {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oHhbCuAY" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f39cb22-9e19-4bd6-a030-bba5b3d2fd98]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oHhbCuAY'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fbb913-cdba-41fe-80cb-c6b12ffbfe2f]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a206546-3290-4260-8533-ef16c5f97117]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:55:35 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:55:35 user nova-compute[71498]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:55:35 user nova-compute[71498]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:55:35 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:55:35 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:55:35 user nova-compute[71498]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:55:35 user nova-compute[71498]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:55:35 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bada35e-b865-4f66-9b12-dee815dbfdc9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415, portal: 172.16.0.220,3260]
Apr 14 01:55:35 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415, portal: 172.16.0.220,3260] successful.
Apr 14 01:55:35 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b0871c-b16c-4460-bfc2-b1a917d46e53]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-13f85645-58a2-4827-97ea-6ade18012972 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-13f85645-58a2-4827-97ea-6ade18012972 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-13f85645-58a2-4827-97ea-6ade18012972 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-13f85645-58a2-4827-97ea-6ade18012972 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-13f85645-58a2-4827-97ea-6ade18012972 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:55:35 user nova-compute[71498]: INFO nova.compute.manager [None req-13f85645-58a2-4827-97ea-6ade18012972 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Terminating instance
Apr 14 01:55:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-13f85645-58a2-4827-97ea-6ade18012972 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd0794c-f929-401b-b4d9-2d0c91bfdb1e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:55:35 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:55:35 user nova-compute[71498]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:55:35 user nova-compute[71498]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:55:35 user nova-compute[71498]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)
Apr 14 01:55:35 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:55:35 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:55:35 user nova-compute[71498]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:55:35 user nova-compute[71498]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:55:35 user nova-compute[71498]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)
Apr 14 01:55:35 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[171b0f62-d786-4f0c-88b8-179628258b78]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oHhbCuAY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG nova.compute.manager [req-d7048e57-9b0c-4b60-8f6f-7627bd6f7e2b req-4ddc9c62-bbc2-4ca5-a288-e50f73da958b service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Received event network-vif-unplugged-db433bb1-8c59-4e6b-ae87-f6fab836df0f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d7048e57-9b0c-4b60-8f6f-7627bd6f7e2b req-4ddc9c62-bbc2-4ca5-a288-e50f73da958b service nova] Acquiring lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d7048e57-9b0c-4b60-8f6f-7627bd6f7e2b req-4ddc9c62-bbc2-4ca5-a288-e50f73da958b service nova] Lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d7048e57-9b0c-4b60-8f6f-7627bd6f7e2b req-4ddc9c62-bbc2-4ca5-a288-e50f73da958b service nova] Lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG nova.compute.manager [req-d7048e57-9b0c-4b60-8f6f-7627bd6f7e2b req-4ddc9c62-bbc2-4ca5-a288-e50f73da958b service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] No waiting events found dispatching network-vif-unplugged-db433bb1-8c59-4e6b-ae87-f6fab836df0f {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG nova.compute.manager [req-d7048e57-9b0c-4b60-8f6f-7627bd6f7e2b req-4ddc9c62-bbc2-4ca5-a288-e50f73da958b service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Received event network-vif-unplugged-db433bb1-8c59-4e6b-ae87-f6fab836df0f for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:36 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Instance destroyed successfully.
Apr 14 01:55:36 user nova-compute[71498]: DEBUG nova.objects.instance [None req-13f85645-58a2-4827-97ea-6ade18012972 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lazy-loading 'resources' on Instance uuid 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:55:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-13f85645-58a2-4827-97ea-6ade18012972 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T01:49:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1301145911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1301145911',id=24,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPK5vWQCKiGuvwej8MZ61wsOrdvHzkY8KKRb64YirQyItNzZ+qUyi3rsN2xXflr+RBnZBMnmrlu6xsd3Isj7tFk7wOqGbcQSauLFOHMBPmHHo5KdwuxT7vQvU/ChwXXgmw==',key_name='tempest-keypair-1472759355',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:53:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6d05ca328d64f2aa1d19550475edba3',ramdisk_id='',reservation_id='r-dkqwl1kl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2042065984',owner_user_name='tempest-AttachVolumeShelveTestJSON-2042065984-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:53:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a5da3e233c74524a953ce0d4e074077',uuid=18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "address": "fa:16:3e:d5:f1:51", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb433bb1-8c", "ovs_interfaceid": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:55:36 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-13f85645-58a2-4827-97ea-6ade18012972 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Converting VIF {"id": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "address": "fa:16:3e:d5:f1:51", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb433bb1-8c", "ovs_interfaceid": "db433bb1-8c59-4e6b-ae87-f6fab836df0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:55:36 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-13f85645-58a2-4827-97ea-6ade18012972 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f1:51,bridge_name='br-int',has_traffic_filtering=True,id=db433bb1-8c59-4e6b-ae87-f6fab836df0f,network=Network(a7b6c0bc-d2de-4431-821b-c2917738e556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb433bb1-8c') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:55:36 user nova-compute[71498]: DEBUG os_vif [None req-13f85645-58a2-4827-97ea-6ade18012972 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f1:51,bridge_name='br-int',has_traffic_filtering=True,id=db433bb1-8c59-4e6b-ae87-f6fab836df0f,network=Network(a7b6c0bc-d2de-4431-821b-c2917738e556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb433bb1-8c') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:55:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb433bb1-8c, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:55:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:55:36 user nova-compute[71498]: INFO os_vif [None req-13f85645-58a2-4827-97ea-6ade18012972 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f1:51,bridge_name='br-int',has_traffic_filtering=True,id=db433bb1-8c59-4e6b-ae87-f6fab836df0f,network=Network(a7b6c0bc-d2de-4431-821b-c2917738e556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb433bb1-8c')
Apr 14 01:55:36 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-13f85645-58a2-4827-97ea-6ade18012972 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Deleting instance files /opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80_del
Apr 14 01:55:36 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-13f85645-58a2-4827-97ea-6ade18012972 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Deletion of /opt/stack/data/nova/instances/18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80_del complete
Apr 14 01:55:36 user nova-compute[71498]: INFO nova.compute.manager [None req-13f85645-58a2-4827-97ea-6ade18012972 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 14 01:55:36 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-13f85645-58a2-4827-97ea-6ade18012972 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 01:55:36 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 01:55:36 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 01:55:36 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:55:36 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:55:36 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26363323966666434', 'path': '/dev/sde'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:55:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363323966666434', 'path': '/dev/sde'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:55:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:55:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:55:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:55:36 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 01:55:36 user nova-compute[71498]: DEBUG nova.objects.instance [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'flavor' on Instance uuid 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:55:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 01:55:36 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:55:36 user nova-compute[71498]:   <source dev="/dev/sde"/>
Apr 14 01:55:36 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:55:36 user nova-compute[71498]:   <serial>4c279a98-9587-47a8-a153-408cc1232415</serial>
Apr 14 01:55:36 user nova-compute[71498]: </disk>
Apr 14 01:55:36 user nova-compute[71498]:  {{(pid=71498) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 01:55:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:55:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:55:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] No VIF found with MAC fa:16:3e:84:32:3a, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:55:36 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:55:36 user nova-compute[71498]: DEBUG nova.compute.manager [req-6682e471-e505-4eb7-8f74-ae6f3bff88ad req-588675c3-9317-46ad-8af5-9f89b83e9db3 service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Received event network-vif-deleted-db433bb1-8c59-4e6b-ae87-f6fab836df0f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:55:36 user nova-compute[71498]: INFO nova.compute.manager [req-6682e471-e505-4eb7-8f74-ae6f3bff88ad req-588675c3-9317-46ad-8af5-9f89b83e9db3 service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Neutron deleted interface db433bb1-8c59-4e6b-ae87-f6fab836df0f; detaching it from the instance and deleting it from the info cache
Apr 14 01:55:36 user nova-compute[71498]: DEBUG nova.network.neutron [req-6682e471-e505-4eb7-8f74-ae6f3bff88ad req-588675c3-9317-46ad-8af5-9f89b83e9db3 service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:55:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:55:36 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Took 0.75 seconds to deallocate network for instance.
Apr 14 01:55:36 user nova-compute[71498]: DEBUG nova.compute.manager [req-6682e471-e505-4eb7-8f74-ae6f3bff88ad req-588675c3-9317-46ad-8af5-9f89b83e9db3 service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Detach interface failed, port_id=db433bb1-8c59-4e6b-ae87-f6fab836df0f, reason: Instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 could not be found. {{(pid=71498) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 01:55:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:55:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-13f85645-58a2-4827-97ea-6ade18012972 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:55:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-13f85645-58a2-4827-97ea-6ade18012972 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:55:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0169ef51-a395-493c-91c4-774549f08840 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.587s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:55:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:37 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-13f85645-58a2-4827-97ea-6ade18012972 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:55:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:37 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-13f85645-58a2-4827-97ea-6ade18012972 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:55:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-13f85645-58a2-4827-97ea-6ade18012972 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.485s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:55:37 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-13f85645-58a2-4827-97ea-6ade18012972 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Deleted allocations for instance 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80
Apr 14 01:55:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-13f85645-58a2-4827-97ea-6ade18012972 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.327s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:55:37 user nova-compute[71498]: DEBUG nova.compute.manager [req-e723db50-7229-4254-ae4b-a66293b6d5db req-1d512fb5-e0b8-410e-93e8-781897470f62 service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Received event network-vif-plugged-db433bb1-8c59-4e6b-ae87-f6fab836df0f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:55:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e723db50-7229-4254-ae4b-a66293b6d5db req-1d512fb5-e0b8-410e-93e8-781897470f62 service nova] Acquiring lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:55:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e723db50-7229-4254-ae4b-a66293b6d5db req-1d512fb5-e0b8-410e-93e8-781897470f62 service nova] Lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:55:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e723db50-7229-4254-ae4b-a66293b6d5db req-1d512fb5-e0b8-410e-93e8-781897470f62 service nova] Lock "18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:55:37 user nova-compute[71498]: DEBUG nova.compute.manager [req-e723db50-7229-4254-ae4b-a66293b6d5db req-1d512fb5-e0b8-410e-93e8-781897470f62 service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] No waiting events found dispatching network-vif-plugged-db433bb1-8c59-4e6b-ae87-f6fab836df0f {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:55:37 user nova-compute[71498]: WARNING nova.compute.manager [req-e723db50-7229-4254-ae4b-a66293b6d5db req-1d512fb5-e0b8-410e-93e8-781897470f62 service nova] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Received unexpected event network-vif-plugged-db433bb1-8c59-4e6b-ae87-f6fab836df0f for instance with vm_state deleted and task_state None.
Apr 14 01:55:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:38 user nova-compute[71498]: INFO nova.compute.manager [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Rescuing
Apr 14 01:55:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "refresh_cache-92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:55:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquired lock "refresh_cache-92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:55:38 user nova-compute[71498]: DEBUG nova.network.neutron [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:55:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:38 user nova-compute[71498]: DEBUG nova.network.neutron [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Updating instance_info_cache with network_info: [{"id": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "address": "fa:16:3e:84:32:3a", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ad9be5-f1", "ovs_interfaceid": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:55:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Releasing lock "refresh_cache-92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:55:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:39 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:55:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:39 user nova-compute[71498]: DEBUG nova.compute.manager [req-1b3399af-3932-4086-976a-fe5d050eeb14 req-fc70e99c-fa6e-41a6-b8fe-7e198ee26f6e service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received event network-vif-unplugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:55:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1b3399af-3932-4086-976a-fe5d050eeb14 req-fc70e99c-fa6e-41a6-b8fe-7e198ee26f6e service nova] Acquiring lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:55:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1b3399af-3932-4086-976a-fe5d050eeb14 req-fc70e99c-fa6e-41a6-b8fe-7e198ee26f6e service nova] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:55:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1b3399af-3932-4086-976a-fe5d050eeb14 req-fc70e99c-fa6e-41a6-b8fe-7e198ee26f6e service nova] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:55:39 user nova-compute[71498]: DEBUG nova.compute.manager [req-1b3399af-3932-4086-976a-fe5d050eeb14 req-fc70e99c-fa6e-41a6-b8fe-7e198ee26f6e service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] No waiting events found dispatching network-vif-unplugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:55:39 user nova-compute[71498]: WARNING nova.compute.manager [req-1b3399af-3932-4086-976a-fe5d050eeb14 req-fc70e99c-fa6e-41a6-b8fe-7e198ee26f6e service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received unexpected event network-vif-unplugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance with vm_state active and task_state rescuing.
Apr 14 01:55:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:39 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:55:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:39 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:40 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Instance destroyed successfully.
Apr 14 01:55:40 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:55:40 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=7970MB free_disk=26.130050659179688GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:55:40 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Attempting rescue
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71498) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Instance directory exists: not creating {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 01:55:40 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Creating image(s)
Apr 14 01:55:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "/opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "/opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "/opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.objects.instance [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'trusted_certs' on Instance uuid 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Applying migration context for instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 as it has an incoming, in-progress migration fffda8d2-cec8-4809-a410-4bc405a28d5c. Migration status is finished {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 01:55:40 user nova-compute[71498]: INFO nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Updating resource usage from migration fffda8d2-cec8-4809-a410-4bc405a28d5c
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance a19a1c08-5454-481b-bb5a-70c39ead9afc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance fa29c144-0ff9-4efb-a574-f521d18f08fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance ae82789e-1bed-419b-a580-68ff7ed03ef2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 85b399dc-62df-480d-8561-5d9d1ab75c52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Migration fffda8d2-cec8-4809-a410-4bc405a28d5c is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=1856MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.134s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk.rescue {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk.rescue" returned: 0 in 0.045s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.183s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.objects.instance [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'migration_context' on Instance uuid 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Start _get_guest_xml network_info=[{"id": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "address": "fa:16:3e:84:32:3a", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "vif_mac": "fa:16:3e:84:32:3a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ad9be5-f1", "ovs_interfaceid": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.objects.instance [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'resources' on Instance uuid 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.objects.instance [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'numa_topology' on Instance uuid 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:55:40 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:55:40 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.objects.instance [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'vcpu_model' on Instance uuid 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:53:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2091181391',display_name='tempest-ServerRescueNegativeTestJSON-server-2091181391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2091181391',id=30,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+OdZSGBEkWqqj7kuDmKwl/+l4bHkD0nIQkpmr7DuvkGkz+hkeVv46cz6D3tLWZ7TOclqa0k/xgkvW1kl0/hacLGQfyoaWAHTyjX568DZBdMmvuK27rWMMV+9zvHM6h7g==',key_name='tempest-keypair-843861517',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:53:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d3de04739384e3ea3a475fee28be3c0',ramdisk_id='',reservation_id='r-4mnwzjvx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1453869246',owner_user_name='tempest-ServerRescueNegativeTestJSON-1453869246-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:53:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeb5f26be86e43b3b61fff98fdc83cf3',uuid=92e640b7-a222-4b2f-8d9f-7151cfc7dcc7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "address": "fa:16:3e:84:32:3a", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "vif_mac": "fa:16:3e:84:32:3a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ad9be5-f1", "ovs_interfaceid": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Converting VIF {"id": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "address": "fa:16:3e:84:32:3a", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "vif_mac": "fa:16:3e:84:32:3a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ad9be5-f1", "ovs_interfaceid": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:32:3a,bridge_name='br-int',has_traffic_filtering=True,id=69ad9be5-f12b-4f3b-8a10-1e4c5f09264d,network=Network(2c4fba9e-0217-4e37-af1c-065b3f0cd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69ad9be5-f1') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.objects.instance [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'pci_devices' on Instance uuid 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:55:40 user nova-compute[71498]:   <uuid>92e640b7-a222-4b2f-8d9f-7151cfc7dcc7</uuid>
Apr 14 01:55:40 user nova-compute[71498]:   <name>instance-0000001e</name>
Apr 14 01:55:40 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:55:40 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:55:40 user nova-compute[71498]:   <metadata>
Apr 14 01:55:40 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:55:40 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:55:40 user nova-compute[71498]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2091181391</nova:name>
Apr 14 01:55:40 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:55:40</nova:creationTime>
Apr 14 01:55:40 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:55:40 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:55:40 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:55:40 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:55:40 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:55:40 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:55:40 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:55:40 user nova-compute[71498]:       <nova:owner>
Apr 14 01:55:40 user nova-compute[71498]:         <nova:user uuid="eeb5f26be86e43b3b61fff98fdc83cf3">tempest-ServerRescueNegativeTestJSON-1453869246-project-member</nova:user>
Apr 14 01:55:40 user nova-compute[71498]:         <nova:project uuid="6d3de04739384e3ea3a475fee28be3c0">tempest-ServerRescueNegativeTestJSON-1453869246</nova:project>
Apr 14 01:55:40 user nova-compute[71498]:       </nova:owner>
Apr 14 01:55:40 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:55:40 user nova-compute[71498]:       <nova:ports>
Apr 14 01:55:40 user nova-compute[71498]:         <nova:port uuid="69ad9be5-f12b-4f3b-8a10-1e4c5f09264d">
Apr 14 01:55:40 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 01:55:40 user nova-compute[71498]:         </nova:port>
Apr 14 01:55:40 user nova-compute[71498]:       </nova:ports>
Apr 14 01:55:40 user nova-compute[71498]:     </nova:instance>
Apr 14 01:55:40 user nova-compute[71498]:   </metadata>
Apr 14 01:55:40 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:55:40 user nova-compute[71498]:     <system>
Apr 14 01:55:40 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:55:40 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:55:40 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:55:40 user nova-compute[71498]:       <entry name="serial">92e640b7-a222-4b2f-8d9f-7151cfc7dcc7</entry>
Apr 14 01:55:40 user nova-compute[71498]:       <entry name="uuid">92e640b7-a222-4b2f-8d9f-7151cfc7dcc7</entry>
Apr 14 01:55:40 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:55:40 user nova-compute[71498]:     </system>
Apr 14 01:55:40 user nova-compute[71498]:   </sysinfo>
Apr 14 01:55:40 user nova-compute[71498]:   <os>
Apr 14 01:55:40 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:55:40 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:55:40 user nova-compute[71498]:   </os>
Apr 14 01:55:40 user nova-compute[71498]:   <features>
Apr 14 01:55:40 user nova-compute[71498]:     <acpi/>
Apr 14 01:55:40 user nova-compute[71498]:     <apic/>
Apr 14 01:55:40 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:55:40 user nova-compute[71498]:   </features>
Apr 14 01:55:40 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:55:40 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:55:40 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:55:40 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:55:40 user nova-compute[71498]:   </clock>
Apr 14 01:55:40 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:55:40 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:55:40 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:55:40 user nova-compute[71498]:   </cpu>
Apr 14 01:55:40 user nova-compute[71498]:   <devices>
Apr 14 01:55:40 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:55:40 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:55:40 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk.rescue"/>
Apr 14 01:55:40 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:55:40 user nova-compute[71498]:     </disk>
Apr 14 01:55:40 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:55:40 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:55:40 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk"/>
Apr 14 01:55:40 user nova-compute[71498]:       <target dev="vdb" bus="virtio"/>
Apr 14 01:55:40 user nova-compute[71498]:     </disk>
Apr 14 01:55:40 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:55:40 user nova-compute[71498]:       <mac address="fa:16:3e:84:32:3a"/>
Apr 14 01:55:40 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:55:40 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:55:40 user nova-compute[71498]:       <target dev="tap69ad9be5-f1"/>
Apr 14 01:55:40 user nova-compute[71498]:     </interface>
Apr 14 01:55:40 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:55:40 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/console.log" append="off"/>
Apr 14 01:55:40 user nova-compute[71498]:     </serial>
Apr 14 01:55:40 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:55:40 user nova-compute[71498]:     <video>
Apr 14 01:55:40 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:55:40 user nova-compute[71498]:     </video>
Apr 14 01:55:40 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:55:40 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:55:40 user nova-compute[71498]:     </rng>
Apr 14 01:55:40 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:55:40 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:55:40 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:55:40 user nova-compute[71498]:     </memballoon>
Apr 14 01:55:40 user nova-compute[71498]:   </devices>
Apr 14 01:55:40 user nova-compute[71498]: </domain>
Apr 14 01:55:40 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:55:40 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Instance destroyed successfully.
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] No VIF found with MAC fa:16:3e:84:32:3a, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 01:55:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.528s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:55:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:41 user nova-compute[71498]: DEBUG nova.compute.manager [req-63871904-dc83-4b70-8d62-536e2c727ae8 req-d06a868b-f65b-486f-91b5-3c01b3b176ce service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received event network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:55:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-63871904-dc83-4b70-8d62-536e2c727ae8 req-d06a868b-f65b-486f-91b5-3c01b3b176ce service nova] Acquiring lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:55:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-63871904-dc83-4b70-8d62-536e2c727ae8 req-d06a868b-f65b-486f-91b5-3c01b3b176ce service nova] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:55:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-63871904-dc83-4b70-8d62-536e2c727ae8 req-d06a868b-f65b-486f-91b5-3c01b3b176ce service nova] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:55:41 user nova-compute[71498]: DEBUG nova.compute.manager [req-63871904-dc83-4b70-8d62-536e2c727ae8 req-d06a868b-f65b-486f-91b5-3c01b3b176ce service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] No waiting events found dispatching network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:55:41 user nova-compute[71498]: WARNING nova.compute.manager [req-63871904-dc83-4b70-8d62-536e2c727ae8 req-d06a868b-f65b-486f-91b5-3c01b3b176ce service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received unexpected event network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance with vm_state active and task_state rescuing.
Apr 14 01:55:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:43 user nova-compute[71498]: DEBUG nova.compute.manager [req-46af440b-ddb9-4feb-bddc-4855d996fe7a req-13e1e7b1-96a3-4cef-9d40-92e83c5b96af service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received event network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:55:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-46af440b-ddb9-4feb-bddc-4855d996fe7a req-13e1e7b1-96a3-4cef-9d40-92e83c5b96af service nova] Acquiring lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:55:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-46af440b-ddb9-4feb-bddc-4855d996fe7a req-13e1e7b1-96a3-4cef-9d40-92e83c5b96af service nova] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:55:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-46af440b-ddb9-4feb-bddc-4855d996fe7a req-13e1e7b1-96a3-4cef-9d40-92e83c5b96af service nova] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:55:43 user nova-compute[71498]: DEBUG nova.compute.manager [req-46af440b-ddb9-4feb-bddc-4855d996fe7a req-13e1e7b1-96a3-4cef-9d40-92e83c5b96af service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] No waiting events found dispatching network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:55:43 user nova-compute[71498]: WARNING nova.compute.manager [req-46af440b-ddb9-4feb-bddc-4855d996fe7a req-13e1e7b1-96a3-4cef-9d40-92e83c5b96af service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received unexpected event network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance with vm_state active and task_state rescuing.
Apr 14 01:55:43 user nova-compute[71498]: DEBUG nova.compute.manager [req-46af440b-ddb9-4feb-bddc-4855d996fe7a req-13e1e7b1-96a3-4cef-9d40-92e83c5b96af service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received event network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:55:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-46af440b-ddb9-4feb-bddc-4855d996fe7a req-13e1e7b1-96a3-4cef-9d40-92e83c5b96af service nova] Acquiring lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:55:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-46af440b-ddb9-4feb-bddc-4855d996fe7a req-13e1e7b1-96a3-4cef-9d40-92e83c5b96af service nova] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:55:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-46af440b-ddb9-4feb-bddc-4855d996fe7a req-13e1e7b1-96a3-4cef-9d40-92e83c5b96af service nova] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:55:43 user nova-compute[71498]: DEBUG nova.compute.manager [req-46af440b-ddb9-4feb-bddc-4855d996fe7a req-13e1e7b1-96a3-4cef-9d40-92e83c5b96af service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] No waiting events found dispatching network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:55:43 user nova-compute[71498]: WARNING nova.compute.manager [req-46af440b-ddb9-4feb-bddc-4855d996fe7a req-13e1e7b1-96a3-4cef-9d40-92e83c5b96af service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received unexpected event network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance with vm_state active and task_state rescuing.
Apr 14 01:55:43 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:55:43 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 01:55:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-a19a1c08-5454-481b-bb5a-70c39ead9afc" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:55:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-a19a1c08-5454-481b-bb5a-70c39ead9afc" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:55:43 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 01:55:44 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Removed pending event for 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 due to event {{(pid=71498) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 01:55:44 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437344.022298, 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:55:44 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] VM Resumed (Lifecycle Event)
Apr 14 01:55:44 user nova-compute[71498]: DEBUG nova.compute.manager [None req-f947f81e-d4c3-417b-8bd0-cf1930629be5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:55:44 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:55:44 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:55:44 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 01:55:44 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437344.0232027, 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:55:44 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] VM Started (Lifecycle Event)
Apr 14 01:55:44 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:55:44 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:55:44 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 01:55:44 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Updating instance_info_cache with network_info: [{"id": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "address": "fa:16:3e:1f:54:6c", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b00fd21-ee", "ovs_interfaceid": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:55:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-a19a1c08-5454-481b-bb5a-70c39ead9afc" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:55:44 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 01:55:44 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:55:44 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:55:44 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:55:46 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:46 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:55:46 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:55:46 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:55:46 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 01:55:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "618f5f0d-3594-41dd-9d8f-0c7bea255a3f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:55:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "618f5f0d-3594-41dd-9d8f-0c7bea255a3f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:55:46 user nova-compute[71498]: DEBUG nova.compute.manager [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 01:55:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:55:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:55:46 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:55:46 user nova-compute[71498]: INFO nova.compute.claims [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Claim successful on node user
Apr 14 01:55:47 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:55:47 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:55:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:55:47 user nova-compute[71498]: DEBUG nova.compute.manager [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 01:55:47 user nova-compute[71498]: DEBUG nova.compute.manager [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 01:55:47 user nova-compute[71498]: DEBUG nova.network.neutron [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:55:47 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 01:55:47 user nova-compute[71498]: DEBUG nova.compute.manager [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 01:55:47 user nova-compute[71498]: INFO nova.virt.block_device [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Booting with volume 450914a2-96ae-4c21-a717-2b391be59860 at /dev/vda
Apr 14 01:55:47 user nova-compute[71498]: DEBUG nova.policy [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50e3354ac1a84c59a7dee8e1ae6e771a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f4117a4adb4aa3b42951cf1fc84237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:55:47 user nova-compute[71498]: DEBUG os_brick.utils [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:55:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:47 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b84133-7e82-4ee7-8554-cfca8cd518cb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:55:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:47 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1768b48a-a60a-4c04-a101-06415763300d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:55:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:47 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7fbcda-0d4d-4cf3-a026-c3d609f7c290]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:55:47 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5a5252-335a-4a34-a63f-0162d96851eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:55:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:55:47 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:55:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:55:47 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:55:47 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a237df-be20-4ef9-9838-f38f95108b47]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:55:47 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:55:47 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:55:47 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:55:47 user nova-compute[71498]: DEBUG os_brick.utils [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:55:47 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Updating existing volume attachment record: 3a19bcd6-96f7-4c66-b2e0-5b4533886c2f {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:55:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:48 user nova-compute[71498]: DEBUG nova.network.neutron [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Successfully created port: 7eb65ace-3427-4415-a8ef-26064243471e {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:55:48 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:55:49 user nova-compute[71498]: DEBUG nova.network.neutron [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Successfully updated port: 7eb65ace-3427-4415-a8ef-26064243471e {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:55:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "refresh_cache-618f5f0d-3594-41dd-9d8f-0c7bea255a3f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:55:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquired lock "refresh_cache-618f5f0d-3594-41dd-9d8f-0c7bea255a3f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:55:49 user nova-compute[71498]: DEBUG nova.network.neutron [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:55:49 user nova-compute[71498]: DEBUG nova.compute.manager [req-a951097e-5fe7-489e-b4b1-0c3f38335027 req-8bef10ca-015b-40f9-8d81-e92952516f34 service nova] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Received event network-changed-7eb65ace-3427-4415-a8ef-26064243471e {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:55:49 user nova-compute[71498]: DEBUG nova.compute.manager [req-a951097e-5fe7-489e-b4b1-0c3f38335027 req-8bef10ca-015b-40f9-8d81-e92952516f34 service nova] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Refreshing instance network info cache due to event network-changed-7eb65ace-3427-4415-a8ef-26064243471e. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:55:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a951097e-5fe7-489e-b4b1-0c3f38335027 req-8bef10ca-015b-40f9-8d81-e92952516f34 service nova] Acquiring lock "refresh_cache-618f5f0d-3594-41dd-9d8f-0c7bea255a3f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:55:49 user nova-compute[71498]: DEBUG nova.network.neutron [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:55:49 user nova-compute[71498]: DEBUG nova.network.neutron [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Updating instance_info_cache with network_info: [{"id": "7eb65ace-3427-4415-a8ef-26064243471e", "address": "fa:16:3e:0f:86:e9", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb65ace-34", "ovs_interfaceid": "7eb65ace-3427-4415-a8ef-26064243471e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:55:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Releasing lock "refresh_cache-618f5f0d-3594-41dd-9d8f-0c7bea255a3f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:55:49 user nova-compute[71498]: DEBUG nova.compute.manager [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Instance network_info: |[{"id": "7eb65ace-3427-4415-a8ef-26064243471e", "address": "fa:16:3e:0f:86:e9", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb65ace-34", "ovs_interfaceid": "7eb65ace-3427-4415-a8ef-26064243471e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 01:55:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a951097e-5fe7-489e-b4b1-0c3f38335027 req-8bef10ca-015b-40f9-8d81-e92952516f34 service nova] Acquired lock "refresh_cache-618f5f0d-3594-41dd-9d8f-0c7bea255a3f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:55:49 user nova-compute[71498]: DEBUG nova.network.neutron [req-a951097e-5fe7-489e-b4b1-0c3f38335027 req-8bef10ca-015b-40f9-8d81-e92952516f34 service nova] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Refreshing network info cache for port 7eb65ace-3427-4415-a8ef-26064243471e {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:55:50 user nova-compute[71498]: DEBUG nova.network.neutron [req-a951097e-5fe7-489e-b4b1-0c3f38335027 req-8bef10ca-015b-40f9-8d81-e92952516f34 service nova] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Updated VIF entry in instance network info cache for port 7eb65ace-3427-4415-a8ef-26064243471e. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:55:50 user nova-compute[71498]: DEBUG nova.network.neutron [req-a951097e-5fe7-489e-b4b1-0c3f38335027 req-8bef10ca-015b-40f9-8d81-e92952516f34 service nova] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Updating instance_info_cache with network_info: [{"id": "7eb65ace-3427-4415-a8ef-26064243471e", "address": "fa:16:3e:0f:86:e9", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb65ace-34", "ovs_interfaceid": "7eb65ace-3427-4415-a8ef-26064243471e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:55:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a951097e-5fe7-489e-b4b1-0c3f38335027 req-8bef10ca-015b-40f9-8d81-e92952516f34 service nova] Releasing lock "refresh_cache-618f5f0d-3594-41dd-9d8f-0c7bea255a3f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:55:51 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681437336.0694406, 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80 => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:55:51 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] VM Stopped (Lifecycle Event)
Apr 14 01:55:51 user nova-compute[71498]: DEBUG nova.compute.manager [None req-f4a42c66-02d9-4caf-aeb5-410469d2b29b None None] [instance: 18ee0c35-e1ac-4369-a5b1-8ecd5eb0cb80] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:55:51 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG nova.compute.manager [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:55:54 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Creating image(s)
Apr 14 01:55:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Did not create local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Ensure instance console log exists: /opt/stack/data/nova/instances/618f5f0d-3594-41dd-9d8f-0c7bea255a3f/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Start _get_guest_xml network_info=[{"id": "7eb65ace-3427-4415-a8ef-26064243471e", "address": "fa:16:3e:0f:86:e9", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb65ace-34", "ovs_interfaceid": "7eb65ace-3427-4415-a8ef-26064243471e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3a19bcd6-96f7-4c66-b2e0-5b4533886c2f', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XIKaoMjg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '618f5f0d-3594-41dd-9d8f-0c7bea255a3f', 'attached_at': '', 'detached_at': '', 'volume_id': '450914a2-96ae-4c21-a717-2b391be59860', 'serial': '450914a2-96ae-4c21-a717-2b391be59860'}, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:55:54 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:55:54 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:55:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XIKaoMjg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:55:54 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:55:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:55:54 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:55:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:55:54 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee47b81e-9ac8-4e9c-932d-82433d12ceb5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:55:54 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd5df80-607a-4be1-861f-79f78c31b15a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860] added
Apr 14 01:55:54 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b63beb-5229-45fe-b35a-d14e5849b800]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1dec420-4363-4f19-846f-c234a536b34c]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XIKaoMjg {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XIKaoMjg" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d5e5cd-3aed-4c5a-88d2-8a5f924dbbb5]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XIKaoMjg'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb1ee2f-0061-4c9f-86e3-7f21e16fd414]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe33946-a25a-475f-a123-a14f4e3fc349]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:55:54 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:55:54 user nova-compute[71498]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:55:54 user nova-compute[71498]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:55:54 user nova-compute[71498]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)
Apr 14 01:55:54 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:55:54 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:55:54 user nova-compute[71498]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:55:54 user nova-compute[71498]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:55:54 user nova-compute[71498]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)
Apr 14 01:55:54 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e4c0e9-3fb0-4d1d-94a3-2272cecacaac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860, portal: 172.16.0.220,3260]
Apr 14 01:55:54 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860, portal: 172.16.0.220,3260] successful.
Apr 14 01:55:54 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b4ecfa-5337-4d48-8d15-f89f0d7ef307]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0653786c-2f73-48b5-b2d3-e20eeafac701]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:55:54 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:55:54 user nova-compute[71498]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:55:54 user nova-compute[71498]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:55:54 user nova-compute[71498]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)
Apr 14 01:55:54 user nova-compute[71498]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:55:54 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:55:54 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:55:54 user nova-compute[71498]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:55:54 user nova-compute[71498]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:55:54 user nova-compute[71498]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)
Apr 14 01:55:54 user nova-compute[71498]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:55:54 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda2d1cd-7a9e-4db7-85fa-830fadda843c]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:55:54 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: None {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:55:55 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:55:55 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XIKaoMjg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:55:55 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:55:55 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23637373038376566', 'path': '/dev/sdf'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:55:55 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637373038376566', 'path': '/dev/sdf'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:55:55 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:55:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1218439158',display_name='tempest-TestVolumeBootPattern-server-1218439158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1218439158',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcODdjkXb9vqfJo6mLTbOXnPLP2HdwXcPxYgRVEM78ApSpFWKxeZveFravQCk22JVH3n1PXZDKAyefoGYrsPczv6zWWLW2pkXjL46/zFdGhb8s3BmOyjVZHJdx/Y2ktUg==',key_name='tempest-TestVolumeBootPattern-824995165',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1f4117a4adb4aa3b42951cf1fc84237',ramdisk_id='',reservation_id='r-1h2cwt4h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-224521177',owner_user_name='tempest-TestVolumeBootPattern-224521177-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:55:47Z,user_data=None,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',uuid=618f5f0d-3594-41dd-9d8f-0c7bea255a3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7eb65ace-3427-4415-a8ef-26064243471e", "address": "fa:16:3e:0f:86:e9", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb65ace-34", "ovs_interfaceid": "7eb65ace-3427-4415-a8ef-26064243471e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:55:55 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converting VIF {"id": "7eb65ace-3427-4415-a8ef-26064243471e", "address": "fa:16:3e:0f:86:e9", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb65ace-34", "ovs_interfaceid": "7eb65ace-3427-4415-a8ef-26064243471e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:55:55 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:86:e9,bridge_name='br-int',has_traffic_filtering=True,id=7eb65ace-3427-4415-a8ef-26064243471e,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eb65ace-34') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:55:55 user nova-compute[71498]: DEBUG nova.objects.instance [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lazy-loading 'pci_devices' on Instance uuid 618f5f0d-3594-41dd-9d8f-0c7bea255a3f {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:55:55 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:55:55 user nova-compute[71498]:   <uuid>618f5f0d-3594-41dd-9d8f-0c7bea255a3f</uuid>
Apr 14 01:55:55 user nova-compute[71498]:   <name>instance-0000001f</name>
Apr 14 01:55:55 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:55:55 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:55:55 user nova-compute[71498]:   <metadata>
Apr 14 01:55:55 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:55:55 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:55:55 user nova-compute[71498]:       <nova:name>tempest-TestVolumeBootPattern-server-1218439158</nova:name>
Apr 14 01:55:55 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:55:54</nova:creationTime>
Apr 14 01:55:55 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:55:55 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:55:55 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:55:55 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:55:55 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:55:55 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:55:55 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:55:55 user nova-compute[71498]:       <nova:owner>
Apr 14 01:55:55 user nova-compute[71498]:         <nova:user uuid="50e3354ac1a84c59a7dee8e1ae6e771a">tempest-TestVolumeBootPattern-224521177-project-member</nova:user>
Apr 14 01:55:55 user nova-compute[71498]:         <nova:project uuid="c1f4117a4adb4aa3b42951cf1fc84237">tempest-TestVolumeBootPattern-224521177</nova:project>
Apr 14 01:55:55 user nova-compute[71498]:       </nova:owner>
Apr 14 01:55:55 user nova-compute[71498]:       <nova:ports>
Apr 14 01:55:55 user nova-compute[71498]:         <nova:port uuid="7eb65ace-3427-4415-a8ef-26064243471e">
Apr 14 01:55:55 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 01:55:55 user nova-compute[71498]:         </nova:port>
Apr 14 01:55:55 user nova-compute[71498]:       </nova:ports>
Apr 14 01:55:55 user nova-compute[71498]:     </nova:instance>
Apr 14 01:55:55 user nova-compute[71498]:   </metadata>
Apr 14 01:55:55 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:55:55 user nova-compute[71498]:     <system>
Apr 14 01:55:55 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:55:55 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:55:55 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:55:55 user nova-compute[71498]:       <entry name="serial">618f5f0d-3594-41dd-9d8f-0c7bea255a3f</entry>
Apr 14 01:55:55 user nova-compute[71498]:       <entry name="uuid">618f5f0d-3594-41dd-9d8f-0c7bea255a3f</entry>
Apr 14 01:55:55 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:55:55 user nova-compute[71498]:     </system>
Apr 14 01:55:55 user nova-compute[71498]:   </sysinfo>
Apr 14 01:55:55 user nova-compute[71498]:   <os>
Apr 14 01:55:55 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:55:55 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:55:55 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:55:55 user nova-compute[71498]:   </os>
Apr 14 01:55:55 user nova-compute[71498]:   <features>
Apr 14 01:55:55 user nova-compute[71498]:     <acpi/>
Apr 14 01:55:55 user nova-compute[71498]:     <apic/>
Apr 14 01:55:55 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:55:55 user nova-compute[71498]:   </features>
Apr 14 01:55:55 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:55:55 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:55:55 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:55:55 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:55:55 user nova-compute[71498]:   </clock>
Apr 14 01:55:55 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:55:55 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:55:55 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:55:55 user nova-compute[71498]:   </cpu>
Apr 14 01:55:55 user nova-compute[71498]:   <devices>
Apr 14 01:55:55 user nova-compute[71498]:     <disk type="block" device="disk">
Apr 14 01:55:55 user nova-compute[71498]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:55:55 user nova-compute[71498]:       <source dev="/dev/sdf"/>
Apr 14 01:55:55 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:55:55 user nova-compute[71498]:       <serial>450914a2-96ae-4c21-a717-2b391be59860</serial>
Apr 14 01:55:55 user nova-compute[71498]:     </disk>
Apr 14 01:55:55 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:55:55 user nova-compute[71498]:       <mac address="fa:16:3e:0f:86:e9"/>
Apr 14 01:55:55 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:55:55 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:55:55 user nova-compute[71498]:       <target dev="tap7eb65ace-34"/>
Apr 14 01:55:55 user nova-compute[71498]:     </interface>
Apr 14 01:55:55 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:55:55 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/618f5f0d-3594-41dd-9d8f-0c7bea255a3f/console.log" append="off"/>
Apr 14 01:55:55 user nova-compute[71498]:     </serial>
Apr 14 01:55:55 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:55:55 user nova-compute[71498]:     <video>
Apr 14 01:55:55 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:55:55 user nova-compute[71498]:     </video>
Apr 14 01:55:55 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:55:55 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:55:55 user nova-compute[71498]:     </rng>
Apr 14 01:55:55 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:55:55 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:55:55 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:55:55 user nova-compute[71498]:     </memballoon>
Apr 14 01:55:55 user nova-compute[71498]:   </devices>
Apr 14 01:55:55 user nova-compute[71498]: </domain>
Apr 14 01:55:55 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:55:55 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:55:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1218439158',display_name='tempest-TestVolumeBootPattern-server-1218439158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1218439158',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcODdjkXb9vqfJo6mLTbOXnPLP2HdwXcPxYgRVEM78ApSpFWKxeZveFravQCk22JVH3n1PXZDKAyefoGYrsPczv6zWWLW2pkXjL46/zFdGhb8s3BmOyjVZHJdx/Y2ktUg==',key_name='tempest-TestVolumeBootPattern-824995165',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1f4117a4adb4aa3b42951cf1fc84237',ramdisk_id='',reservation_id='r-1h2cwt4h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-224521177',owner_user_name='tempest-TestVolumeBootPattern-224521177-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:55:47Z,user_data=None,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',uuid=618f5f0d-3594-41dd-9d8f-0c7bea255a3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7eb65ace-3427-4415-a8ef-26064243471e", "address": "fa:16:3e:0f:86:e9", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb65ace-34", "ovs_interfaceid": "7eb65ace-3427-4415-a8ef-26064243471e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:55:55 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converting VIF {"id": "7eb65ace-3427-4415-a8ef-26064243471e", "address": "fa:16:3e:0f:86:e9", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb65ace-34", "ovs_interfaceid": "7eb65ace-3427-4415-a8ef-26064243471e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:55:55 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:86:e9,bridge_name='br-int',has_traffic_filtering=True,id=7eb65ace-3427-4415-a8ef-26064243471e,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eb65ace-34') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:55:55 user nova-compute[71498]: DEBUG os_vif [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:86:e9,bridge_name='br-int',has_traffic_filtering=True,id=7eb65ace-3427-4415-a8ef-26064243471e,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eb65ace-34') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:55:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:55:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:55:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7eb65ace-34, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:55:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7eb65ace-34, col_values=(('external_ids', {'iface-id': '7eb65ace-3427-4415-a8ef-26064243471e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:86:e9', 'vm-uuid': '618f5f0d-3594-41dd-9d8f-0c7bea255a3f'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:55:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:55:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:55 user nova-compute[71498]: INFO os_vif [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:86:e9,bridge_name='br-int',has_traffic_filtering=True,id=7eb65ace-3427-4415-a8ef-26064243471e,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eb65ace-34')
Apr 14 01:55:55 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:55:55 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] No VIF found with MAC fa:16:3e:0f:86:e9, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:55:56 user nova-compute[71498]: INFO nova.compute.manager [None req-590eab39-5723-406f-8990-83920400fcd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Unrescuing
Apr 14 01:55:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-590eab39-5723-406f-8990-83920400fcd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "refresh_cache-7ff438f4-54e1-44b9-bb5a-1b42d48a37ed" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:55:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-590eab39-5723-406f-8990-83920400fcd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquired lock "refresh_cache-7ff438f4-54e1-44b9-bb5a-1b42d48a37ed" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:55:56 user nova-compute[71498]: DEBUG nova.network.neutron [None req-590eab39-5723-406f-8990-83920400fcd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:55:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:57 user nova-compute[71498]: DEBUG nova.compute.manager [req-349f4569-990b-4ecb-9f45-71c4e4b3ce17 req-dc0f634e-8600-4379-b2a0-5a338d63eb5a service nova] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Received event network-vif-plugged-7eb65ace-3427-4415-a8ef-26064243471e {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:55:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-349f4569-990b-4ecb-9f45-71c4e4b3ce17 req-dc0f634e-8600-4379-b2a0-5a338d63eb5a service nova] Acquiring lock "618f5f0d-3594-41dd-9d8f-0c7bea255a3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:55:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-349f4569-990b-4ecb-9f45-71c4e4b3ce17 req-dc0f634e-8600-4379-b2a0-5a338d63eb5a service nova] Lock "618f5f0d-3594-41dd-9d8f-0c7bea255a3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:55:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-349f4569-990b-4ecb-9f45-71c4e4b3ce17 req-dc0f634e-8600-4379-b2a0-5a338d63eb5a service nova] Lock "618f5f0d-3594-41dd-9d8f-0c7bea255a3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:55:57 user nova-compute[71498]: DEBUG nova.compute.manager [req-349f4569-990b-4ecb-9f45-71c4e4b3ce17 req-dc0f634e-8600-4379-b2a0-5a338d63eb5a service nova] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] No waiting events found dispatching network-vif-plugged-7eb65ace-3427-4415-a8ef-26064243471e {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:55:57 user nova-compute[71498]: WARNING nova.compute.manager [req-349f4569-990b-4ecb-9f45-71c4e4b3ce17 req-dc0f634e-8600-4379-b2a0-5a338d63eb5a service nova] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Received unexpected event network-vif-plugged-7eb65ace-3427-4415-a8ef-26064243471e for instance with vm_state building and task_state spawning.
Apr 14 01:55:57 user nova-compute[71498]: DEBUG nova.network.neutron [None req-590eab39-5723-406f-8990-83920400fcd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Updating instance_info_cache with network_info: [{"id": "6568fde8-2639-4cee-8527-e3ca028f42fd", "address": "fa:16:3e:69:f8:89", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6568fde8-26", "ovs_interfaceid": "6568fde8-2639-4cee-8527-e3ca028f42fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:55:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-590eab39-5723-406f-8990-83920400fcd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Releasing lock "refresh_cache-7ff438f4-54e1-44b9-bb5a-1b42d48a37ed" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:55:57 user nova-compute[71498]: DEBUG nova.objects.instance [None req-590eab39-5723-406f-8990-83920400fcd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lazy-loading 'flavor' on Instance uuid 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:55:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:57 user nova-compute[71498]: DEBUG nova.compute.manager [req-8e27c627-7be1-48c8-bddd-2d223e7ef8e6 req-f364634d-aabc-41cc-8318-98e85ebd6620 service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Received event network-vif-unplugged-6568fde8-2639-4cee-8527-e3ca028f42fd {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:55:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8e27c627-7be1-48c8-bddd-2d223e7ef8e6 req-f364634d-aabc-41cc-8318-98e85ebd6620 service nova] Acquiring lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:55:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8e27c627-7be1-48c8-bddd-2d223e7ef8e6 req-f364634d-aabc-41cc-8318-98e85ebd6620 service nova] Lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:55:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8e27c627-7be1-48c8-bddd-2d223e7ef8e6 req-f364634d-aabc-41cc-8318-98e85ebd6620 service nova] Lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:55:57 user nova-compute[71498]: DEBUG nova.compute.manager [req-8e27c627-7be1-48c8-bddd-2d223e7ef8e6 req-f364634d-aabc-41cc-8318-98e85ebd6620 service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] No waiting events found dispatching network-vif-unplugged-6568fde8-2639-4cee-8527-e3ca028f42fd {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:55:57 user nova-compute[71498]: WARNING nova.compute.manager [req-8e27c627-7be1-48c8-bddd-2d223e7ef8e6 req-f364634d-aabc-41cc-8318-98e85ebd6620 service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Received unexpected event network-vif-unplugged-6568fde8-2639-4cee-8527-e3ca028f42fd for instance with vm_state rescued and task_state unrescuing.
Apr 14 01:55:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:58 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Instance destroyed successfully.
Apr 14 01:55:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:59 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437359.3105876, 618f5f0d-3594-41dd-9d8f-0c7bea255a3f => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:55:59 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] VM Resumed (Lifecycle Event)
Apr 14 01:55:59 user nova-compute[71498]: DEBUG nova.compute.manager [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:55:59 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:55:59 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Instance spawned successfully.
Apr 14 01:55:59 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:55:59 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:55:59 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:55:59 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:55:59 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:55:59 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:55:59 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:55:59 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:55:59 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:55:59 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:55:59 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437359.3130164, 618f5f0d-3594-41dd-9d8f-0c7bea255a3f => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:55:59 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] VM Started (Lifecycle Event)
Apr 14 01:55:59 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:55:59 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:55:59 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:55:59 user nova-compute[71498]: INFO nova.compute.manager [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Took 5.24 seconds to spawn the instance on the hypervisor.
Apr 14 01:55:59 user nova-compute[71498]: DEBUG nova.compute.manager [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:55:59 user nova-compute[71498]: DEBUG nova.compute.manager [req-d9c73ee3-b35c-47a2-b5a9-a14de7270ed0 req-afb5655a-b00a-45d8-8cde-5006d9f7cd88 service nova] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Received event network-vif-plugged-7eb65ace-3427-4415-a8ef-26064243471e {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:55:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d9c73ee3-b35c-47a2-b5a9-a14de7270ed0 req-afb5655a-b00a-45d8-8cde-5006d9f7cd88 service nova] Acquiring lock "618f5f0d-3594-41dd-9d8f-0c7bea255a3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:55:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d9c73ee3-b35c-47a2-b5a9-a14de7270ed0 req-afb5655a-b00a-45d8-8cde-5006d9f7cd88 service nova] Lock "618f5f0d-3594-41dd-9d8f-0c7bea255a3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:55:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d9c73ee3-b35c-47a2-b5a9-a14de7270ed0 req-afb5655a-b00a-45d8-8cde-5006d9f7cd88 service nova] Lock "618f5f0d-3594-41dd-9d8f-0c7bea255a3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:55:59 user nova-compute[71498]: DEBUG nova.compute.manager [req-d9c73ee3-b35c-47a2-b5a9-a14de7270ed0 req-afb5655a-b00a-45d8-8cde-5006d9f7cd88 service nova] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] No waiting events found dispatching network-vif-plugged-7eb65ace-3427-4415-a8ef-26064243471e {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:55:59 user nova-compute[71498]: WARNING nova.compute.manager [req-d9c73ee3-b35c-47a2-b5a9-a14de7270ed0 req-afb5655a-b00a-45d8-8cde-5006d9f7cd88 service nova] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Received unexpected event network-vif-plugged-7eb65ace-3427-4415-a8ef-26064243471e for instance with vm_state building and task_state spawning.
Apr 14 01:55:59 user nova-compute[71498]: INFO nova.compute.manager [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Took 12.77 seconds to build instance.
Apr 14 01:55:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-20695d05-9199-495f-936d-05833742b4c7 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "618f5f0d-3594-41dd-9d8f-0c7bea255a3f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.867s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:55:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:55:59 user nova-compute[71498]: DEBUG nova.compute.manager [req-590688fb-25ca-4763-b96d-e869feb2646e req-9ad6400e-bc93-40d9-8004-a9edbb9d8a41 service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Received event network-vif-plugged-6568fde8-2639-4cee-8527-e3ca028f42fd {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:55:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-590688fb-25ca-4763-b96d-e869feb2646e req-9ad6400e-bc93-40d9-8004-a9edbb9d8a41 service nova] Acquiring lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:55:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-590688fb-25ca-4763-b96d-e869feb2646e req-9ad6400e-bc93-40d9-8004-a9edbb9d8a41 service nova] Lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:55:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-590688fb-25ca-4763-b96d-e869feb2646e req-9ad6400e-bc93-40d9-8004-a9edbb9d8a41 service nova] Lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:55:59 user nova-compute[71498]: DEBUG nova.compute.manager [req-590688fb-25ca-4763-b96d-e869feb2646e req-9ad6400e-bc93-40d9-8004-a9edbb9d8a41 service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] No waiting events found dispatching network-vif-plugged-6568fde8-2639-4cee-8527-e3ca028f42fd {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:55:59 user nova-compute[71498]: WARNING nova.compute.manager [req-590688fb-25ca-4763-b96d-e869feb2646e req-9ad6400e-bc93-40d9-8004-a9edbb9d8a41 service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Received unexpected event network-vif-plugged-6568fde8-2639-4cee-8527-e3ca028f42fd for instance with vm_state rescued and task_state unrescuing.
Apr 14 01:55:59 user nova-compute[71498]: DEBUG nova.compute.manager [req-590688fb-25ca-4763-b96d-e869feb2646e req-9ad6400e-bc93-40d9-8004-a9edbb9d8a41 service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Received event network-vif-plugged-6568fde8-2639-4cee-8527-e3ca028f42fd {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:55:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-590688fb-25ca-4763-b96d-e869feb2646e req-9ad6400e-bc93-40d9-8004-a9edbb9d8a41 service nova] Acquiring lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:55:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-590688fb-25ca-4763-b96d-e869feb2646e req-9ad6400e-bc93-40d9-8004-a9edbb9d8a41 service nova] Lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:55:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-590688fb-25ca-4763-b96d-e869feb2646e req-9ad6400e-bc93-40d9-8004-a9edbb9d8a41 service nova] Lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:55:59 user nova-compute[71498]: DEBUG nova.compute.manager [req-590688fb-25ca-4763-b96d-e869feb2646e req-9ad6400e-bc93-40d9-8004-a9edbb9d8a41 service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] No waiting events found dispatching network-vif-plugged-6568fde8-2639-4cee-8527-e3ca028f42fd {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:55:59 user nova-compute[71498]: WARNING nova.compute.manager [req-590688fb-25ca-4763-b96d-e869feb2646e req-9ad6400e-bc93-40d9-8004-a9edbb9d8a41 service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Received unexpected event network-vif-plugged-6568fde8-2639-4cee-8527-e3ca028f42fd for instance with vm_state rescued and task_state unrescuing.
Apr 14 01:56:00 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:01 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Removed pending event for 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed due to event {{(pid=71498) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 01:56:01 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437361.8259451, 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:56:01 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] VM Resumed (Lifecycle Event)
Apr 14 01:56:01 user nova-compute[71498]: DEBUG nova.compute.manager [None req-590eab39-5723-406f-8990-83920400fcd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:56:01 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:56:01 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:56:01 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 01:56:01 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437361.8301842, 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:56:01 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] VM Started (Lifecycle Event)
Apr 14 01:56:01 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:56:01 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:56:02 user nova-compute[71498]: DEBUG nova.compute.manager [req-e6163a08-5e82-42d6-b33b-55afb7278b26 req-015a6397-b104-47b9-8f7f-bc95de54f127 service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Received event network-vif-plugged-6568fde8-2639-4cee-8527-e3ca028f42fd {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:56:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e6163a08-5e82-42d6-b33b-55afb7278b26 req-015a6397-b104-47b9-8f7f-bc95de54f127 service nova] Acquiring lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:56:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e6163a08-5e82-42d6-b33b-55afb7278b26 req-015a6397-b104-47b9-8f7f-bc95de54f127 service nova] Lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:56:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e6163a08-5e82-42d6-b33b-55afb7278b26 req-015a6397-b104-47b9-8f7f-bc95de54f127 service nova] Lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:56:02 user nova-compute[71498]: DEBUG nova.compute.manager [req-e6163a08-5e82-42d6-b33b-55afb7278b26 req-015a6397-b104-47b9-8f7f-bc95de54f127 service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] No waiting events found dispatching network-vif-plugged-6568fde8-2639-4cee-8527-e3ca028f42fd {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:56:02 user nova-compute[71498]: WARNING nova.compute.manager [req-e6163a08-5e82-42d6-b33b-55afb7278b26 req-015a6397-b104-47b9-8f7f-bc95de54f127 service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Received unexpected event network-vif-plugged-6568fde8-2639-4cee-8527-e3ca028f42fd for instance with vm_state active and task_state None.
Apr 14 01:56:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:05 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:05 user nova-compute[71498]: DEBUG nova.network.neutron [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Port 84d281bf-164e-48f3-a3ee-ca796d9a48e7 binding to destination host user is already ACTIVE {{(pid=71498) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 14 01:56:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "refresh_cache-73cc8ede-babd-4281-bf1d-c5a3f8bad440" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:56:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquired lock "refresh_cache-73cc8ede-babd-4281-bf1d-c5a3f8bad440" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:56:05 user nova-compute[71498]: DEBUG nova.network.neutron [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:56:06 user nova-compute[71498]: DEBUG nova.network.neutron [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Updating instance_info_cache with network_info: [{"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:56:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Releasing lock "refresh_cache-73cc8ede-babd-4281-bf1d-c5a3f8bad440" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:56:06 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Creating tmpfile /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/tmp66p_rebs to verify with other compute node that the instance is on the same shared storage. {{(pid=71498) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9595}}
Apr 14 01:56:06 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:06 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:06 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:06 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:06 user nova-compute[71498]: DEBUG nova.compute.manager [req-a89f8243-0c02-4eab-9325-777c41fa5d69 req-ab1ac2a0-2095-4f04-b2b0-efc3bccf6fef service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Received event network-vif-unplugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:56:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a89f8243-0c02-4eab-9325-777c41fa5d69 req-ab1ac2a0-2095-4f04-b2b0-efc3bccf6fef service nova] Acquiring lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:56:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a89f8243-0c02-4eab-9325-777c41fa5d69 req-ab1ac2a0-2095-4f04-b2b0-efc3bccf6fef service nova] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:56:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a89f8243-0c02-4eab-9325-777c41fa5d69 req-ab1ac2a0-2095-4f04-b2b0-efc3bccf6fef service nova] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:56:06 user nova-compute[71498]: DEBUG nova.compute.manager [req-a89f8243-0c02-4eab-9325-777c41fa5d69 req-ab1ac2a0-2095-4f04-b2b0-efc3bccf6fef service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] No waiting events found dispatching network-vif-unplugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:56:06 user nova-compute[71498]: WARNING nova.compute.manager [req-a89f8243-0c02-4eab-9325-777c41fa5d69 req-ab1ac2a0-2095-4f04-b2b0-efc3bccf6fef service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Received unexpected event network-vif-unplugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 for instance with vm_state resized and task_state resize_reverting.
Apr 14 01:56:07 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Instance destroyed successfully.
Apr 14 01:56:07 user nova-compute[71498]: DEBUG nova.objects.instance [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lazy-loading 'resources' on Instance uuid 73cc8ede-babd-4281-bf1d-c5a3f8bad440 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T01:45:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-889087873',display_name='tempest-ServerActionsTestJSON-server-311342760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-889087873',id=20,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7iIvlhM+wCditCRaonOriLx8WWyehY8kYxTUZ36Z1Q4VGm2JnuefQ18D+1ncnGXJXgbpg/EWHmDPRQFx9TQ2PBQ5aNgSGRUcq/Ovi+zGjOYQDNVYkQyEvsulSNtijWoQ==',key_name='tempest-keypair-165395776',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:54:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ed4ed4ab2fd4c14b3e2afe343fd7256',ramdisk_id='',reservation_id='r-1656hccc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2035821517',owner_user_name='tempest-ServerActionsTestJSON-2035821517-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:54:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78ccd1a1ec1b486981d850881734fe02',uuid=73cc8ede-babd-4281-bf1d-c5a3f8bad440,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converting VIF {"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:d1:94,bridge_name='br-int',has_traffic_filtering=True,id=84d281bf-164e-48f3-a3ee-ca796d9a48e7,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d281bf-16') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG os_vif [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:d1:94,bridge_name='br-int',has_traffic_filtering=True,id=84d281bf-164e-48f3-a3ee-ca796d9a48e7,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d281bf-16') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84d281bf-16, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:07 user nova-compute[71498]: INFO os_vif [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:d1:94,bridge_name='br-int',has_traffic_filtering=True,id=84d281bf-164e-48f3-a3ee-ca796d9a48e7,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d281bf-16')
Apr 14 01:56:07 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vNWpMtFL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:56:07 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:56:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a205c7f-b1f8-4346-80e7-c66b9ac30909]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:56:07 user nova-compute[71498]: No targets found.
Apr 14 01:56:07 user nova-compute[71498]: iSNS:
Apr 14 01:56:07 user nova-compute[71498]: No targets found.
Apr 14 01:56:07 user nova-compute[71498]: STATIC:
Apr 14 01:56:07 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f
Apr 14 01:56:07 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:56:07 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:56:07 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860
Apr 14 01:56:07 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:56:07 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:56:07 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae
Apr 14 01:56:07 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:56:07 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:56:07 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415
Apr 14 01:56:07 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:56:07 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:56:07 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10
Apr 14 01:56:07 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:56:07 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:56:07 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22
Apr 14 01:56:07 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:56:07 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:56:07 user nova-compute[71498]: FIRMWARE:
Apr 14 01:56:07 user nova-compute[71498]: No targets found.
Apr 14 01:56:07 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:56:07 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:56:07 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9480be0-872c-4735-bedc-0730c8f0df28]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[888cdb0f-60c2-4a5c-a12a-ce400f39ffed]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:56:07 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:56:07 user nova-compute[71498]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:56:07 user nova-compute[71498]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:56:07 user nova-compute[71498]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)
Apr 14 01:56:07 user nova-compute[71498]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:56:07 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:56:07 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:56:07 user nova-compute[71498]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:56:07 user nova-compute[71498]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:56:07 user nova-compute[71498]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)
Apr 14 01:56:07 user nova-compute[71498]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:56:07 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51f44f4160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f'): ({'sdg'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Removing single pathed devices sdg {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0319fce9-8ec9-461a-9bfb-022c18d612b3]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4050d67-debb-4eb0-8b20-b2a3c576b689]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Flushing IO for device /dev/sdg {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[78933338-04bf-4d08-9798-db12168f90c8]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.041s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46345d0-c503-42e6-8b06-61a03f2a66e9]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] SCSI volumes sdg have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[95eb2973-a8af-4023-8912-ee9383142426]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cbc4bb-3e91-40a1-b77a-6c776db7c899]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f, portal: 172.16.0.220,3260]
Apr 14 01:56:07 user nova-compute[71498]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f, portal: 172.16.0.220,3260] successful.
Apr 14 01:56:07 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9cb98c-24fd-4a39-9126-61d035b8eb63]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] <== disconnect_volume: return (346ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:56:07 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:56:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:56:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:56:08 user nova-compute[71498]: DEBUG nova.objects.instance [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lazy-loading 'migration_context' on Instance uuid 73cc8ede-babd-4281-bf1d-c5a3f8bad440 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:56:08 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:56:08 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:56:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.426s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:56:09 user nova-compute[71498]: INFO nova.compute.manager [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Swapping old allocation on dict_keys(['5d1e0d73-5203-4561-b5ca-56519acd0ff4']) held by migration fffda8d2-cec8-4809-a410-4bc405a28d5c for instance
Apr 14 01:56:09 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Overwriting current allocation {'allocations': {'5d1e0d73-5203-4561-b5ca-56519acd0ff4': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 37}}, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'consumer_generation': 1} on consumer 73cc8ede-babd-4281-bf1d-c5a3f8bad440 {{(pid=71498) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Apr 14 01:56:09 user nova-compute[71498]: DEBUG nova.compute.manager [req-82b154c5-c38a-4cee-bbef-0b243ae64912 req-6e8d2354-fcf8-4d0c-8105-999d006d58f2 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Received event network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:56:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-82b154c5-c38a-4cee-bbef-0b243ae64912 req-6e8d2354-fcf8-4d0c-8105-999d006d58f2 service nova] Acquiring lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:56:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-82b154c5-c38a-4cee-bbef-0b243ae64912 req-6e8d2354-fcf8-4d0c-8105-999d006d58f2 service nova] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:56:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-82b154c5-c38a-4cee-bbef-0b243ae64912 req-6e8d2354-fcf8-4d0c-8105-999d006d58f2 service nova] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:56:09 user nova-compute[71498]: DEBUG nova.compute.manager [req-82b154c5-c38a-4cee-bbef-0b243ae64912 req-6e8d2354-fcf8-4d0c-8105-999d006d58f2 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] No waiting events found dispatching network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:56:09 user nova-compute[71498]: WARNING nova.compute.manager [req-82b154c5-c38a-4cee-bbef-0b243ae64912 req-6e8d2354-fcf8-4d0c-8105-999d006d58f2 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Received unexpected event network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 for instance with vm_state resized and task_state resize_reverting.
Apr 14 01:56:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "refresh_cache-73cc8ede-babd-4281-bf1d-c5a3f8bad440" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:56:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquired lock "refresh_cache-73cc8ede-babd-4281-bf1d-c5a3f8bad440" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:56:09 user nova-compute[71498]: DEBUG nova.network.neutron [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:56:09 user nova-compute[71498]: DEBUG nova.network.neutron [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Updating instance_info_cache with network_info: [{"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:56:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Releasing lock "refresh_cache-73cc8ede-babd-4281-bf1d-c5a3f8bad440" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:56:09 user nova-compute[71498]: DEBUG os_brick.utils [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:56:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e0fb27-9829-4f85-b40d-d3c792174681]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9156f0b-aab9-4446-b365-9b1a5a108c99]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe5186f-baf1-41f4-982f-92be09c18db4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be4fe7a-15a3-4d1d-a9ba-2d0464a68503]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:56:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:56:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:56:09 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:56:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[515b851a-7808-4571-9316-a47a90cdb8bd]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:56:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:56:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:56:09 user nova-compute[71498]: DEBUG os_brick.utils [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:56:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Starting finish_revert_migration {{(pid=71498) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11792}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Start _get_guest_xml network_info=[{"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '4e685821-d1fd-466b-9876-ae4ade85b28d', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vNWpMtFL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '73cc8ede-babd-4281-bf1d-c5a3f8bad440', 'attached_at': '2023-04-14T01:56:14.000000', 'detached_at': '', 'volume_id': '55aa3df5-b363-4e8f-ac2e-f46bea9ca67f', 'serial': '55aa3df5-b363-4e8f-ac2e-f46bea9ca67f'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:56:14 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:56:14 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:56:14 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG nova.objects.instance [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lazy-loading 'vcpu_model' on Instance uuid 73cc8ede-babd-4281-bf1d-c5a3f8bad440 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vNWpMtFL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:56:14 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:56:14 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:56:14 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:56:14 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:56:14 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:56:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc5eb21-85ee-47de-8c6f-2251e85d21fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:56:14 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e44124-f9be-4dad-a573-edd1f2b593b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f] added
Apr 14 01:56:14 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[864c8173-8951-4868-98ed-b774dc0d36dd]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e12c77d-5a4a-4a6b-9030-fa84a1c73eed]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vNWpMtFL {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vNWpMtFL" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a302977-95cb-46dd-ab2a-6b047602ac01]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vNWpMtFL'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89f66e4-b32c-4f47-88cf-5f5b4d4df0b7]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f61aae-b3bf-4f91-abed-8f63ab187d1f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:56:14 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:56:14 user nova-compute[71498]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:56:14 user nova-compute[71498]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)
Apr 14 01:56:14 user nova-compute[71498]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:56:14 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:56:14 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:56:14 user nova-compute[71498]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:56:14 user nova-compute[71498]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)
Apr 14 01:56:14 user nova-compute[71498]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:56:14 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[450dd9bf-ed5f-4ce2-8498-5d551b2861a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f, portal: 172.16.0.220,3260]
Apr 14 01:56:14 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f, portal: 172.16.0.220,3260] successful.
Apr 14 01:56:14 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac266c6-e004-49c3-ba2f-d4106cbfa106]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87b6188-fc46-4121-802b-e2955160785f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:56:14 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:56:14 user nova-compute[71498]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:56:14 user nova-compute[71498]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)
Apr 14 01:56:14 user nova-compute[71498]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:56:14 user nova-compute[71498]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:56:14 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:56:14 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:56:14 user nova-compute[71498]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:56:14 user nova-compute[71498]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)
Apr 14 01:56:14 user nova-compute[71498]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:56:14 user nova-compute[71498]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:56:14 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] HCTL ('38', '-', '-', 0) found on session 38 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[96203790-544b-42ab-8867-27bd22f2f67d]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:14 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Searching for a device in session 38 and hctl ['38', '*', '*', 0] yield: None {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:56:15 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Searching for a device in session 38 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:56:15 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vNWpMtFL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:56:15 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:56:15 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23133633338326462', 'path': '/dev/sdg'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:56:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133633338326462', 'path': '/dev/sdg'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:56:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T01:45:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-889087873',display_name='tempest-ServerActionsTestJSON-server-311342760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-889087873',id=20,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7iIvlhM+wCditCRaonOriLx8WWyehY8kYxTUZ36Z1Q4VGm2JnuefQ18D+1ncnGXJXgbpg/EWHmDPRQFx9TQ2PBQ5aNgSGRUcq/Ovi+zGjOYQDNVYkQyEvsulSNtijWoQ==',key_name='tempest-keypair-165395776',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:54:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2ed4ed4ab2fd4c14b3e2afe343fd7256',ramdisk_id='',reservation_id='r-1656hccc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2035821517',owner_user_name='tempest-ServerActionsTestJSON-2035821517-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:56:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78ccd1a1ec1b486981d850881734fe02',uuid=73cc8ede-babd-4281-bf1d-c5a3f8bad440,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:56:15 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converting VIF {"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:56:15 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d1:94,bridge_name='br-int',has_traffic_filtering=True,id=84d281bf-164e-48f3-a3ee-ca796d9a48e7,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d281bf-16') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:56:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:56:15 user nova-compute[71498]:   <uuid>73cc8ede-babd-4281-bf1d-c5a3f8bad440</uuid>
Apr 14 01:56:15 user nova-compute[71498]:   <name>instance-00000014</name>
Apr 14 01:56:15 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:56:15 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:56:15 user nova-compute[71498]:   <metadata>
Apr 14 01:56:15 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:56:15 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:56:15 user nova-compute[71498]:       <nova:name>tempest-ServerActionsTestJSON-server-311342760</nova:name>
Apr 14 01:56:15 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:56:14</nova:creationTime>
Apr 14 01:56:15 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:56:15 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:56:15 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:56:15 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:56:15 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:56:15 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:56:15 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:56:15 user nova-compute[71498]:       <nova:owner>
Apr 14 01:56:15 user nova-compute[71498]:         <nova:user uuid="78ccd1a1ec1b486981d850881734fe02">tempest-ServerActionsTestJSON-2035821517-project-member</nova:user>
Apr 14 01:56:15 user nova-compute[71498]:         <nova:project uuid="2ed4ed4ab2fd4c14b3e2afe343fd7256">tempest-ServerActionsTestJSON-2035821517</nova:project>
Apr 14 01:56:15 user nova-compute[71498]:       </nova:owner>
Apr 14 01:56:15 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:56:15 user nova-compute[71498]:       <nova:ports>
Apr 14 01:56:15 user nova-compute[71498]:         <nova:port uuid="84d281bf-164e-48f3-a3ee-ca796d9a48e7">
Apr 14 01:56:15 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 01:56:15 user nova-compute[71498]:         </nova:port>
Apr 14 01:56:15 user nova-compute[71498]:       </nova:ports>
Apr 14 01:56:15 user nova-compute[71498]:     </nova:instance>
Apr 14 01:56:15 user nova-compute[71498]:   </metadata>
Apr 14 01:56:15 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:56:15 user nova-compute[71498]:     <system>
Apr 14 01:56:15 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:56:15 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:56:15 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:56:15 user nova-compute[71498]:       <entry name="serial">73cc8ede-babd-4281-bf1d-c5a3f8bad440</entry>
Apr 14 01:56:15 user nova-compute[71498]:       <entry name="uuid">73cc8ede-babd-4281-bf1d-c5a3f8bad440</entry>
Apr 14 01:56:15 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:56:15 user nova-compute[71498]:     </system>
Apr 14 01:56:15 user nova-compute[71498]:   </sysinfo>
Apr 14 01:56:15 user nova-compute[71498]:   <os>
Apr 14 01:56:15 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:56:15 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:56:15 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:56:15 user nova-compute[71498]:   </os>
Apr 14 01:56:15 user nova-compute[71498]:   <features>
Apr 14 01:56:15 user nova-compute[71498]:     <acpi/>
Apr 14 01:56:15 user nova-compute[71498]:     <apic/>
Apr 14 01:56:15 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:56:15 user nova-compute[71498]:   </features>
Apr 14 01:56:15 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:56:15 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:56:15 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:56:15 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:56:15 user nova-compute[71498]:   </clock>
Apr 14 01:56:15 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:56:15 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:56:15 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:56:15 user nova-compute[71498]:   </cpu>
Apr 14 01:56:15 user nova-compute[71498]:   <devices>
Apr 14 01:56:15 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:56:15 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:56:15 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk"/>
Apr 14 01:56:15 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:56:15 user nova-compute[71498]:     </disk>
Apr 14 01:56:15 user nova-compute[71498]:     <disk type="block" device="disk">
Apr 14 01:56:15 user nova-compute[71498]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:56:15 user nova-compute[71498]:       <source dev="/dev/sdg"/>
Apr 14 01:56:15 user nova-compute[71498]:       <target dev="vdb" bus="virtio"/>
Apr 14 01:56:15 user nova-compute[71498]:       <serial>55aa3df5-b363-4e8f-ac2e-f46bea9ca67f</serial>
Apr 14 01:56:15 user nova-compute[71498]:     </disk>
Apr 14 01:56:15 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:56:15 user nova-compute[71498]:       <mac address="fa:16:3e:b2:d1:94"/>
Apr 14 01:56:15 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:56:15 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:56:15 user nova-compute[71498]:       <target dev="tap84d281bf-16"/>
Apr 14 01:56:15 user nova-compute[71498]:     </interface>
Apr 14 01:56:15 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:56:15 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/console.log" append="off"/>
Apr 14 01:56:15 user nova-compute[71498]:     </serial>
Apr 14 01:56:15 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:56:15 user nova-compute[71498]:     <video>
Apr 14 01:56:15 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:56:15 user nova-compute[71498]:     </video>
Apr 14 01:56:15 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:56:15 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:56:15 user nova-compute[71498]:     </rng>
Apr 14 01:56:15 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:56:15 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:56:15 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:56:15 user nova-compute[71498]:     </memballoon>
Apr 14 01:56:15 user nova-compute[71498]:   </devices>
Apr 14 01:56:15 user nova-compute[71498]: </domain>
Apr 14 01:56:15 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:56:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T01:45:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-889087873',display_name='tempest-ServerActionsTestJSON-server-311342760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-889087873',id=20,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7iIvlhM+wCditCRaonOriLx8WWyehY8kYxTUZ36Z1Q4VGm2JnuefQ18D+1ncnGXJXgbpg/EWHmDPRQFx9TQ2PBQ5aNgSGRUcq/Ovi+zGjOYQDNVYkQyEvsulSNtijWoQ==',key_name='tempest-keypair-165395776',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:54:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2ed4ed4ab2fd4c14b3e2afe343fd7256',ramdisk_id='',reservation_id='r-1656hccc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2035821517',owner_user_name='tempest-ServerActionsTestJSON-2035821517-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:56:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78ccd1a1ec1b486981d850881734fe02',uuid=73cc8ede-babd-4281-bf1d-c5a3f8bad440,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:56:16 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converting VIF {"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:56:16 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d1:94,bridge_name='br-int',has_traffic_filtering=True,id=84d281bf-164e-48f3-a3ee-ca796d9a48e7,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d281bf-16') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:56:16 user nova-compute[71498]: DEBUG os_vif [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d1:94,bridge_name='br-int',has_traffic_filtering=True,id=84d281bf-164e-48f3-a3ee-ca796d9a48e7,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d281bf-16') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:56:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:56:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:56:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84d281bf-16, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:56:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap84d281bf-16, col_values=(('external_ids', {'iface-id': '84d281bf-164e-48f3-a3ee-ca796d9a48e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:d1:94', 'vm-uuid': '73cc8ede-babd-4281-bf1d-c5a3f8bad440'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:56:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:56:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:16 user nova-compute[71498]: INFO os_vif [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d1:94,bridge_name='br-int',has_traffic_filtering=True,id=84d281bf-164e-48f3-a3ee-ca796d9a48e7,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d281bf-16')
Apr 14 01:56:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "85b399dc-62df-480d-8561-5d9d1ab75c52" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:56:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:56:16 user nova-compute[71498]: INFO nova.compute.manager [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Detaching volume 4d2a082d-59f8-4081-9ace-fc3ae1219b10
Apr 14 01:56:16 user nova-compute[71498]: INFO nova.virt.block_device [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Attempting to driver detach volume 4d2a082d-59f8-4081-9ace-fc3ae1219b10 from mountpoint /dev/vdb
Apr 14 01:56:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Attempting to detach device vdb from instance 85b399dc-62df-480d-8561-5d9d1ab75c52 from the persistent domain config. {{(pid=71498) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 01:56:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 01:56:16 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:56:16 user nova-compute[71498]:   <source dev="/dev/sdd"/>
Apr 14 01:56:16 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:56:16 user nova-compute[71498]:   <serial>4d2a082d-59f8-4081-9ace-fc3ae1219b10</serial>
Apr 14 01:56:16 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 01:56:16 user nova-compute[71498]: </disk>
Apr 14 01:56:16 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:56:16 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Successfully detached device vdb from instance 85b399dc-62df-480d-8561-5d9d1ab75c52 from the persistent domain config.
Apr 14 01:56:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 85b399dc-62df-480d-8561-5d9d1ab75c52 from the live domain config. {{(pid=71498) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 01:56:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 01:56:16 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:56:16 user nova-compute[71498]:   <source dev="/dev/sdd"/>
Apr 14 01:56:16 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:56:16 user nova-compute[71498]:   <serial>4d2a082d-59f8-4081-9ace-fc3ae1219b10</serial>
Apr 14 01:56:16 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 01:56:16 user nova-compute[71498]: </disk>
Apr 14 01:56:16 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Received event <DeviceRemovedEvent: 1681437377.274554, 85b399dc-62df-480d-8561-5d9d1ab75c52 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71498) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 85b399dc-62df-480d-8561-5d9d1ab75c52 {{(pid=71498) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 01:56:17 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Successfully detached device vdb from instance 85b399dc-62df-480d-8561-5d9d1ab75c52 from the live domain config.
Apr 14 01:56:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'txGYAkUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:56:17 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:56:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32cb9f5-75a9-4304-8bc8-a6b91a05c942]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:56:17 user nova-compute[71498]: No targets found.
Apr 14 01:56:17 user nova-compute[71498]: iSNS:
Apr 14 01:56:17 user nova-compute[71498]: No targets found.
Apr 14 01:56:17 user nova-compute[71498]: STATIC:
Apr 14 01:56:17 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f
Apr 14 01:56:17 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:56:17 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:56:17 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860
Apr 14 01:56:17 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:56:17 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:56:17 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae
Apr 14 01:56:17 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:56:17 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:56:17 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415
Apr 14 01:56:17 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:56:17 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:56:17 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10
Apr 14 01:56:17 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:56:17 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:56:17 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22
Apr 14 01:56:17 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:56:17 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:56:17 user nova-compute[71498]: FIRMWARE:
Apr 14 01:56:17 user nova-compute[71498]: No targets found.
Apr 14 01:56:17 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:56:17 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:56:17 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca1703c-5415-4800-a83d-1d24a9c18726]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec56025-e37f-46e7-8f62-e807d4fa4c35]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:56:17 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:56:17 user nova-compute[71498]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:56:17 user nova-compute[71498]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)
Apr 14 01:56:17 user nova-compute[71498]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:56:17 user nova-compute[71498]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:56:17 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:56:17 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:56:17 user nova-compute[71498]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 (non-flash)
Apr 14 01:56:17 user nova-compute[71498]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)
Apr 14 01:56:17 user nova-compute[71498]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:56:17 user nova-compute[71498]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:56:17 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52014ed3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10'): ({'sdd'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Removing single pathed devices sdd {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[143a4ab3-8980-4a03-bab4-acb5cfef2757]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4097a4-3be5-4fa3-8335-7c9f76fafefd]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Flushing IO for device /dev/sdd {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab5fb5a-b4c8-4afd-8b5f-e01b45b0cfbb]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f73f06-6529-4f83-ac08-77fddf39be5d]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] SCSI volumes sdd have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e1d04f-0461-48be-a594-14cce321faff]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f452384-8d47-4210-ac06-321116734478]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10, portal: 172.16.0.220,3260]
Apr 14 01:56:17 user nova-compute[71498]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10, portal: 172.16.0.220,3260] successful.
Apr 14 01:56:17 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d2a082d-59f8-4081-9ace-fc3ae1219b10 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf027ba-5876-4da6-bc63-8d196c8f191d]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] <== disconnect_volume: return (390ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG nova.compute.manager [req-4cb1f4c6-c0b0-41de-b0a8-8c5b2ec1bec0 req-5d91e022-1533-4c20-99d8-51d0431c7d24 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Received event network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4cb1f4c6-c0b0-41de-b0a8-8c5b2ec1bec0 req-5d91e022-1533-4c20-99d8-51d0431c7d24 service nova] Acquiring lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4cb1f4c6-c0b0-41de-b0a8-8c5b2ec1bec0 req-5d91e022-1533-4c20-99d8-51d0431c7d24 service nova] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4cb1f4c6-c0b0-41de-b0a8-8c5b2ec1bec0 req-5d91e022-1533-4c20-99d8-51d0431c7d24 service nova] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:56:17 user nova-compute[71498]: DEBUG nova.compute.manager [req-4cb1f4c6-c0b0-41de-b0a8-8c5b2ec1bec0 req-5d91e022-1533-4c20-99d8-51d0431c7d24 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] No waiting events found dispatching network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:56:17 user nova-compute[71498]: WARNING nova.compute.manager [req-4cb1f4c6-c0b0-41de-b0a8-8c5b2ec1bec0 req-5d91e022-1533-4c20-99d8-51d0431c7d24 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Received unexpected event network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 for instance with vm_state resized and task_state resize_reverting.
Apr 14 01:56:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:18 user nova-compute[71498]: DEBUG nova.objects.instance [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'flavor' on Instance uuid 85b399dc-62df-480d-8561-5d9d1ab75c52 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:56:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-cd5ab555-57c2-488b-b09d-f4ba3fd86dbc tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.222s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:56:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dd1c77f0-7e10-4d1d-996f-1ead7581c605 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "85b399dc-62df-480d-8561-5d9d1ab75c52" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:56:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dd1c77f0-7e10-4d1d-996f-1ead7581c605 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:56:19 user nova-compute[71498]: DEBUG nova.compute.manager [None req-dd1c77f0-7e10-4d1d-996f-1ead7581c605 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:56:19 user nova-compute[71498]: DEBUG nova.compute.manager [None req-dd1c77f0-7e10-4d1d-996f-1ead7581c605 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71498) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 14 01:56:19 user nova-compute[71498]: DEBUG nova.objects.instance [None req-dd1c77f0-7e10-4d1d-996f-1ead7581c605 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'flavor' on Instance uuid 85b399dc-62df-480d-8561-5d9d1ab75c52 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:56:19 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Removed pending event for 73cc8ede-babd-4281-bf1d-c5a3f8bad440 due to event {{(pid=71498) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 01:56:19 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437379.938763, 73cc8ede-babd-4281-bf1d-c5a3f8bad440 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:56:19 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] VM Resumed (Lifecycle Event)
Apr 14 01:56:19 user nova-compute[71498]: DEBUG nova.compute.manager [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:56:19 user nova-compute[71498]: DEBUG nova.compute.manager [req-1f68904f-f2a4-4438-a430-c15e336617ce req-3949451c-f884-4960-b6ca-af3578711abe service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Received event network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:56:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1f68904f-f2a4-4438-a430-c15e336617ce req-3949451c-f884-4960-b6ca-af3578711abe service nova] Acquiring lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:56:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1f68904f-f2a4-4438-a430-c15e336617ce req-3949451c-f884-4960-b6ca-af3578711abe service nova] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:56:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1f68904f-f2a4-4438-a430-c15e336617ce req-3949451c-f884-4960-b6ca-af3578711abe service nova] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:56:19 user nova-compute[71498]: DEBUG nova.compute.manager [req-1f68904f-f2a4-4438-a430-c15e336617ce req-3949451c-f884-4960-b6ca-af3578711abe service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] No waiting events found dispatching network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:56:19 user nova-compute[71498]: WARNING nova.compute.manager [req-1f68904f-f2a4-4438-a430-c15e336617ce req-3949451c-f884-4960-b6ca-af3578711abe service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Received unexpected event network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 for instance with vm_state resized and task_state resize_reverting.
Apr 14 01:56:19 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Instance running successfully.
Apr 14 01:56:19 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] finish_revert_migration finished successfully. {{(pid=71498) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11836}}
Apr 14 01:56:19 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:56:19 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:19 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:19 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:56:20 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 14 01:56:20 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437379.9389331, 73cc8ede-babd-4281-bf1d-c5a3f8bad440 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:56:20 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] VM Started (Lifecycle Event)
Apr 14 01:56:20 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:20 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:56:20 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:20 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:56:20 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 14 01:56:20 user nova-compute[71498]: INFO nova.compute.manager [None req-c7e237e9-db24-4808-af02-9a2c7b2f9b3a tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Updating instance to original state: 'active'
Apr 14 01:56:20 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Instance destroyed successfully.
Apr 14 01:56:20 user nova-compute[71498]: DEBUG nova.compute.manager [None req-dd1c77f0-7e10-4d1d-996f-1ead7581c605 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:56:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dd1c77f0-7e10-4d1d-996f-1ead7581c605 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.871s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:56:21 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:22 user nova-compute[71498]: DEBUG nova.compute.manager [req-5ff8e1c4-6fde-4983-9879-9f045e3e6fba req-ef0f422c-35ee-4a44-b7e2-503c4b5763db service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Received event network-vif-unplugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:56:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5ff8e1c4-6fde-4983-9879-9f045e3e6fba req-ef0f422c-35ee-4a44-b7e2-503c4b5763db service nova] Acquiring lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:56:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5ff8e1c4-6fde-4983-9879-9f045e3e6fba req-ef0f422c-35ee-4a44-b7e2-503c4b5763db service nova] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:56:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5ff8e1c4-6fde-4983-9879-9f045e3e6fba req-ef0f422c-35ee-4a44-b7e2-503c4b5763db service nova] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:56:22 user nova-compute[71498]: DEBUG nova.compute.manager [req-5ff8e1c4-6fde-4983-9879-9f045e3e6fba req-ef0f422c-35ee-4a44-b7e2-503c4b5763db service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] No waiting events found dispatching network-vif-unplugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:56:22 user nova-compute[71498]: WARNING nova.compute.manager [req-5ff8e1c4-6fde-4983-9879-9f045e3e6fba req-ef0f422c-35ee-4a44-b7e2-503c4b5763db service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Received unexpected event network-vif-unplugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf for instance with vm_state stopped and task_state None.
Apr 14 01:56:22 user nova-compute[71498]: DEBUG nova.compute.manager [req-5ff8e1c4-6fde-4983-9879-9f045e3e6fba req-ef0f422c-35ee-4a44-b7e2-503c4b5763db service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Received event network-vif-plugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:56:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5ff8e1c4-6fde-4983-9879-9f045e3e6fba req-ef0f422c-35ee-4a44-b7e2-503c4b5763db service nova] Acquiring lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:56:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5ff8e1c4-6fde-4983-9879-9f045e3e6fba req-ef0f422c-35ee-4a44-b7e2-503c4b5763db service nova] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:56:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5ff8e1c4-6fde-4983-9879-9f045e3e6fba req-ef0f422c-35ee-4a44-b7e2-503c4b5763db service nova] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:56:22 user nova-compute[71498]: DEBUG nova.compute.manager [req-5ff8e1c4-6fde-4983-9879-9f045e3e6fba req-ef0f422c-35ee-4a44-b7e2-503c4b5763db service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] No waiting events found dispatching network-vif-plugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:56:22 user nova-compute[71498]: WARNING nova.compute.manager [req-5ff8e1c4-6fde-4983-9879-9f045e3e6fba req-ef0f422c-35ee-4a44-b7e2-503c4b5763db service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Received unexpected event network-vif-plugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf for instance with vm_state stopped and task_state None.
Apr 14 01:56:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:26 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:26 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "9152f969-e279-4182-aa0a-8534458acbca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:56:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "9152f969-e279-4182-aa0a-8534458acbca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:56:29 user nova-compute[71498]: DEBUG nova.compute.manager [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 01:56:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:56:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:56:29 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:56:29 user nova-compute[71498]: INFO nova.compute.claims [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Claim successful on node user
Apr 14 01:56:29 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:56:29 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:56:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:56:29 user nova-compute[71498]: DEBUG nova.compute.manager [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 01:56:29 user nova-compute[71498]: DEBUG nova.compute.manager [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 01:56:29 user nova-compute[71498]: DEBUG nova.network.neutron [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:56:29 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 01:56:29 user nova-compute[71498]: DEBUG nova.compute.manager [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 01:56:29 user nova-compute[71498]: DEBUG nova.policy [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2a5da3e233c74524a953ce0d4e074077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d05ca328d64f2aa1d19550475edba3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:56:29 user nova-compute[71498]: DEBUG nova.compute.manager [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 01:56:29 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:56:29 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Creating image(s)
Apr 14 01:56:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "/opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:56:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "/opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:56:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "/opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:56:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.135s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:56:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:56:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.142s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk 1073741824" returned: 0 in 0.047s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:56:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.144s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:30 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 01:56:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:30 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Cannot resize image /opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 01:56:30 user nova-compute[71498]: DEBUG nova.objects.instance [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lazy-loading 'migration_context' on Instance uuid 9152f969-e279-4182-aa0a-8534458acbca {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:56:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 01:56:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Ensure instance console log exists: /opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:56:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:56:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:56:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:56:30 user nova-compute[71498]: DEBUG nova.network.neutron [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Successfully created port: cb0b5d20-30a0-4636-82c8-0c7637d66465 {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG nova.network.neutron [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Successfully updated port: cb0b5d20-30a0-4636-82c8-0c7637d66465 {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "refresh_cache-9152f969-e279-4182-aa0a-8534458acbca" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquired lock "refresh_cache-9152f969-e279-4182-aa0a-8534458acbca" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG nova.network.neutron [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG nova.network.neutron [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG nova.compute.manager [req-c5b49fbc-bc16-4acf-95f1-25661d6efe5f req-36083b4d-b89f-4969-a443-c706fd0620e8 service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Received event network-changed-cb0b5d20-30a0-4636-82c8-0c7637d66465 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG nova.compute.manager [req-c5b49fbc-bc16-4acf-95f1-25661d6efe5f req-36083b4d-b89f-4969-a443-c706fd0620e8 service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Refreshing instance network info cache due to event network-changed-cb0b5d20-30a0-4636-82c8-0c7637d66465. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c5b49fbc-bc16-4acf-95f1-25661d6efe5f req-36083b4d-b89f-4969-a443-c706fd0620e8 service nova] Acquiring lock "refresh_cache-9152f969-e279-4182-aa0a-8534458acbca" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG nova.network.neutron [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Updating instance_info_cache with network_info: [{"id": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "address": "fa:16:3e:66:5e:af", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0b5d20-30", "ovs_interfaceid": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Releasing lock "refresh_cache-9152f969-e279-4182-aa0a-8534458acbca" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG nova.compute.manager [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Instance network_info: |[{"id": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "address": "fa:16:3e:66:5e:af", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0b5d20-30", "ovs_interfaceid": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c5b49fbc-bc16-4acf-95f1-25661d6efe5f req-36083b4d-b89f-4969-a443-c706fd0620e8 service nova] Acquired lock "refresh_cache-9152f969-e279-4182-aa0a-8534458acbca" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG nova.network.neutron [req-c5b49fbc-bc16-4acf-95f1-25661d6efe5f req-36083b4d-b89f-4969-a443-c706fd0620e8 service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Refreshing network info cache for port cb0b5d20-30a0-4636-82c8-0c7637d66465 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Start _get_guest_xml network_info=[{"id": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "address": "fa:16:3e:66:5e:af", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0b5d20-30", "ovs_interfaceid": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:56:31 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:56:31 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:56:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:56:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1283417408',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1283417408',id=32,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIopxcmtvU7zv42zkIa4Oz1jEP4DNyyAzFY9+vRTU16RetxI5ZPVi+sg5XXxOyu9RTbP8T9qWJjnsbfeLu0C5tcKuN56PwVxP5mYkQsJP0kN6YvWI8oVts6rIeLy1vmUYw==',key_name='tempest-keypair-1419165173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6d05ca328d64f2aa1d19550475edba3',ramdisk_id='',reservation_id='r-wryfyacz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2042065984',owner_user_name='tempest-AttachVolumeShelveTestJSON-2042065984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:56:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a5da3e233c74524a953ce0d4e074077',uuid=9152f969-e279-4182-aa0a-8534458acbca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "address": "fa:16:3e:66:5e:af", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0b5d20-30", "ovs_interfaceid": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Converting VIF {"id": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "address": "fa:16:3e:66:5e:af", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0b5d20-30", "ovs_interfaceid": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:5e:af,bridge_name='br-int',has_traffic_filtering=True,id=cb0b5d20-30a0-4636-82c8-0c7637d66465,network=Network(a7b6c0bc-d2de-4431-821b-c2917738e556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb0b5d20-30') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG nova.objects.instance [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lazy-loading 'pci_devices' on Instance uuid 9152f969-e279-4182-aa0a-8534458acbca {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:56:31 user nova-compute[71498]:   <uuid>9152f969-e279-4182-aa0a-8534458acbca</uuid>
Apr 14 01:56:31 user nova-compute[71498]:   <name>instance-00000020</name>
Apr 14 01:56:31 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:56:31 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:56:31 user nova-compute[71498]:   <metadata>
Apr 14 01:56:31 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:56:31 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:56:31 user nova-compute[71498]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1283417408</nova:name>
Apr 14 01:56:31 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:56:31</nova:creationTime>
Apr 14 01:56:31 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:56:31 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:56:31 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:56:31 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:56:31 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:56:31 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:56:31 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:56:31 user nova-compute[71498]:       <nova:owner>
Apr 14 01:56:31 user nova-compute[71498]:         <nova:user uuid="2a5da3e233c74524a953ce0d4e074077">tempest-AttachVolumeShelveTestJSON-2042065984-project-member</nova:user>
Apr 14 01:56:31 user nova-compute[71498]:         <nova:project uuid="a6d05ca328d64f2aa1d19550475edba3">tempest-AttachVolumeShelveTestJSON-2042065984</nova:project>
Apr 14 01:56:31 user nova-compute[71498]:       </nova:owner>
Apr 14 01:56:31 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:56:31 user nova-compute[71498]:       <nova:ports>
Apr 14 01:56:31 user nova-compute[71498]:         <nova:port uuid="cb0b5d20-30a0-4636-82c8-0c7637d66465">
Apr 14 01:56:31 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 01:56:31 user nova-compute[71498]:         </nova:port>
Apr 14 01:56:31 user nova-compute[71498]:       </nova:ports>
Apr 14 01:56:31 user nova-compute[71498]:     </nova:instance>
Apr 14 01:56:31 user nova-compute[71498]:   </metadata>
Apr 14 01:56:31 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:56:31 user nova-compute[71498]:     <system>
Apr 14 01:56:31 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:56:31 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:56:31 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:56:31 user nova-compute[71498]:       <entry name="serial">9152f969-e279-4182-aa0a-8534458acbca</entry>
Apr 14 01:56:31 user nova-compute[71498]:       <entry name="uuid">9152f969-e279-4182-aa0a-8534458acbca</entry>
Apr 14 01:56:31 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:56:31 user nova-compute[71498]:     </system>
Apr 14 01:56:31 user nova-compute[71498]:   </sysinfo>
Apr 14 01:56:31 user nova-compute[71498]:   <os>
Apr 14 01:56:31 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:56:31 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:56:31 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:56:31 user nova-compute[71498]:   </os>
Apr 14 01:56:31 user nova-compute[71498]:   <features>
Apr 14 01:56:31 user nova-compute[71498]:     <acpi/>
Apr 14 01:56:31 user nova-compute[71498]:     <apic/>
Apr 14 01:56:31 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:56:31 user nova-compute[71498]:   </features>
Apr 14 01:56:31 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:56:31 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:56:31 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:56:31 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:56:31 user nova-compute[71498]:   </clock>
Apr 14 01:56:31 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:56:31 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:56:31 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:56:31 user nova-compute[71498]:   </cpu>
Apr 14 01:56:31 user nova-compute[71498]:   <devices>
Apr 14 01:56:31 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:56:31 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:56:31 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk"/>
Apr 14 01:56:31 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:56:31 user nova-compute[71498]:     </disk>
Apr 14 01:56:31 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:56:31 user nova-compute[71498]:       <mac address="fa:16:3e:66:5e:af"/>
Apr 14 01:56:31 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:56:31 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:56:31 user nova-compute[71498]:       <target dev="tapcb0b5d20-30"/>
Apr 14 01:56:31 user nova-compute[71498]:     </interface>
Apr 14 01:56:31 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:56:31 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/console.log" append="off"/>
Apr 14 01:56:31 user nova-compute[71498]:     </serial>
Apr 14 01:56:31 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:56:31 user nova-compute[71498]:     <video>
Apr 14 01:56:31 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:56:31 user nova-compute[71498]:     </video>
Apr 14 01:56:31 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:56:31 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:56:31 user nova-compute[71498]:     </rng>
Apr 14 01:56:31 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:56:31 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:56:31 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:56:31 user nova-compute[71498]:     </memballoon>
Apr 14 01:56:31 user nova-compute[71498]:   </devices>
Apr 14 01:56:31 user nova-compute[71498]: </domain>
Apr 14 01:56:31 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:56:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1283417408',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1283417408',id=32,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIopxcmtvU7zv42zkIa4Oz1jEP4DNyyAzFY9+vRTU16RetxI5ZPVi+sg5XXxOyu9RTbP8T9qWJjnsbfeLu0C5tcKuN56PwVxP5mYkQsJP0kN6YvWI8oVts6rIeLy1vmUYw==',key_name='tempest-keypair-1419165173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6d05ca328d64f2aa1d19550475edba3',ramdisk_id='',reservation_id='r-wryfyacz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2042065984',owner_user_name='tempest-AttachVolumeShelveTestJSON-2042065984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:56:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a5da3e233c74524a953ce0d4e074077',uuid=9152f969-e279-4182-aa0a-8534458acbca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "address": "fa:16:3e:66:5e:af", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0b5d20-30", "ovs_interfaceid": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Converting VIF {"id": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "address": "fa:16:3e:66:5e:af", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0b5d20-30", "ovs_interfaceid": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:5e:af,bridge_name='br-int',has_traffic_filtering=True,id=cb0b5d20-30a0-4636-82c8-0c7637d66465,network=Network(a7b6c0bc-d2de-4431-821b-c2917738e556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb0b5d20-30') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG os_vif [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:5e:af,bridge_name='br-int',has_traffic_filtering=True,id=cb0b5d20-30a0-4636-82c8-0c7637d66465,network=Network(a7b6c0bc-d2de-4431-821b-c2917738e556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb0b5d20-30') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb0b5d20-30, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcb0b5d20-30, col_values=(('external_ids', {'iface-id': 'cb0b5d20-30a0-4636-82c8-0c7637d66465', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:5e:af', 'vm-uuid': '9152f969-e279-4182-aa0a-8534458acbca'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:31 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:56:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:32 user nova-compute[71498]: INFO os_vif [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:5e:af,bridge_name='br-int',has_traffic_filtering=True,id=cb0b5d20-30a0-4636-82c8-0c7637d66465,network=Network(a7b6c0bc-d2de-4431-821b-c2917738e556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb0b5d20-30')
Apr 14 01:56:32 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:56:32 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] No VIF found with MAC fa:16:3e:66:5e:af, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:56:32 user nova-compute[71498]: DEBUG nova.network.neutron [req-c5b49fbc-bc16-4acf-95f1-25661d6efe5f req-36083b4d-b89f-4969-a443-c706fd0620e8 service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Updated VIF entry in instance network info cache for port cb0b5d20-30a0-4636-82c8-0c7637d66465. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:56:32 user nova-compute[71498]: DEBUG nova.network.neutron [req-c5b49fbc-bc16-4acf-95f1-25661d6efe5f req-36083b4d-b89f-4969-a443-c706fd0620e8 service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Updating instance_info_cache with network_info: [{"id": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "address": "fa:16:3e:66:5e:af", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0b5d20-30", "ovs_interfaceid": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:56:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c5b49fbc-bc16-4acf-95f1-25661d6efe5f req-36083b4d-b89f-4969-a443-c706fd0620e8 service nova] Releasing lock "refresh_cache-9152f969-e279-4182-aa0a-8534458acbca" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:56:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:34 user nova-compute[71498]: DEBUG nova.compute.manager [req-526e657a-a71c-47c6-bf67-99f532223a47 req-1922748a-ab60-42c5-b9a8-202d11252663 service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Received event network-vif-plugged-cb0b5d20-30a0-4636-82c8-0c7637d66465 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:56:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-526e657a-a71c-47c6-bf67-99f532223a47 req-1922748a-ab60-42c5-b9a8-202d11252663 service nova] Acquiring lock "9152f969-e279-4182-aa0a-8534458acbca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:56:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-526e657a-a71c-47c6-bf67-99f532223a47 req-1922748a-ab60-42c5-b9a8-202d11252663 service nova] Lock "9152f969-e279-4182-aa0a-8534458acbca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:56:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-526e657a-a71c-47c6-bf67-99f532223a47 req-1922748a-ab60-42c5-b9a8-202d11252663 service nova] Lock "9152f969-e279-4182-aa0a-8534458acbca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:56:34 user nova-compute[71498]: DEBUG nova.compute.manager [req-526e657a-a71c-47c6-bf67-99f532223a47 req-1922748a-ab60-42c5-b9a8-202d11252663 service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] No waiting events found dispatching network-vif-plugged-cb0b5d20-30a0-4636-82c8-0c7637d66465 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:56:34 user nova-compute[71498]: WARNING nova.compute.manager [req-526e657a-a71c-47c6-bf67-99f532223a47 req-1922748a-ab60-42c5-b9a8-202d11252663 service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Received unexpected event network-vif-plugged-cb0b5d20-30a0-4636-82c8-0c7637d66465 for instance with vm_state building and task_state spawning.
Apr 14 01:56:34 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:34 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:34 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:34 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:34 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:35 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681437380.6920125, 85b399dc-62df-480d-8561-5d9d1ab75c52 => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:56:35 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] VM Stopped (Lifecycle Event)
Apr 14 01:56:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-5ce2e16c-1bf3-4791-8f13-d1d34a479a3f None None] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:56:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-5ce2e16c-1bf3-4791-8f13-d1d34a479a3f None None] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:56:36 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437396.009021, 9152f969-e279-4182-aa0a-8534458acbca => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:56:36 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9152f969-e279-4182-aa0a-8534458acbca] VM Resumed (Lifecycle Event)
Apr 14 01:56:36 user nova-compute[71498]: DEBUG nova.compute.manager [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:56:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:56:36 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Instance spawned successfully.
Apr 14 01:56:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:56:36 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:56:36 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:56:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:56:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:56:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:56:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:56:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:56:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:56:36 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9152f969-e279-4182-aa0a-8534458acbca] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:56:36 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437396.009195, 9152f969-e279-4182-aa0a-8534458acbca => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:56:36 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9152f969-e279-4182-aa0a-8534458acbca] VM Started (Lifecycle Event)
Apr 14 01:56:36 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:56:36 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:56:36 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9152f969-e279-4182-aa0a-8534458acbca] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:56:36 user nova-compute[71498]: INFO nova.compute.manager [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Took 6.37 seconds to spawn the instance on the hypervisor.
Apr 14 01:56:36 user nova-compute[71498]: DEBUG nova.compute.manager [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:56:36 user nova-compute[71498]: DEBUG nova.compute.manager [req-ad80985b-43b8-4221-99dd-4abc4cc8a94d req-ec889415-98ab-46af-95b9-27cd76448cea service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Received event network-vif-plugged-cb0b5d20-30a0-4636-82c8-0c7637d66465 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:56:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ad80985b-43b8-4221-99dd-4abc4cc8a94d req-ec889415-98ab-46af-95b9-27cd76448cea service nova] Acquiring lock "9152f969-e279-4182-aa0a-8534458acbca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:56:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ad80985b-43b8-4221-99dd-4abc4cc8a94d req-ec889415-98ab-46af-95b9-27cd76448cea service nova] Lock "9152f969-e279-4182-aa0a-8534458acbca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:56:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ad80985b-43b8-4221-99dd-4abc4cc8a94d req-ec889415-98ab-46af-95b9-27cd76448cea service nova] Lock "9152f969-e279-4182-aa0a-8534458acbca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:56:36 user nova-compute[71498]: DEBUG nova.compute.manager [req-ad80985b-43b8-4221-99dd-4abc4cc8a94d req-ec889415-98ab-46af-95b9-27cd76448cea service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] No waiting events found dispatching network-vif-plugged-cb0b5d20-30a0-4636-82c8-0c7637d66465 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:56:36 user nova-compute[71498]: WARNING nova.compute.manager [req-ad80985b-43b8-4221-99dd-4abc4cc8a94d req-ec889415-98ab-46af-95b9-27cd76448cea service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Received unexpected event network-vif-plugged-cb0b5d20-30a0-4636-82c8-0c7637d66465 for instance with vm_state building and task_state spawning.
Apr 14 01:56:36 user nova-compute[71498]: INFO nova.compute.manager [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Took 7.14 seconds to build instance.
Apr 14 01:56:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-11159c71-f4e6-406a-9001-53a0441e7f1b tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "9152f969-e279-4182-aa0a-8534458acbca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.238s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:56:36 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:56:36 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Cleaning up deleted instances with incomplete migration  {{(pid=71498) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 01:56:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:38 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:56:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:56:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:56:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:56:38 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 01:56:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:56:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:56:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:38 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:40 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:56:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:40 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk (vdb) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:56:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:41 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:41 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:56:41 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:56:41 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:56:41 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:56:41 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:56:41 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=7959MB free_disk=26.125240325927734GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 01:56:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:56:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:56:41 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:56:41 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:56:41 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance a19a1c08-5454-481b-bb5a-70c39ead9afc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:56:41 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance fa29c144-0ff9-4efb-a574-f521d18f08fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:56:41 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance ae82789e-1bed-419b-a580-68ff7ed03ef2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:56:41 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 85b399dc-62df-480d-8561-5d9d1ab75c52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:56:41 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:56:41 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:56:41 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:56:41 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 618f5f0d-3594-41dd-9d8f-0c7bea255a3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:56:41 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 9152f969-e279-4182-aa0a-8534458acbca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:56:41 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 01:56:41 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 01:56:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:42 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:56:42 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:56:42 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 01:56:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.486s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:56:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:44 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:56:44 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 01:56:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-fa29c144-0ff9-4efb-a574-f521d18f08fa" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:56:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-fa29c144-0ff9-4efb-a574-f521d18f08fa" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:56:44 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 01:56:44 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Updating instance_info_cache with network_info: [{"id": "6a841349-4e6e-40e1-90f0-998d46c60567", "address": "fa:16:3e:49:5d:eb", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a841349-4e", "ovs_interfaceid": "6a841349-4e6e-40e1-90f0-998d46c60567", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:56:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-fa29c144-0ff9-4efb-a574-f521d18f08fa" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:56:44 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 01:56:44 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:56:44 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:56:44 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:56:44 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:56:46 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:56:46 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:56:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:48 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:56:48 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:56:48 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:56:48 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 01:56:49 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:56:49 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Cleaning up deleted instances {{(pid=71498) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 01:56:49 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] There are 0 instances to clean {{(pid=71498) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 01:56:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:56:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._sync_power_states {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Triggering sync for uuid 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 {{(pid=71498) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Triggering sync for uuid 73fd9bc1-af0f-41e9-adea-d73323b4a76c {{(pid=71498) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Triggering sync for uuid a19a1c08-5454-481b-bb5a-70c39ead9afc {{(pid=71498) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Triggering sync for uuid fa29c144-0ff9-4efb-a574-f521d18f08fa {{(pid=71498) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Triggering sync for uuid 73cc8ede-babd-4281-bf1d-c5a3f8bad440 {{(pid=71498) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Triggering sync for uuid ae82789e-1bed-419b-a580-68ff7ed03ef2 {{(pid=71498) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Triggering sync for uuid 85b399dc-62df-480d-8561-5d9d1ab75c52 {{(pid=71498) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Triggering sync for uuid 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed {{(pid=71498) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Triggering sync for uuid 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 {{(pid=71498) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Triggering sync for uuid 618f5f0d-3594-41dd-9d8f-0c7bea255a3f {{(pid=71498) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Triggering sync for uuid 9152f969-e279-4182-aa0a-8534458acbca {{(pid=71498) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "8e042a42-7cc2-4d72-b7ed-2b80339f2c85" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "8e042a42-7cc2-4d72-b7ed-2b80339f2c85" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "a19a1c08-5454-481b-bb5a-70c39ead9afc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "a19a1c08-5454-481b-bb5a-70c39ead9afc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "fa29c144-0ff9-4efb-a574-f521d18f08fa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "fa29c144-0ff9-4efb-a574-f521d18f08fa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "ae82789e-1bed-419b-a580-68ff7ed03ef2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "ae82789e-1bed-419b-a580-68ff7ed03ef2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "85b399dc-62df-480d-8561-5d9d1ab75c52" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "618f5f0d-3594-41dd-9d8f-0c7bea255a3f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "618f5f0d-3594-41dd-9d8f-0c7bea255a3f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "9152f969-e279-4182-aa0a-8534458acbca" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "9152f969-e279-4182-aa0a-8534458acbca" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "8e042a42-7cc2-4d72-b7ed-2b80339f2c85" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "a19a1c08-5454-481b-bb5a-70c39ead9afc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "fa29c144-0ff9-4efb-a574-f521d18f08fa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "ae82789e-1bed-419b-a580-68ff7ed03ef2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "618f5f0d-3594-41dd-9d8f-0c7bea255a3f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:57:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "9152f969-e279-4182-aa0a-8534458acbca" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:57:29 user nova-compute[71498]: INFO nova.compute.manager [None req-28c3399e-05e1-4c3e-afa3-1d90f77d3926 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Unrescuing
Apr 14 01:57:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-28c3399e-05e1-4c3e-afa3-1d90f77d3926 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "refresh_cache-92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:57:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-28c3399e-05e1-4c3e-afa3-1d90f77d3926 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquired lock "refresh_cache-92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:57:29 user nova-compute[71498]: DEBUG nova.network.neutron [None req-28c3399e-05e1-4c3e-afa3-1d90f77d3926 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:57:29 user nova-compute[71498]: DEBUG nova.network.neutron [None req-28c3399e-05e1-4c3e-afa3-1d90f77d3926 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Updating instance_info_cache with network_info: [{"id": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "address": "fa:16:3e:84:32:3a", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ad9be5-f1", "ovs_interfaceid": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:57:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-28c3399e-05e1-4c3e-afa3-1d90f77d3926 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Releasing lock "refresh_cache-92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:57:29 user nova-compute[71498]: DEBUG nova.objects.instance [None req-28c3399e-05e1-4c3e-afa3-1d90f77d3926 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'flavor' on Instance uuid 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:57:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:30 user nova-compute[71498]: DEBUG nova.compute.manager [req-21da7e72-1587-44c1-84d4-32eedd831326 req-95372bd7-ee0a-49a1-b483-a47ea7c11974 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received event network-vif-unplugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:57:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-21da7e72-1587-44c1-84d4-32eedd831326 req-95372bd7-ee0a-49a1-b483-a47ea7c11974 service nova] Acquiring lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:57:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-21da7e72-1587-44c1-84d4-32eedd831326 req-95372bd7-ee0a-49a1-b483-a47ea7c11974 service nova] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:57:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-21da7e72-1587-44c1-84d4-32eedd831326 req-95372bd7-ee0a-49a1-b483-a47ea7c11974 service nova] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:57:30 user nova-compute[71498]: DEBUG nova.compute.manager [req-21da7e72-1587-44c1-84d4-32eedd831326 req-95372bd7-ee0a-49a1-b483-a47ea7c11974 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] No waiting events found dispatching network-vif-unplugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:57:30 user nova-compute[71498]: WARNING nova.compute.manager [req-21da7e72-1587-44c1-84d4-32eedd831326 req-95372bd7-ee0a-49a1-b483-a47ea7c11974 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received unexpected event network-vif-unplugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance with vm_state rescued and task_state unrescuing.
Apr 14 01:57:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:30 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Instance destroyed successfully.
Apr 14 01:57:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:31 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:31 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:31 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:31 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:31 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:31 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:32 user nova-compute[71498]: DEBUG nova.compute.manager [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received event network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:57:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] Acquiring lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:57:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:57:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:57:32 user nova-compute[71498]: DEBUG nova.compute.manager [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] No waiting events found dispatching network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:57:32 user nova-compute[71498]: WARNING nova.compute.manager [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received unexpected event network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance with vm_state rescued and task_state unrescuing.
Apr 14 01:57:32 user nova-compute[71498]: DEBUG nova.compute.manager [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received event network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:57:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] Acquiring lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:57:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:57:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:57:32 user nova-compute[71498]: DEBUG nova.compute.manager [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] No waiting events found dispatching network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:57:32 user nova-compute[71498]: WARNING nova.compute.manager [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received unexpected event network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance with vm_state rescued and task_state unrescuing.
Apr 14 01:57:32 user nova-compute[71498]: DEBUG nova.compute.manager [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received event network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:57:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] Acquiring lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:57:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:57:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:57:32 user nova-compute[71498]: DEBUG nova.compute.manager [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] No waiting events found dispatching network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:57:32 user nova-compute[71498]: WARNING nova.compute.manager [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received unexpected event network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance with vm_state rescued and task_state unrescuing.
Apr 14 01:57:32 user nova-compute[71498]: DEBUG nova.compute.manager [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received event network-vif-unplugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:57:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] Acquiring lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:57:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:57:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:57:32 user nova-compute[71498]: DEBUG nova.compute.manager [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] No waiting events found dispatching network-vif-unplugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:57:32 user nova-compute[71498]: WARNING nova.compute.manager [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received unexpected event network-vif-unplugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance with vm_state rescued and task_state unrescuing.
Apr 14 01:57:32 user nova-compute[71498]: DEBUG nova.compute.manager [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received event network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:57:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] Acquiring lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:57:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:57:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:57:32 user nova-compute[71498]: DEBUG nova.compute.manager [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] No waiting events found dispatching network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:57:32 user nova-compute[71498]: WARNING nova.compute.manager [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received unexpected event network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance with vm_state rescued and task_state unrescuing.
Apr 14 01:57:32 user nova-compute[71498]: DEBUG nova.compute.manager [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received event network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:57:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] Acquiring lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:57:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:57:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:57:32 user nova-compute[71498]: DEBUG nova.compute.manager [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] No waiting events found dispatching network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:57:32 user nova-compute[71498]: WARNING nova.compute.manager [req-886d0d04-1286-45c7-ae6f-13d2aa25eacc req-300f32f4-db50-4c89-8c58-3854884cb208 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received unexpected event network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance with vm_state rescued and task_state unrescuing.
Apr 14 01:57:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:34 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Removed pending event for 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 due to event {{(pid=71498) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 01:57:34 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437454.0835943, 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:57:34 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] VM Resumed (Lifecycle Event)
Apr 14 01:57:34 user nova-compute[71498]: DEBUG nova.compute.manager [None req-28c3399e-05e1-4c3e-afa3-1d90f77d3926 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:57:34 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:57:34 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:57:34 user nova-compute[71498]: DEBUG nova.compute.manager [req-0abb0fd3-eaf0-4861-85e2-8eb9db92c13c req-e920b8b0-5139-4c00-99c3-0103fcc67e14 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received event network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:57:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0abb0fd3-eaf0-4861-85e2-8eb9db92c13c req-e920b8b0-5139-4c00-99c3-0103fcc67e14 service nova] Acquiring lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:57:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0abb0fd3-eaf0-4861-85e2-8eb9db92c13c req-e920b8b0-5139-4c00-99c3-0103fcc67e14 service nova] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:57:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0abb0fd3-eaf0-4861-85e2-8eb9db92c13c req-e920b8b0-5139-4c00-99c3-0103fcc67e14 service nova] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:57:34 user nova-compute[71498]: DEBUG nova.compute.manager [req-0abb0fd3-eaf0-4861-85e2-8eb9db92c13c req-e920b8b0-5139-4c00-99c3-0103fcc67e14 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] No waiting events found dispatching network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:57:34 user nova-compute[71498]: WARNING nova.compute.manager [req-0abb0fd3-eaf0-4861-85e2-8eb9db92c13c req-e920b8b0-5139-4c00-99c3-0103fcc67e14 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received unexpected event network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance with vm_state rescued and task_state unrescuing.
Apr 14 01:57:34 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 01:57:34 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437454.0854666, 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:57:34 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] VM Started (Lifecycle Event)
Apr 14 01:57:34 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:57:34 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:57:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:38 user nova-compute[71498]: DEBUG nova.compute.manager [req-57b5934b-681c-4fb2-be2b-14817d0adab5 req-1adc226f-e9f6-49be-8128-8e57744b1e9e service nova] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Received event network-changed-7eb65ace-3427-4415-a8ef-26064243471e {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:57:38 user nova-compute[71498]: DEBUG nova.compute.manager [req-57b5934b-681c-4fb2-be2b-14817d0adab5 req-1adc226f-e9f6-49be-8128-8e57744b1e9e service nova] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Refreshing instance network info cache due to event network-changed-7eb65ace-3427-4415-a8ef-26064243471e. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:57:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-57b5934b-681c-4fb2-be2b-14817d0adab5 req-1adc226f-e9f6-49be-8128-8e57744b1e9e service nova] Acquiring lock "refresh_cache-618f5f0d-3594-41dd-9d8f-0c7bea255a3f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:57:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-57b5934b-681c-4fb2-be2b-14817d0adab5 req-1adc226f-e9f6-49be-8128-8e57744b1e9e service nova] Acquired lock "refresh_cache-618f5f0d-3594-41dd-9d8f-0c7bea255a3f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:57:38 user nova-compute[71498]: DEBUG nova.network.neutron [req-57b5934b-681c-4fb2-be2b-14817d0adab5 req-1adc226f-e9f6-49be-8128-8e57744b1e9e service nova] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Refreshing network info cache for port 7eb65ace-3427-4415-a8ef-26064243471e {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:57:39 user nova-compute[71498]: DEBUG nova.network.neutron [req-57b5934b-681c-4fb2-be2b-14817d0adab5 req-1adc226f-e9f6-49be-8128-8e57744b1e9e service nova] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Updated VIF entry in instance network info cache for port 7eb65ace-3427-4415-a8ef-26064243471e. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:57:39 user nova-compute[71498]: DEBUG nova.network.neutron [req-57b5934b-681c-4fb2-be2b-14817d0adab5 req-1adc226f-e9f6-49be-8128-8e57744b1e9e service nova] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Updating instance_info_cache with network_info: [{"id": "7eb65ace-3427-4415-a8ef-26064243471e", "address": "fa:16:3e:0f:86:e9", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb65ace-34", "ovs_interfaceid": "7eb65ace-3427-4415-a8ef-26064243471e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:57:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-57b5934b-681c-4fb2-be2b-14817d0adab5 req-1adc226f-e9f6-49be-8128-8e57744b1e9e service nova] Releasing lock "refresh_cache-618f5f0d-3594-41dd-9d8f-0c7bea255a3f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:57:40 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:57:40 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 01:57:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-73cc8ede-babd-4281-bf1d-c5a3f8bad440" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:57:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-73cc8ede-babd-4281-bf1d-c5a3f8bad440" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:57:40 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 01:57:40 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Updating instance_info_cache with network_info: [{"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:57:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-73cc8ede-babd-4281-bf1d-c5a3f8bad440" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:57:40 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 01:57:40 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:57:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:57:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:57:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:57:40 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 01:57:41 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:57:41 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:57:41 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:41 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:41 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:41 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:41 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:41 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:41 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:41 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:41 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:41 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:41 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:43 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:57:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:43 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:57:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:43 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:57:44 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:57:44 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:57:44 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=7886MB free_disk=26.122844696044922GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 01:57:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:57:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:57:44 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:57:44 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:57:44 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance a19a1c08-5454-481b-bb5a-70c39ead9afc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:57:44 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance fa29c144-0ff9-4efb-a574-f521d18f08fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:57:44 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance ae82789e-1bed-419b-a580-68ff7ed03ef2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:57:44 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 85b399dc-62df-480d-8561-5d9d1ab75c52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:57:44 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:57:44 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:57:44 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:57:44 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 618f5f0d-3594-41dd-9d8f-0c7bea255a3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:57:44 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 9152f969-e279-4182-aa0a-8534458acbca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:57:44 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 01:57:44 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 01:57:44 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Refreshing inventories for resource provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 01:57:44 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Updating ProviderTree inventory for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 01:57:44 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Updating inventory in ProviderTree for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 01:57:44 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Refreshing aggregate associations for resource provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4, aggregates: None {{(pid=71498) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 01:57:44 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Refreshing trait associations for resource provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,HW_CPU_X86_SSE2 {{(pid=71498) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 01:57:45 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:57:45 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:57:45 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 01:57:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.765s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:57:45 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:57:45 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:57:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "81666244-a2a7-4ace-969d-a3a3d0128329" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:57:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "81666244-a2a7-4ace-969d-a3a3d0128329" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:57:46 user nova-compute[71498]: DEBUG nova.compute.manager [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 01:57:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:57:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:57:46 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:57:46 user nova-compute[71498]: INFO nova.compute.claims [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Claim successful on node user
Apr 14 01:57:46 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:57:46 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:57:46 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:57:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:57:46 user nova-compute[71498]: DEBUG nova.compute.manager [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 01:57:46 user nova-compute[71498]: DEBUG nova.compute.manager [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 01:57:46 user nova-compute[71498]: DEBUG nova.network.neutron [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:57:46 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 01:57:46 user nova-compute[71498]: DEBUG nova.compute.manager [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 01:57:46 user nova-compute[71498]: INFO nova.virt.block_device [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Booting with volume fd2a58c4-4fc8-4aca-8654-ae325aec4e25 at /dev/vda
Apr 14 01:57:46 user nova-compute[71498]: DEBUG nova.policy [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50e3354ac1a84c59a7dee8e1ae6e771a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1f4117a4adb4aa3b42951cf1fc84237', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:57:46 user nova-compute[71498]: DEBUG os_brick.utils [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:57:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:46 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0edabb-e3c1-4e21-82f1-0e63481b86a0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:57:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:46 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a64e7d6-5273-4863-9366-c0c160d15de3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:57:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:46 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c4e238-d17a-4d03-b5f5-abec8ac9197c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:57:46 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0001501-8295-4799-b32b-81ee07f07e43]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:57:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:57:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:57:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:57:46 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:57:46 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97a0a71-f890-41d2-a5e2-c4b5f06481af]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:57:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:57:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:57:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:57:46 user nova-compute[71498]: DEBUG os_brick.utils [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:57:46 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Updating existing volume attachment record: 28ad901e-b24f-4192-9b1e-3c64401882cd {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:57:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:47 user nova-compute[71498]: DEBUG nova.network.neutron [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Successfully created port: d66c282d-74db-42ba-96f3-faf43ebc6d98 {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:57:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:57:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:57:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:57:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:57:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:57:47 user nova-compute[71498]: INFO nova.compute.manager [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Terminating instance
Apr 14 01:57:47 user nova-compute[71498]: DEBUG nova.compute.manager [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG nova.network.neutron [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Successfully updated port: d66c282d-74db-42ba-96f3-faf43ebc6d98 {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "refresh_cache-81666244-a2a7-4ace-969d-a3a3d0128329" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquired lock "refresh_cache-81666244-a2a7-4ace-969d-a3a3d0128329" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG nova.network.neutron [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG nova.compute.manager [req-07173f92-9701-4b9d-bc52-b921f279a711 req-cba4b4fa-8439-47a9-a44b-b08446ea984e service nova] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Received event network-changed-d66c282d-74db-42ba-96f3-faf43ebc6d98 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG nova.compute.manager [req-07173f92-9701-4b9d-bc52-b921f279a711 req-cba4b4fa-8439-47a9-a44b-b08446ea984e service nova] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Refreshing instance network info cache due to event network-changed-d66c282d-74db-42ba-96f3-faf43ebc6d98. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-07173f92-9701-4b9d-bc52-b921f279a711 req-cba4b4fa-8439-47a9-a44b-b08446ea984e service nova] Acquiring lock "refresh_cache-81666244-a2a7-4ace-969d-a3a3d0128329" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG nova.network.neutron [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:57:48 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Instance destroyed successfully.
Apr 14 01:57:48 user nova-compute[71498]: DEBUG nova.objects.instance [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lazy-loading 'resources' on Instance uuid 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:52:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-831752770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-831752770',id=28,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:54:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='219c39c8299e46368012a947fdfbe5fd',ramdisk_id='',reservation_id='r-h4xgnsfu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-85797606',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:56:02Z,user_data=None,user_id='7ed01a83531f4c6bb18a4593284baf05',uuid=7ff438f4-54e1-44b9-bb5a-1b42d48a37ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6568fde8-2639-4cee-8527-e3ca028f42fd", "address": "fa:16:3e:69:f8:89", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6568fde8-26", "ovs_interfaceid": "6568fde8-2639-4cee-8527-e3ca028f42fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Converting VIF {"id": "6568fde8-2639-4cee-8527-e3ca028f42fd", "address": "fa:16:3e:69:f8:89", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6568fde8-26", "ovs_interfaceid": "6568fde8-2639-4cee-8527-e3ca028f42fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:f8:89,bridge_name='br-int',has_traffic_filtering=True,id=6568fde8-2639-4cee-8527-e3ca028f42fd,network=Network(365cbeec-3756-4258-a135-04112bdda4b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6568fde8-26') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG os_vif [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:f8:89,bridge_name='br-int',has_traffic_filtering=True,id=6568fde8-2639-4cee-8527-e3ca028f42fd,network=Network(365cbeec-3756-4258-a135-04112bdda4b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6568fde8-26') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6568fde8-26, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:48 user nova-compute[71498]: INFO os_vif [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:f8:89,bridge_name='br-int',has_traffic_filtering=True,id=6568fde8-2639-4cee-8527-e3ca028f42fd,network=Network(365cbeec-3756-4258-a135-04112bdda4b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6568fde8-26')
Apr 14 01:57:48 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AUTEzbSm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:57:48 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:57:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecdcc63-805e-499e-a106-9eb710e5e656]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:57:48 user nova-compute[71498]: No targets found.
Apr 14 01:57:48 user nova-compute[71498]: iSNS:
Apr 14 01:57:48 user nova-compute[71498]: No targets found.
Apr 14 01:57:48 user nova-compute[71498]: STATIC:
Apr 14 01:57:48 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f
Apr 14 01:57:48 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:57:48 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:57:48 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860
Apr 14 01:57:48 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:57:48 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:57:48 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae
Apr 14 01:57:48 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:57:48 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:57:48 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415
Apr 14 01:57:48 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:57:48 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:57:48 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22
Apr 14 01:57:48 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:57:48 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:57:48 user nova-compute[71498]: FIRMWARE:
Apr 14 01:57:48 user nova-compute[71498]: No targets found.
Apr 14 01:57:48 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:57:48 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:57:48 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ff5c89-f53d-4d56-9a9e-80a657082bdb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4eb685-7ddc-4bb2-83e6-4c8f04e0ea48]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:57:48 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:57:48 user nova-compute[71498]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)
Apr 14 01:57:48 user nova-compute[71498]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:57:48 user nova-compute[71498]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:57:48 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:57:48 user nova-compute[71498]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae (non-flash)
Apr 14 01:57:48 user nova-compute[71498]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)
Apr 14 01:57:48 user nova-compute[71498]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:57:48 user nova-compute[71498]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:57:48 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51e4239b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae'): ({'sdc'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Removing single pathed devices sdc {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d1c74b-5996-43e8-b071-e3bc0420c667]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cd3d66-9007-4b08-914d-85bcbe861f5e]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Flushing IO for device /dev/sdc {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba365bf-8580-4115-9ac7-eb334c0e0e6b]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5711b8c3-2a4f-4823-a549-201509921d2a]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] SCSI volumes sdc have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOb4af87ff-1fc43c9e17dad57c', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b4af87ff', '/dev/disk/by-id/scsi-23166633433633965') {{(pid=81721) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[38db1368-2b97-41be-a29c-379651100bd0]: (4, None) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:57:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:49 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a439849-fce6-468f-b317-2c77018607c4]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:57:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:57:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:49 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6732020d-8ad4-42e8-a657-0d3419777b6d]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:57:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae, portal: 172.16.0.220,3260]
Apr 14 01:57:49 user nova-compute[71498]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae, portal: 172.16.0.220,3260] successful.
Apr 14 01:57:49 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:57:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:49 user nova-compute[71498]: DEBUG nova.network.neutron [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Updating instance_info_cache with network_info: [{"id": "d66c282d-74db-42ba-96f3-faf43ebc6d98", "address": "fa:16:3e:8a:c6:83", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd66c282d-74", "ovs_interfaceid": "d66c282d-74db-42ba-96f3-faf43ebc6d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:57:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f2f2823-8b6e-49ae-ad4e-ed05a02421ae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:49 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54c9fc1-4bf7-48a4-a6b9-015b50c73986]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:57:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:57:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:57:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] <== disconnect_volume: return (345ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:57:49 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:57:49 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Deleting instance files /opt/stack/data/nova/instances/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed_del
Apr 14 01:57:49 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Deletion of /opt/stack/data/nova/instances/7ff438f4-54e1-44b9-bb5a-1b42d48a37ed_del complete
Apr 14 01:57:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Releasing lock "refresh_cache-81666244-a2a7-4ace-969d-a3a3d0128329" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:57:49 user nova-compute[71498]: DEBUG nova.compute.manager [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Instance network_info: |[{"id": "d66c282d-74db-42ba-96f3-faf43ebc6d98", "address": "fa:16:3e:8a:c6:83", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd66c282d-74", "ovs_interfaceid": "d66c282d-74db-42ba-96f3-faf43ebc6d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 01:57:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-07173f92-9701-4b9d-bc52-b921f279a711 req-cba4b4fa-8439-47a9-a44b-b08446ea984e service nova] Acquired lock "refresh_cache-81666244-a2a7-4ace-969d-a3a3d0128329" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:57:49 user nova-compute[71498]: DEBUG nova.network.neutron [req-07173f92-9701-4b9d-bc52-b921f279a711 req-cba4b4fa-8439-47a9-a44b-b08446ea984e service nova] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Refreshing network info cache for port d66c282d-74db-42ba-96f3-faf43ebc6d98 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:57:49 user nova-compute[71498]: INFO nova.compute.manager [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Took 1.24 seconds to destroy the instance on the hypervisor.
Apr 14 01:57:49 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 01:57:49 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 01:57:49 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 01:57:49 user nova-compute[71498]: DEBUG nova.network.neutron [req-07173f92-9701-4b9d-bc52-b921f279a711 req-cba4b4fa-8439-47a9-a44b-b08446ea984e service nova] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Updated VIF entry in instance network info cache for port d66c282d-74db-42ba-96f3-faf43ebc6d98. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:57:49 user nova-compute[71498]: DEBUG nova.network.neutron [req-07173f92-9701-4b9d-bc52-b921f279a711 req-cba4b4fa-8439-47a9-a44b-b08446ea984e service nova] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Updating instance_info_cache with network_info: [{"id": "d66c282d-74db-42ba-96f3-faf43ebc6d98", "address": "fa:16:3e:8a:c6:83", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd66c282d-74", "ovs_interfaceid": "d66c282d-74db-42ba-96f3-faf43ebc6d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:57:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-07173f92-9701-4b9d-bc52-b921f279a711 req-cba4b4fa-8439-47a9-a44b-b08446ea984e service nova] Releasing lock "refresh_cache-81666244-a2a7-4ace-969d-a3a3d0128329" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:57:49 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:57:49 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Took 0.47 seconds to deallocate network for instance.
Apr 14 01:57:49 user nova-compute[71498]: DEBUG nova.compute.manager [req-716f5d73-236f-48d0-b736-32667a5fd877 req-2fdb3c2d-6b44-428e-8687-22f8185f08b1 service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Received event network-vif-deleted-6568fde8-2639-4cee-8527-e3ca028f42fd {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:57:49 user nova-compute[71498]: INFO nova.compute.manager [req-716f5d73-236f-48d0-b736-32667a5fd877 req-2fdb3c2d-6b44-428e-8687-22f8185f08b1 service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Neutron deleted interface 6568fde8-2639-4cee-8527-e3ca028f42fd; detaching it from the instance and deleting it from the info cache
Apr 14 01:57:49 user nova-compute[71498]: DEBUG nova.network.neutron [req-716f5d73-236f-48d0-b736-32667a5fd877 req-2fdb3c2d-6b44-428e-8687-22f8185f08b1 service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:57:49 user nova-compute[71498]: DEBUG nova.compute.manager [req-716f5d73-236f-48d0-b736-32667a5fd877 req-2fdb3c2d-6b44-428e-8687-22f8185f08b1 service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Detach interface failed, port_id=6568fde8-2639-4cee-8527-e3ca028f42fd, reason: Instance 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed could not be found. {{(pid=71498) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 01:57:50 user nova-compute[71498]: DEBUG nova.compute.manager [req-c55bffb9-789e-4e0b-9d48-a3b9597c799b req-16cca6f1-ed40-4696-9746-43c522ddffa4 service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Received event network-vif-unplugged-6568fde8-2639-4cee-8527-e3ca028f42fd {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:57:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c55bffb9-789e-4e0b-9d48-a3b9597c799b req-16cca6f1-ed40-4696-9746-43c522ddffa4 service nova] Acquiring lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:57:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c55bffb9-789e-4e0b-9d48-a3b9597c799b req-16cca6f1-ed40-4696-9746-43c522ddffa4 service nova] Lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:57:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c55bffb9-789e-4e0b-9d48-a3b9597c799b req-16cca6f1-ed40-4696-9746-43c522ddffa4 service nova] Lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:57:50 user nova-compute[71498]: DEBUG nova.compute.manager [req-c55bffb9-789e-4e0b-9d48-a3b9597c799b req-16cca6f1-ed40-4696-9746-43c522ddffa4 service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] No waiting events found dispatching network-vif-unplugged-6568fde8-2639-4cee-8527-e3ca028f42fd {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:57:50 user nova-compute[71498]: DEBUG nova.compute.manager [req-c55bffb9-789e-4e0b-9d48-a3b9597c799b req-16cca6f1-ed40-4696-9746-43c522ddffa4 service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Received event network-vif-unplugged-6568fde8-2639-4cee-8527-e3ca028f42fd for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:57:50 user nova-compute[71498]: DEBUG nova.compute.manager [req-c55bffb9-789e-4e0b-9d48-a3b9597c799b req-16cca6f1-ed40-4696-9746-43c522ddffa4 service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Received event network-vif-plugged-6568fde8-2639-4cee-8527-e3ca028f42fd {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:57:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c55bffb9-789e-4e0b-9d48-a3b9597c799b req-16cca6f1-ed40-4696-9746-43c522ddffa4 service nova] Acquiring lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:57:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c55bffb9-789e-4e0b-9d48-a3b9597c799b req-16cca6f1-ed40-4696-9746-43c522ddffa4 service nova] Lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:57:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c55bffb9-789e-4e0b-9d48-a3b9597c799b req-16cca6f1-ed40-4696-9746-43c522ddffa4 service nova] Lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:57:50 user nova-compute[71498]: DEBUG nova.compute.manager [req-c55bffb9-789e-4e0b-9d48-a3b9597c799b req-16cca6f1-ed40-4696-9746-43c522ddffa4 service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] No waiting events found dispatching network-vif-plugged-6568fde8-2639-4cee-8527-e3ca028f42fd {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:57:50 user nova-compute[71498]: WARNING nova.compute.manager [req-c55bffb9-789e-4e0b-9d48-a3b9597c799b req-16cca6f1-ed40-4696-9746-43c522ddffa4 service nova] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Received unexpected event network-vif-plugged-6568fde8-2639-4cee-8527-e3ca028f42fd for instance with vm_state active and task_state deleting.
Apr 14 01:57:50 user nova-compute[71498]: INFO nova.compute.manager [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Took 0.79 seconds to detach 1 volumes for instance.
Apr 14 01:57:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:57:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:57:50 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:57:50 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:57:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:57:50 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Deleted allocations for instance 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-31b35708-3b76-4711-ac6e-43c76423d892 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "7ff438f4-54e1-44b9-bb5a-1b42d48a37ed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.061s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG nova.compute.manager [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:57:51 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Creating image(s)
Apr 14 01:57:51 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Did not create local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Ensure instance console log exists: /opt/stack/data/nova/instances/81666244-a2a7-4ace-969d-a3a3d0128329/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Start _get_guest_xml network_info=[{"id": "d66c282d-74db-42ba-96f3-faf43ebc6d98", "address": "fa:16:3e:8a:c6:83", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd66c282d-74", "ovs_interfaceid": "d66c282d-74db-42ba-96f3-faf43ebc6d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '28ad901e-b24f-4192-9b1e-3c64401882cd', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QkZUoSzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '81666244-a2a7-4ace-969d-a3a3d0128329', 'attached_at': '', 'detached_at': '', 'volume_id': 'fd2a58c4-4fc8-4aca-8654-ae325aec4e25', 'serial': 'fd2a58c4-4fc8-4aca-8654-ae325aec4e25'}, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:57:51 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:57:51 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:57:51 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QkZUoSzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:57:51 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:57:51 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:57:51 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:57:51 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:57:51 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb48bc45-4abc-409e-b16d-5730b0afa793]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:57:51 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[810950b3-ae99-450f-a684-6f5d0aeff54c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25] added
Apr 14 01:57:51 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77e7517-a10c-4921-ba14-a5ec6320400b]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4124cf2a-efa9-41e5-8bee-15dc6f9c7c86]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QkZUoSzc {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QkZUoSzc" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b662f8e2-1504-4cd7-a86c-6a2b94d79ca0]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QkZUoSzc'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57c5c5b-9bae-4515-a655-14091a757f0e]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b0f0ce-3435-4032-9102-1298f6bc710a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:57:51 user nova-compute[71498]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)
Apr 14 01:57:51 user nova-compute[71498]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:57:51 user nova-compute[71498]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:57:51 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:57:51 user nova-compute[71498]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)
Apr 14 01:57:51 user nova-compute[71498]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:57:51 user nova-compute[71498]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:57:51 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8bf0f3-e571-4aac-8aa0-fffa5e29ac80]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25, portal: 172.16.0.220,3260]
Apr 14 01:57:51 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25, portal: 172.16.0.220,3260] successful.
Apr 14 01:57:51 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead7ef5f-8d6a-4405-bcc0-4cfaeeb5c4b5]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1c2cce-0619-40e5-beec-fae1c95fc2d3]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:57:51 user nova-compute[71498]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)
Apr 14 01:57:51 user nova-compute[71498]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:57:51 user nova-compute[71498]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:57:51 user nova-compute[71498]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 (non-flash)
Apr 14 01:57:51 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:57:51 user nova-compute[71498]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)
Apr 14 01:57:51 user nova-compute[71498]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:57:51 user nova-compute[71498]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:57:51 user nova-compute[71498]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 (non-flash)
Apr 14 01:57:51 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[990b2ef0-d1d6-446f-926c-c47c4a9d49bf]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:57:51 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: None {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:57:52 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:57:52 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QkZUoSzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:57:52 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:57:52 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26535633465373361', 'path': '/dev/sdc'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:57:52 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535633465373361', 'path': '/dev/sdc'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:57:52 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:57:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-999984632',display_name='tempest-TestVolumeBootPattern-server-999984632',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-999984632',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcODdjkXb9vqfJo6mLTbOXnPLP2HdwXcPxYgRVEM78ApSpFWKxeZveFravQCk22JVH3n1PXZDKAyefoGYrsPczv6zWWLW2pkXjL46/zFdGhb8s3BmOyjVZHJdx/Y2ktUg==',key_name='tempest-TestVolumeBootPattern-824995165',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1f4117a4adb4aa3b42951cf1fc84237',ramdisk_id='',reservation_id='r-h73i3big',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-224521177',owner_user_name='tempest-TestVolumeBootPattern-224521177-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:57:47Z,user_data=None,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',uuid=81666244-a2a7-4ace-969d-a3a3d0128329,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d66c282d-74db-42ba-96f3-faf43ebc6d98", "address": "fa:16:3e:8a:c6:83", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd66c282d-74", "ovs_interfaceid": "d66c282d-74db-42ba-96f3-faf43ebc6d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:57:52 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converting VIF {"id": "d66c282d-74db-42ba-96f3-faf43ebc6d98", "address": "fa:16:3e:8a:c6:83", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd66c282d-74", "ovs_interfaceid": "d66c282d-74db-42ba-96f3-faf43ebc6d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:57:52 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:c6:83,bridge_name='br-int',has_traffic_filtering=True,id=d66c282d-74db-42ba-96f3-faf43ebc6d98,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd66c282d-74') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:57:52 user nova-compute[71498]: DEBUG nova.objects.instance [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lazy-loading 'pci_devices' on Instance uuid 81666244-a2a7-4ace-969d-a3a3d0128329 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:57:52 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:57:52 user nova-compute[71498]:   <uuid>81666244-a2a7-4ace-969d-a3a3d0128329</uuid>
Apr 14 01:57:52 user nova-compute[71498]:   <name>instance-00000021</name>
Apr 14 01:57:52 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:57:52 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:57:52 user nova-compute[71498]:   <metadata>
Apr 14 01:57:52 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:57:52 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:57:52 user nova-compute[71498]:       <nova:name>tempest-TestVolumeBootPattern-server-999984632</nova:name>
Apr 14 01:57:52 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:57:51</nova:creationTime>
Apr 14 01:57:52 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:57:52 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:57:52 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:57:52 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:57:52 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:57:52 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:57:52 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:57:52 user nova-compute[71498]:       <nova:owner>
Apr 14 01:57:52 user nova-compute[71498]:         <nova:user uuid="50e3354ac1a84c59a7dee8e1ae6e771a">tempest-TestVolumeBootPattern-224521177-project-member</nova:user>
Apr 14 01:57:52 user nova-compute[71498]:         <nova:project uuid="c1f4117a4adb4aa3b42951cf1fc84237">tempest-TestVolumeBootPattern-224521177</nova:project>
Apr 14 01:57:52 user nova-compute[71498]:       </nova:owner>
Apr 14 01:57:52 user nova-compute[71498]:       <nova:ports>
Apr 14 01:57:52 user nova-compute[71498]:         <nova:port uuid="d66c282d-74db-42ba-96f3-faf43ebc6d98">
Apr 14 01:57:52 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 01:57:52 user nova-compute[71498]:         </nova:port>
Apr 14 01:57:52 user nova-compute[71498]:       </nova:ports>
Apr 14 01:57:52 user nova-compute[71498]:     </nova:instance>
Apr 14 01:57:52 user nova-compute[71498]:   </metadata>
Apr 14 01:57:52 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:57:52 user nova-compute[71498]:     <system>
Apr 14 01:57:52 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:57:52 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:57:52 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:57:52 user nova-compute[71498]:       <entry name="serial">81666244-a2a7-4ace-969d-a3a3d0128329</entry>
Apr 14 01:57:52 user nova-compute[71498]:       <entry name="uuid">81666244-a2a7-4ace-969d-a3a3d0128329</entry>
Apr 14 01:57:52 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:57:52 user nova-compute[71498]:     </system>
Apr 14 01:57:52 user nova-compute[71498]:   </sysinfo>
Apr 14 01:57:52 user nova-compute[71498]:   <os>
Apr 14 01:57:52 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:57:52 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:57:52 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:57:52 user nova-compute[71498]:   </os>
Apr 14 01:57:52 user nova-compute[71498]:   <features>
Apr 14 01:57:52 user nova-compute[71498]:     <acpi/>
Apr 14 01:57:52 user nova-compute[71498]:     <apic/>
Apr 14 01:57:52 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:57:52 user nova-compute[71498]:   </features>
Apr 14 01:57:52 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:57:52 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:57:52 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:57:52 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:57:52 user nova-compute[71498]:   </clock>
Apr 14 01:57:52 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:57:52 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:57:52 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:57:52 user nova-compute[71498]:   </cpu>
Apr 14 01:57:52 user nova-compute[71498]:   <devices>
Apr 14 01:57:52 user nova-compute[71498]:     <disk type="block" device="disk">
Apr 14 01:57:52 user nova-compute[71498]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:57:52 user nova-compute[71498]:       <source dev="/dev/sdc"/>
Apr 14 01:57:52 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:57:52 user nova-compute[71498]:       <serial>fd2a58c4-4fc8-4aca-8654-ae325aec4e25</serial>
Apr 14 01:57:52 user nova-compute[71498]:     </disk>
Apr 14 01:57:52 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:57:52 user nova-compute[71498]:       <mac address="fa:16:3e:8a:c6:83"/>
Apr 14 01:57:52 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:57:52 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:57:52 user nova-compute[71498]:       <target dev="tapd66c282d-74"/>
Apr 14 01:57:52 user nova-compute[71498]:     </interface>
Apr 14 01:57:52 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:57:52 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/81666244-a2a7-4ace-969d-a3a3d0128329/console.log" append="off"/>
Apr 14 01:57:52 user nova-compute[71498]:     </serial>
Apr 14 01:57:52 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:57:52 user nova-compute[71498]:     <video>
Apr 14 01:57:52 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:57:52 user nova-compute[71498]:     </video>
Apr 14 01:57:52 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:57:52 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:57:52 user nova-compute[71498]:     </rng>
Apr 14 01:57:52 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:57:52 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:57:52 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:57:52 user nova-compute[71498]:     </memballoon>
Apr 14 01:57:52 user nova-compute[71498]:   </devices>
Apr 14 01:57:52 user nova-compute[71498]: </domain>
Apr 14 01:57:52 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:57:52 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:57:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-999984632',display_name='tempest-TestVolumeBootPattern-server-999984632',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-999984632',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcODdjkXb9vqfJo6mLTbOXnPLP2HdwXcPxYgRVEM78ApSpFWKxeZveFravQCk22JVH3n1PXZDKAyefoGYrsPczv6zWWLW2pkXjL46/zFdGhb8s3BmOyjVZHJdx/Y2ktUg==',key_name='tempest-TestVolumeBootPattern-824995165',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1f4117a4adb4aa3b42951cf1fc84237',ramdisk_id='',reservation_id='r-h73i3big',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-224521177',owner_user_name='tempest-TestVolumeBootPattern-224521177-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:57:47Z,user_data=None,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',uuid=81666244-a2a7-4ace-969d-a3a3d0128329,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d66c282d-74db-42ba-96f3-faf43ebc6d98", "address": "fa:16:3e:8a:c6:83", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd66c282d-74", "ovs_interfaceid": "d66c282d-74db-42ba-96f3-faf43ebc6d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:57:52 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converting VIF {"id": "d66c282d-74db-42ba-96f3-faf43ebc6d98", "address": "fa:16:3e:8a:c6:83", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd66c282d-74", "ovs_interfaceid": "d66c282d-74db-42ba-96f3-faf43ebc6d98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:57:52 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:c6:83,bridge_name='br-int',has_traffic_filtering=True,id=d66c282d-74db-42ba-96f3-faf43ebc6d98,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd66c282d-74') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:57:52 user nova-compute[71498]: DEBUG os_vif [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:c6:83,bridge_name='br-int',has_traffic_filtering=True,id=d66c282d-74db-42ba-96f3-faf43ebc6d98,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd66c282d-74') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:57:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:57:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:57:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd66c282d-74, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:57:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd66c282d-74, col_values=(('external_ids', {'iface-id': 'd66c282d-74db-42ba-96f3-faf43ebc6d98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:c6:83', 'vm-uuid': '81666244-a2a7-4ace-969d-a3a3d0128329'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:57:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:57:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:53 user nova-compute[71498]: INFO os_vif [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:c6:83,bridge_name='br-int',has_traffic_filtering=True,id=d66c282d-74db-42ba-96f3-faf43ebc6d98,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd66c282d-74')
Apr 14 01:57:53 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:57:53 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] No VIF found with MAC fa:16:3e:8a:c6:83, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:57:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:54 user nova-compute[71498]: DEBUG nova.compute.manager [req-d10cd856-24a4-4185-84bd-0cd882d6c6e9 req-14dc169b-c9a6-4aa6-82c9-2faf6fe8d39b service nova] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Received event network-vif-plugged-d66c282d-74db-42ba-96f3-faf43ebc6d98 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:57:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d10cd856-24a4-4185-84bd-0cd882d6c6e9 req-14dc169b-c9a6-4aa6-82c9-2faf6fe8d39b service nova] Acquiring lock "81666244-a2a7-4ace-969d-a3a3d0128329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:57:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d10cd856-24a4-4185-84bd-0cd882d6c6e9 req-14dc169b-c9a6-4aa6-82c9-2faf6fe8d39b service nova] Lock "81666244-a2a7-4ace-969d-a3a3d0128329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:57:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d10cd856-24a4-4185-84bd-0cd882d6c6e9 req-14dc169b-c9a6-4aa6-82c9-2faf6fe8d39b service nova] Lock "81666244-a2a7-4ace-969d-a3a3d0128329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:57:54 user nova-compute[71498]: DEBUG nova.compute.manager [req-d10cd856-24a4-4185-84bd-0cd882d6c6e9 req-14dc169b-c9a6-4aa6-82c9-2faf6fe8d39b service nova] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] No waiting events found dispatching network-vif-plugged-d66c282d-74db-42ba-96f3-faf43ebc6d98 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:57:54 user nova-compute[71498]: WARNING nova.compute.manager [req-d10cd856-24a4-4185-84bd-0cd882d6c6e9 req-14dc169b-c9a6-4aa6-82c9-2faf6fe8d39b service nova] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Received unexpected event network-vif-plugged-d66c282d-74db-42ba-96f3-faf43ebc6d98 for instance with vm_state building and task_state spawning.
Apr 14 01:57:56 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437476.4847896, 81666244-a2a7-4ace-969d-a3a3d0128329 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:57:56 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] VM Resumed (Lifecycle Event)
Apr 14 01:57:56 user nova-compute[71498]: DEBUG nova.compute.manager [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:57:56 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:57:56 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Instance spawned successfully.
Apr 14 01:57:56 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:57:56 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:57:56 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:57:56 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:57:56 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:57:56 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:57:56 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:57:56 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:57:56 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:57:56 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:57:56 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437476.4860067, 81666244-a2a7-4ace-969d-a3a3d0128329 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:57:56 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] VM Started (Lifecycle Event)
Apr 14 01:57:56 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:57:56 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:57:56 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:57:56 user nova-compute[71498]: INFO nova.compute.manager [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Took 5.02 seconds to spawn the instance on the hypervisor.
Apr 14 01:57:56 user nova-compute[71498]: DEBUG nova.compute.manager [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:57:56 user nova-compute[71498]: INFO nova.compute.manager [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Took 10.59 seconds to build instance.
Apr 14 01:57:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e2d84d5b-4bcf-4880-84c1-6335ff75b8a9 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "81666244-a2a7-4ace-969d-a3a3d0128329" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.676s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:57:56 user nova-compute[71498]: DEBUG nova.compute.manager [req-e80a4b63-d825-4ca6-a80a-7dfc680278b7 req-83b56892-1ccb-40af-bf9d-54af4049c341 service nova] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Received event network-vif-plugged-d66c282d-74db-42ba-96f3-faf43ebc6d98 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:57:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e80a4b63-d825-4ca6-a80a-7dfc680278b7 req-83b56892-1ccb-40af-bf9d-54af4049c341 service nova] Acquiring lock "81666244-a2a7-4ace-969d-a3a3d0128329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:57:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e80a4b63-d825-4ca6-a80a-7dfc680278b7 req-83b56892-1ccb-40af-bf9d-54af4049c341 service nova] Lock "81666244-a2a7-4ace-969d-a3a3d0128329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:57:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e80a4b63-d825-4ca6-a80a-7dfc680278b7 req-83b56892-1ccb-40af-bf9d-54af4049c341 service nova] Lock "81666244-a2a7-4ace-969d-a3a3d0128329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:57:56 user nova-compute[71498]: DEBUG nova.compute.manager [req-e80a4b63-d825-4ca6-a80a-7dfc680278b7 req-83b56892-1ccb-40af-bf9d-54af4049c341 service nova] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] No waiting events found dispatching network-vif-plugged-d66c282d-74db-42ba-96f3-faf43ebc6d98 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:57:56 user nova-compute[71498]: WARNING nova.compute.manager [req-e80a4b63-d825-4ca6-a80a-7dfc680278b7 req-83b56892-1ccb-40af-bf9d-54af4049c341 service nova] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Received unexpected event network-vif-plugged-d66c282d-74db-42ba-96f3-faf43ebc6d98 for instance with vm_state active and task_state None.
Apr 14 01:57:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:57:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:03 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681437468.7163973, 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:58:03 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] VM Stopped (Lifecycle Event)
Apr 14 01:58:03 user nova-compute[71498]: DEBUG nova.compute.manager [None req-3fc38abf-8985-4d8f-b374-7fdbc021deee None None] [instance: 7ff438f4-54e1-44b9-bb5a-1b42d48a37ed] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:58:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:10 user nova-compute[71498]: DEBUG nova.objects.instance [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'flavor' on Instance uuid 85b399dc-62df-480d-8561-5d9d1ab75c52 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:58:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "refresh_cache-85b399dc-62df-480d-8561-5d9d1ab75c52" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:58:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquired lock "refresh_cache-85b399dc-62df-480d-8561-5d9d1ab75c52" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:58:10 user nova-compute[71498]: DEBUG nova.network.neutron [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:58:10 user nova-compute[71498]: DEBUG nova.objects.instance [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'info_cache' on Instance uuid 85b399dc-62df-480d-8561-5d9d1ab75c52 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:58:10 user nova-compute[71498]: DEBUG nova.network.neutron [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Updating instance_info_cache with network_info: [{"id": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "address": "fa:16:3e:c2:1d:7f", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31ffaf4-6b", "ovs_interfaceid": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:58:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Releasing lock "refresh_cache-85b399dc-62df-480d-8561-5d9d1ab75c52" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:58:11 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Instance destroyed successfully.
Apr 14 01:58:11 user nova-compute[71498]: DEBUG nova.objects.instance [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'resources' on Instance uuid 85b399dc-62df-480d-8561-5d9d1ab75c52 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:50:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-325708357',display_name='tempest-AttachVolumeTestJSON-server-325708357',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-325708357',id=27,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvk+JYMt+HZ39UKnyK9XjRAYXFTfLUFV2C7qQoN4BD8jI9jpYJTV8jA9OgD5QAxdNshSqirCRpZ3xA98RiAsOOX3u/3A0BiHL6YVfgoocjrtHZ6NQNKyL6LjNBDUv8OmA==',key_name='tempest-keypair-2007571811',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:50:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0f650e04d2c947498b9e7a8d002862ad',ramdisk_id='',reservation_id='r-d003i0bm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-296004410',owner_user_name='tempest-AttachVolumeTestJSON-296004410-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:56:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba0894753a074f99ab226fde0565dd28',uuid=85b399dc-62df-480d-8561-5d9d1ab75c52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "address": "fa:16:3e:c2:1d:7f", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31ffaf4-6b", "ovs_interfaceid": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Converting VIF {"id": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "address": "fa:16:3e:c2:1d:7f", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31ffaf4-6b", "ovs_interfaceid": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1d:7f,bridge_name='br-int',has_traffic_filtering=True,id=e31ffaf4-6b2b-4099-88b5-683bc51ccfdf,network=Network(fe9d57b9-96e8-424e-8dc9-0c95f1aff03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape31ffaf4-6b') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG os_vif [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1d:7f,bridge_name='br-int',has_traffic_filtering=True,id=e31ffaf4-6b2b-4099-88b5-683bc51ccfdf,network=Network(fe9d57b9-96e8-424e-8dc9-0c95f1aff03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape31ffaf4-6b') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape31ffaf4-6b, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:58:11 user nova-compute[71498]: INFO os_vif [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1d:7f,bridge_name='br-int',has_traffic_filtering=True,id=e31ffaf4-6b2b-4099-88b5-683bc51ccfdf,network=Network(fe9d57b9-96e8-424e-8dc9-0c95f1aff03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape31ffaf4-6b')
Apr 14 01:58:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Start _get_guest_xml network_info=[{"id": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "address": "fa:16:3e:c2:1d:7f", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31ffaf4-6b", "ovs_interfaceid": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG nova.objects.instance [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'numa_topology' on Instance uuid 85b399dc-62df-480d-8561-5d9d1ab75c52 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:58:11 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:58:11 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:58:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG nova.objects.instance [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'vcpu_model' on Instance uuid 85b399dc-62df-480d-8561-5d9d1ab75c52 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:50:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-325708357',display_name='tempest-AttachVolumeTestJSON-server-325708357',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-325708357',id=27,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvk+JYMt+HZ39UKnyK9XjRAYXFTfLUFV2C7qQoN4BD8jI9jpYJTV8jA9OgD5QAxdNshSqirCRpZ3xA98RiAsOOX3u/3A0BiHL6YVfgoocjrtHZ6NQNKyL6LjNBDUv8OmA==',key_name='tempest-keypair-2007571811',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:50:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0f650e04d2c947498b9e7a8d002862ad',ramdisk_id='',reservation_id='r-d003i0bm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-296004410',owner_user_name='tempest-AttachVolumeTestJSON-296004410-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:56:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba0894753a074f99ab226fde0565dd28',uuid=85b399dc-62df-480d-8561-5d9d1ab75c52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "address": "fa:16:3e:c2:1d:7f", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31ffaf4-6b", "ovs_interfaceid": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Converting VIF {"id": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "address": "fa:16:3e:c2:1d:7f", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31ffaf4-6b", "ovs_interfaceid": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1d:7f,bridge_name='br-int',has_traffic_filtering=True,id=e31ffaf4-6b2b-4099-88b5-683bc51ccfdf,network=Network(fe9d57b9-96e8-424e-8dc9-0c95f1aff03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape31ffaf4-6b') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG nova.objects.instance [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'pci_devices' on Instance uuid 85b399dc-62df-480d-8561-5d9d1ab75c52 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:58:11 user nova-compute[71498]:   <uuid>85b399dc-62df-480d-8561-5d9d1ab75c52</uuid>
Apr 14 01:58:11 user nova-compute[71498]:   <name>instance-0000001b</name>
Apr 14 01:58:11 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:58:11 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:58:11 user nova-compute[71498]:   <metadata>
Apr 14 01:58:11 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:58:11 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:58:11 user nova-compute[71498]:       <nova:name>tempest-AttachVolumeTestJSON-server-325708357</nova:name>
Apr 14 01:58:11 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:58:11</nova:creationTime>
Apr 14 01:58:11 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:58:11 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:58:11 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:58:11 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:58:11 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:58:11 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:58:11 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:58:11 user nova-compute[71498]:       <nova:owner>
Apr 14 01:58:11 user nova-compute[71498]:         <nova:user uuid="ba0894753a074f99ab226fde0565dd28">tempest-AttachVolumeTestJSON-296004410-project-member</nova:user>
Apr 14 01:58:11 user nova-compute[71498]:         <nova:project uuid="0f650e04d2c947498b9e7a8d002862ad">tempest-AttachVolumeTestJSON-296004410</nova:project>
Apr 14 01:58:11 user nova-compute[71498]:       </nova:owner>
Apr 14 01:58:11 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:58:11 user nova-compute[71498]:       <nova:ports>
Apr 14 01:58:11 user nova-compute[71498]:         <nova:port uuid="e31ffaf4-6b2b-4099-88b5-683bc51ccfdf">
Apr 14 01:58:11 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 14 01:58:11 user nova-compute[71498]:         </nova:port>
Apr 14 01:58:11 user nova-compute[71498]:       </nova:ports>
Apr 14 01:58:11 user nova-compute[71498]:     </nova:instance>
Apr 14 01:58:11 user nova-compute[71498]:   </metadata>
Apr 14 01:58:11 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:58:11 user nova-compute[71498]:     <system>
Apr 14 01:58:11 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:58:11 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:58:11 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:58:11 user nova-compute[71498]:       <entry name="serial">85b399dc-62df-480d-8561-5d9d1ab75c52</entry>
Apr 14 01:58:11 user nova-compute[71498]:       <entry name="uuid">85b399dc-62df-480d-8561-5d9d1ab75c52</entry>
Apr 14 01:58:11 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:58:11 user nova-compute[71498]:     </system>
Apr 14 01:58:11 user nova-compute[71498]:   </sysinfo>
Apr 14 01:58:11 user nova-compute[71498]:   <os>
Apr 14 01:58:11 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:58:11 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:58:11 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:58:11 user nova-compute[71498]:   </os>
Apr 14 01:58:11 user nova-compute[71498]:   <features>
Apr 14 01:58:11 user nova-compute[71498]:     <acpi/>
Apr 14 01:58:11 user nova-compute[71498]:     <apic/>
Apr 14 01:58:11 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:58:11 user nova-compute[71498]:   </features>
Apr 14 01:58:11 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:58:11 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:58:11 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:58:11 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:58:11 user nova-compute[71498]:   </clock>
Apr 14 01:58:11 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:58:11 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:58:11 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:58:11 user nova-compute[71498]:   </cpu>
Apr 14 01:58:11 user nova-compute[71498]:   <devices>
Apr 14 01:58:11 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:58:11 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:58:11 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk"/>
Apr 14 01:58:11 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:58:11 user nova-compute[71498]:     </disk>
Apr 14 01:58:11 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:58:11 user nova-compute[71498]:       <mac address="fa:16:3e:c2:1d:7f"/>
Apr 14 01:58:11 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:58:11 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:58:11 user nova-compute[71498]:       <target dev="tape31ffaf4-6b"/>
Apr 14 01:58:11 user nova-compute[71498]:     </interface>
Apr 14 01:58:11 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:58:11 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/console.log" append="off"/>
Apr 14 01:58:11 user nova-compute[71498]:     </serial>
Apr 14 01:58:11 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:58:11 user nova-compute[71498]:     <video>
Apr 14 01:58:11 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:58:11 user nova-compute[71498]:     </video>
Apr 14 01:58:11 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:58:11 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:58:11 user nova-compute[71498]:     </rng>
Apr 14 01:58:11 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:58:11 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:58:11 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:58:11 user nova-compute[71498]:     </memballoon>
Apr 14 01:58:11 user nova-compute[71498]:   </devices>
Apr 14 01:58:11 user nova-compute[71498]: </domain>
Apr 14 01:58:11 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG nova.objects.instance [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'trusted_certs' on Instance uuid 85b399dc-62df-480d-8561-5d9d1ab75c52 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.132s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Cannot resize image /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG nova.objects.instance [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'migration_context' on Instance uuid 85b399dc-62df-480d-8561-5d9d1ab75c52 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:50:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-325708357',display_name='tempest-AttachVolumeTestJSON-server-325708357',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-325708357',id=27,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvk+JYMt+HZ39UKnyK9XjRAYXFTfLUFV2C7qQoN4BD8jI9jpYJTV8jA9OgD5QAxdNshSqirCRpZ3xA98RiAsOOX3u/3A0BiHL6YVfgoocjrtHZ6NQNKyL6LjNBDUv8OmA==',key_name='tempest-keypair-2007571811',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:50:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='0f650e04d2c947498b9e7a8d002862ad',ramdisk_id='',reservation_id='r-d003i0bm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-296004410',owner_user_name='tempest-AttachVolumeTestJSON-296004410-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:56:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba0894753a074f99ab226fde0565dd28',uuid=85b399dc-62df-480d-8561-5d9d1ab75c52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "address": "fa:16:3e:c2:1d:7f", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31ffaf4-6b", "ovs_interfaceid": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Converting VIF {"id": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "address": "fa:16:3e:c2:1d:7f", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31ffaf4-6b", "ovs_interfaceid": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1d:7f,bridge_name='br-int',has_traffic_filtering=True,id=e31ffaf4-6b2b-4099-88b5-683bc51ccfdf,network=Network(fe9d57b9-96e8-424e-8dc9-0c95f1aff03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape31ffaf4-6b') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG os_vif [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1d:7f,bridge_name='br-int',has_traffic_filtering=True,id=e31ffaf4-6b2b-4099-88b5-683bc51ccfdf,network=Network(fe9d57b9-96e8-424e-8dc9-0c95f1aff03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape31ffaf4-6b') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape31ffaf4-6b, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape31ffaf4-6b, col_values=(('external_ids', {'iface-id': 'e31ffaf4-6b2b-4099-88b5-683bc51ccfdf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:1d:7f', 'vm-uuid': '85b399dc-62df-480d-8561-5d9d1ab75c52'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:58:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:11 user nova-compute[71498]: INFO os_vif [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1d:7f,bridge_name='br-int',has_traffic_filtering=True,id=e31ffaf4-6b2b-4099-88b5-683bc51ccfdf,network=Network(fe9d57b9-96e8-424e-8dc9-0c95f1aff03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape31ffaf4-6b')
Apr 14 01:58:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:13 user nova-compute[71498]: DEBUG nova.compute.manager [req-18cda808-0652-4b5a-96d7-c75b8eaa7f4d req-ddc62afd-8098-4d18-bd21-d18cde3c6a3f service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Received event network-vif-plugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:58:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-18cda808-0652-4b5a-96d7-c75b8eaa7f4d req-ddc62afd-8098-4d18-bd21-d18cde3c6a3f service nova] Acquiring lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:58:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-18cda808-0652-4b5a-96d7-c75b8eaa7f4d req-ddc62afd-8098-4d18-bd21-d18cde3c6a3f service nova] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:58:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-18cda808-0652-4b5a-96d7-c75b8eaa7f4d req-ddc62afd-8098-4d18-bd21-d18cde3c6a3f service nova] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:58:13 user nova-compute[71498]: DEBUG nova.compute.manager [req-18cda808-0652-4b5a-96d7-c75b8eaa7f4d req-ddc62afd-8098-4d18-bd21-d18cde3c6a3f service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] No waiting events found dispatching network-vif-plugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:58:13 user nova-compute[71498]: WARNING nova.compute.manager [req-18cda808-0652-4b5a-96d7-c75b8eaa7f4d req-ddc62afd-8098-4d18-bd21-d18cde3c6a3f service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Received unexpected event network-vif-plugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf for instance with vm_state stopped and task_state powering-on.
Apr 14 01:58:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:15 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437495.137977, 85b399dc-62df-480d-8561-5d9d1ab75c52 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:58:15 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] VM Resumed (Lifecycle Event)
Apr 14 01:58:15 user nova-compute[71498]: DEBUG nova.compute.manager [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:58:15 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Instance rebooted successfully.
Apr 14 01:58:15 user nova-compute[71498]: DEBUG nova.compute.manager [None req-5b0fda82-aa40-4d2f-8a4a-8a043801d74d tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:58:15 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:58:15 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:58:15 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 14 01:58:15 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437495.1398041, 85b399dc-62df-480d-8561-5d9d1ab75c52 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:58:15 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] VM Started (Lifecycle Event)
Apr 14 01:58:15 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:58:15 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:58:15 user nova-compute[71498]: DEBUG nova.compute.manager [req-412be855-4aa3-4eed-99e4-6cd670c6ea5c req-efb865ab-f96f-4309-adcf-b2e3ae3960de service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Received event network-vif-plugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:58:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-412be855-4aa3-4eed-99e4-6cd670c6ea5c req-efb865ab-f96f-4309-adcf-b2e3ae3960de service nova] Acquiring lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:58:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-412be855-4aa3-4eed-99e4-6cd670c6ea5c req-efb865ab-f96f-4309-adcf-b2e3ae3960de service nova] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:58:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-412be855-4aa3-4eed-99e4-6cd670c6ea5c req-efb865ab-f96f-4309-adcf-b2e3ae3960de service nova] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:58:15 user nova-compute[71498]: DEBUG nova.compute.manager [req-412be855-4aa3-4eed-99e4-6cd670c6ea5c req-efb865ab-f96f-4309-adcf-b2e3ae3960de service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] No waiting events found dispatching network-vif-plugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:58:15 user nova-compute[71498]: WARNING nova.compute.manager [req-412be855-4aa3-4eed-99e4-6cd670c6ea5c req-efb865ab-f96f-4309-adcf-b2e3ae3960de service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Received unexpected event network-vif-plugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf for instance with vm_state active and task_state None.
Apr 14 01:58:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:20 user nova-compute[71498]: DEBUG nova.compute.manager [req-25a3c3d2-20bc-4673-b345-61c44023b606 req-b8471d0b-1574-48d8-8daf-c73a5bbde285 service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Received event network-changed-cb0b5d20-30a0-4636-82c8-0c7637d66465 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:58:20 user nova-compute[71498]: DEBUG nova.compute.manager [req-25a3c3d2-20bc-4673-b345-61c44023b606 req-b8471d0b-1574-48d8-8daf-c73a5bbde285 service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Refreshing instance network info cache due to event network-changed-cb0b5d20-30a0-4636-82c8-0c7637d66465. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:58:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-25a3c3d2-20bc-4673-b345-61c44023b606 req-b8471d0b-1574-48d8-8daf-c73a5bbde285 service nova] Acquiring lock "refresh_cache-9152f969-e279-4182-aa0a-8534458acbca" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:58:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-25a3c3d2-20bc-4673-b345-61c44023b606 req-b8471d0b-1574-48d8-8daf-c73a5bbde285 service nova] Acquired lock "refresh_cache-9152f969-e279-4182-aa0a-8534458acbca" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:58:20 user nova-compute[71498]: DEBUG nova.network.neutron [req-25a3c3d2-20bc-4673-b345-61c44023b606 req-b8471d0b-1574-48d8-8daf-c73a5bbde285 service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Refreshing network info cache for port cb0b5d20-30a0-4636-82c8-0c7637d66465 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:58:20 user nova-compute[71498]: DEBUG nova.network.neutron [req-25a3c3d2-20bc-4673-b345-61c44023b606 req-b8471d0b-1574-48d8-8daf-c73a5bbde285 service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Updated VIF entry in instance network info cache for port cb0b5d20-30a0-4636-82c8-0c7637d66465. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:58:20 user nova-compute[71498]: DEBUG nova.network.neutron [req-25a3c3d2-20bc-4673-b345-61c44023b606 req-b8471d0b-1574-48d8-8daf-c73a5bbde285 service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Updating instance_info_cache with network_info: [{"id": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "address": "fa:16:3e:66:5e:af", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0b5d20-30", "ovs_interfaceid": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:58:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-25a3c3d2-20bc-4673-b345-61c44023b606 req-b8471d0b-1574-48d8-8daf-c73a5bbde285 service nova] Releasing lock "refresh_cache-9152f969-e279-4182-aa0a-8534458acbca" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:58:21 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "9152f969-e279-4182-aa0a-8534458acbca" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:58:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "9152f969-e279-4182-aa0a-8534458acbca" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:58:23 user nova-compute[71498]: INFO nova.compute.manager [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Shelving
Apr 14 01:58:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:23 user nova-compute[71498]: DEBUG nova.compute.manager [req-efba93e9-8ed6-4c93-9ea4-4d324677f40a req-21dfd76a-e8a4-4522-ae11-7eb557686e1a service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Received event network-vif-unplugged-cb0b5d20-30a0-4636-82c8-0c7637d66465 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:58:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-efba93e9-8ed6-4c93-9ea4-4d324677f40a req-21dfd76a-e8a4-4522-ae11-7eb557686e1a service nova] Acquiring lock "9152f969-e279-4182-aa0a-8534458acbca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:58:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-efba93e9-8ed6-4c93-9ea4-4d324677f40a req-21dfd76a-e8a4-4522-ae11-7eb557686e1a service nova] Lock "9152f969-e279-4182-aa0a-8534458acbca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:58:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-efba93e9-8ed6-4c93-9ea4-4d324677f40a req-21dfd76a-e8a4-4522-ae11-7eb557686e1a service nova] Lock "9152f969-e279-4182-aa0a-8534458acbca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:58:23 user nova-compute[71498]: DEBUG nova.compute.manager [req-efba93e9-8ed6-4c93-9ea4-4d324677f40a req-21dfd76a-e8a4-4522-ae11-7eb557686e1a service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] No waiting events found dispatching network-vif-unplugged-cb0b5d20-30a0-4636-82c8-0c7637d66465 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:58:23 user nova-compute[71498]: WARNING nova.compute.manager [req-efba93e9-8ed6-4c93-9ea4-4d324677f40a req-21dfd76a-e8a4-4522-ae11-7eb557686e1a service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Received unexpected event network-vif-unplugged-cb0b5d20-30a0-4636-82c8-0c7637d66465 for instance with vm_state active and task_state shelving.
Apr 14 01:58:24 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Instance destroyed successfully.
Apr 14 01:58:24 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Beginning cold snapshot process
Apr 14 01:58:24 user nova-compute[71498]: DEBUG nova.privsep.utils [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71498) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 01:58:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk /opt/stack/data/nova/instances/snapshots/tmp8e_j6f0c/8fa2bc195d3e4eeabb9e4ef19d168cf1 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:58:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk /opt/stack/data/nova/instances/snapshots/tmp8e_j6f0c/8fa2bc195d3e4eeabb9e4ef19d168cf1" returned: 0 in 0.384s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:58:24 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Snapshot extracted, beginning image upload
Apr 14 01:58:25 user nova-compute[71498]: DEBUG nova.compute.manager [req-446dd524-9ffa-42c5-987b-a98662395b49 req-35d3f291-9018-4965-a482-4fbafaffb596 service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Received event network-vif-plugged-cb0b5d20-30a0-4636-82c8-0c7637d66465 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:58:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-446dd524-9ffa-42c5-987b-a98662395b49 req-35d3f291-9018-4965-a482-4fbafaffb596 service nova] Acquiring lock "9152f969-e279-4182-aa0a-8534458acbca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:58:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-446dd524-9ffa-42c5-987b-a98662395b49 req-35d3f291-9018-4965-a482-4fbafaffb596 service nova] Lock "9152f969-e279-4182-aa0a-8534458acbca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:58:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-446dd524-9ffa-42c5-987b-a98662395b49 req-35d3f291-9018-4965-a482-4fbafaffb596 service nova] Lock "9152f969-e279-4182-aa0a-8534458acbca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:58:25 user nova-compute[71498]: DEBUG nova.compute.manager [req-446dd524-9ffa-42c5-987b-a98662395b49 req-35d3f291-9018-4965-a482-4fbafaffb596 service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] No waiting events found dispatching network-vif-plugged-cb0b5d20-30a0-4636-82c8-0c7637d66465 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:58:25 user nova-compute[71498]: WARNING nova.compute.manager [req-446dd524-9ffa-42c5-987b-a98662395b49 req-35d3f291-9018-4965-a482-4fbafaffb596 service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Received unexpected event network-vif-plugged-cb0b5d20-30a0-4636-82c8-0c7637d66465 for instance with vm_state active and task_state shelving_image_uploading.
Apr 14 01:58:26 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:27 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Snapshot image upload complete
Apr 14 01:58:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:58:27 user nova-compute[71498]: INFO nova.compute.manager [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Shelve offloading
Apr 14 01:58:27 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Instance destroyed successfully.
Apr 14 01:58:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:58:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "refresh_cache-9152f969-e279-4182-aa0a-8534458acbca" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:58:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquired lock "refresh_cache-9152f969-e279-4182-aa0a-8534458acbca" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:58:27 user nova-compute[71498]: DEBUG nova.network.neutron [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:58:27 user nova-compute[71498]: DEBUG nova.network.neutron [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Updating instance_info_cache with network_info: [{"id": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "address": "fa:16:3e:66:5e:af", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0b5d20-30", "ovs_interfaceid": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:58:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Releasing lock "refresh_cache-9152f969-e279-4182-aa0a-8534458acbca" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:58:28 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Instance destroyed successfully.
Apr 14 01:58:28 user nova-compute[71498]: DEBUG nova.objects.instance [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lazy-loading 'resources' on Instance uuid 9152f969-e279-4182-aa0a-8534458acbca {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:58:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:28 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:56:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1283417408',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1283417408',id=32,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIopxcmtvU7zv42zkIa4Oz1jEP4DNyyAzFY9+vRTU16RetxI5ZPVi+sg5XXxOyu9RTbP8T9qWJjnsbfeLu0C5tcKuN56PwVxP5mYkQsJP0kN6YvWI8oVts6rIeLy1vmUYw==',key_name='tempest-keypair-1419165173',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:56:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a6d05ca328d64f2aa1d19550475edba3',ramdisk_id='',reservation_id='r-wryfyacz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2042065984',owner_user_name='tempest-AttachVolumeShelveTestJSON-2042065984-project-member',shelved_at='2023-04-14T01:58:27.035819',shelved_host='user',shelved_image_id='613b68a2-7fbe-45d8-9865-8b80ea916153'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:58:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a5da3e233c74524a953ce0d4e074077',uuid=9152f969-e279-4182-aa0a-8534458acbca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "address": "fa:16:3e:66:5e:af", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0b5d20-30", "ovs_interfaceid": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:58:28 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Converting VIF {"id": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "address": "fa:16:3e:66:5e:af", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0b5d20-30", "ovs_interfaceid": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:58:28 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:5e:af,bridge_name='br-int',has_traffic_filtering=True,id=cb0b5d20-30a0-4636-82c8-0c7637d66465,network=Network(a7b6c0bc-d2de-4431-821b-c2917738e556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb0b5d20-30') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:58:28 user nova-compute[71498]: DEBUG os_vif [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:5e:af,bridge_name='br-int',has_traffic_filtering=True,id=cb0b5d20-30a0-4636-82c8-0c7637d66465,network=Network(a7b6c0bc-d2de-4431-821b-c2917738e556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb0b5d20-30') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:58:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb0b5d20-30, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:58:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:58:28 user nova-compute[71498]: INFO os_vif [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:5e:af,bridge_name='br-int',has_traffic_filtering=True,id=cb0b5d20-30a0-4636-82c8-0c7637d66465,network=Network(a7b6c0bc-d2de-4431-821b-c2917738e556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb0b5d20-30')
Apr 14 01:58:28 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Deleting instance files /opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca_del
Apr 14 01:58:28 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Deletion of /opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca_del complete
Apr 14 01:58:28 user nova-compute[71498]: DEBUG nova.compute.manager [req-6be23c85-053f-42ab-adb8-dabcd5c5c093 req-8f31eb3e-1af8-4c9c-8466-fcb22bb22376 service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Received event network-changed-cb0b5d20-30a0-4636-82c8-0c7637d66465 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:58:28 user nova-compute[71498]: DEBUG nova.compute.manager [req-6be23c85-053f-42ab-adb8-dabcd5c5c093 req-8f31eb3e-1af8-4c9c-8466-fcb22bb22376 service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Refreshing instance network info cache due to event network-changed-cb0b5d20-30a0-4636-82c8-0c7637d66465. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:58:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6be23c85-053f-42ab-adb8-dabcd5c5c093 req-8f31eb3e-1af8-4c9c-8466-fcb22bb22376 service nova] Acquiring lock "refresh_cache-9152f969-e279-4182-aa0a-8534458acbca" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:58:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6be23c85-053f-42ab-adb8-dabcd5c5c093 req-8f31eb3e-1af8-4c9c-8466-fcb22bb22376 service nova] Acquired lock "refresh_cache-9152f969-e279-4182-aa0a-8534458acbca" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:58:28 user nova-compute[71498]: DEBUG nova.network.neutron [req-6be23c85-053f-42ab-adb8-dabcd5c5c093 req-8f31eb3e-1af8-4c9c-8466-fcb22bb22376 service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Refreshing network info cache for port cb0b5d20-30a0-4636-82c8-0c7637d66465 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:58:28 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Deleted allocations for instance 9152f969-e279-4182-aa0a-8534458acbca
Apr 14 01:58:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:58:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:58:28 user nova-compute[71498]: DEBUG nova.objects.instance [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lazy-loading 'numa_topology' on Instance uuid 9152f969-e279-4182-aa0a-8534458acbca {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:58:28 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:58:28 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:58:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:58:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5cfacf38-fcba-49d5-af87-ac891f546405 tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "9152f969-e279-4182-aa0a-8534458acbca" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.372s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:58:29 user nova-compute[71498]: DEBUG nova.network.neutron [req-6be23c85-053f-42ab-adb8-dabcd5c5c093 req-8f31eb3e-1af8-4c9c-8466-fcb22bb22376 service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Updated VIF entry in instance network info cache for port cb0b5d20-30a0-4636-82c8-0c7637d66465. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:58:29 user nova-compute[71498]: DEBUG nova.network.neutron [req-6be23c85-053f-42ab-adb8-dabcd5c5c093 req-8f31eb3e-1af8-4c9c-8466-fcb22bb22376 service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Updating instance_info_cache with network_info: [{"id": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "address": "fa:16:3e:66:5e:af", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapcb0b5d20-30", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:58:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6be23c85-053f-42ab-adb8-dabcd5c5c093 req-8f31eb3e-1af8-4c9c-8466-fcb22bb22376 service nova] Releasing lock "refresh_cache-9152f969-e279-4182-aa0a-8534458acbca" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:58:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-75cd6313-474e-470b-bc41-54fadeeaafd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "ae82789e-1bed-419b-a580-68ff7ed03ef2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:58:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-75cd6313-474e-470b-bc41-54fadeeaafd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "ae82789e-1bed-419b-a580-68ff7ed03ef2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:58:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-75cd6313-474e-470b-bc41-54fadeeaafd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "ae82789e-1bed-419b-a580-68ff7ed03ef2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:58:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-75cd6313-474e-470b-bc41-54fadeeaafd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "ae82789e-1bed-419b-a580-68ff7ed03ef2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:58:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-75cd6313-474e-470b-bc41-54fadeeaafd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "ae82789e-1bed-419b-a580-68ff7ed03ef2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:58:38 user nova-compute[71498]: INFO nova.compute.manager [None req-75cd6313-474e-470b-bc41-54fadeeaafd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Terminating instance
Apr 14 01:58:38 user nova-compute[71498]: DEBUG nova.compute.manager [None req-75cd6313-474e-470b-bc41-54fadeeaafd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 01:58:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:39 user nova-compute[71498]: DEBUG nova.compute.manager [req-b92eca9c-6cee-490f-bf35-bd584a32d15f req-33ceeb72-5f70-4a9a-a4ae-ab34000a0d91 service nova] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Received event network-vif-unplugged-1c1e2ef8-d508-4d18-b4a4-69251ae763d0 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:58:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b92eca9c-6cee-490f-bf35-bd584a32d15f req-33ceeb72-5f70-4a9a-a4ae-ab34000a0d91 service nova] Acquiring lock "ae82789e-1bed-419b-a580-68ff7ed03ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:58:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b92eca9c-6cee-490f-bf35-bd584a32d15f req-33ceeb72-5f70-4a9a-a4ae-ab34000a0d91 service nova] Lock "ae82789e-1bed-419b-a580-68ff7ed03ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:58:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b92eca9c-6cee-490f-bf35-bd584a32d15f req-33ceeb72-5f70-4a9a-a4ae-ab34000a0d91 service nova] Lock "ae82789e-1bed-419b-a580-68ff7ed03ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:58:39 user nova-compute[71498]: DEBUG nova.compute.manager [req-b92eca9c-6cee-490f-bf35-bd584a32d15f req-33ceeb72-5f70-4a9a-a4ae-ab34000a0d91 service nova] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] No waiting events found dispatching network-vif-unplugged-1c1e2ef8-d508-4d18-b4a4-69251ae763d0 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:58:39 user nova-compute[71498]: DEBUG nova.compute.manager [req-b92eca9c-6cee-490f-bf35-bd584a32d15f req-33ceeb72-5f70-4a9a-a4ae-ab34000a0d91 service nova] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Received event network-vif-unplugged-1c1e2ef8-d508-4d18-b4a4-69251ae763d0 for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:58:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:39 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681437504.1875129, 9152f969-e279-4182-aa0a-8534458acbca => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:58:39 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 9152f969-e279-4182-aa0a-8534458acbca] VM Stopped (Lifecycle Event)
Apr 14 01:58:39 user nova-compute[71498]: DEBUG nova.compute.manager [None req-ddd36dbb-c02c-4869-8ddb-2ef829d946c4 None None] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:58:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:39 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Instance destroyed successfully.
Apr 14 01:58:39 user nova-compute[71498]: DEBUG nova.objects.instance [None req-75cd6313-474e-470b-bc41-54fadeeaafd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lazy-loading 'resources' on Instance uuid ae82789e-1bed-419b-a580-68ff7ed03ef2 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:58:39 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-75cd6313-474e-470b-bc41-54fadeeaafd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:49:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-82990348',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-82990348',id=25,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:49:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='219c39c8299e46368012a947fdfbe5fd',ramdisk_id='',reservation_id='r-zpjyjljy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-85797606',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:51:14Z,user_data=None,user_id='7ed01a83531f4c6bb18a4593284baf05',uuid=ae82789e-1bed-419b-a580-68ff7ed03ef2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c1e2ef8-d508-4d18-b4a4-69251ae763d0", "address": "fa:16:3e:d5:d6:0c", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c1e2ef8-d5", "ovs_interfaceid": "1c1e2ef8-d508-4d18-b4a4-69251ae763d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:58:39 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-75cd6313-474e-470b-bc41-54fadeeaafd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Converting VIF {"id": "1c1e2ef8-d508-4d18-b4a4-69251ae763d0", "address": "fa:16:3e:d5:d6:0c", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c1e2ef8-d5", "ovs_interfaceid": "1c1e2ef8-d508-4d18-b4a4-69251ae763d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:58:39 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-75cd6313-474e-470b-bc41-54fadeeaafd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:d6:0c,bridge_name='br-int',has_traffic_filtering=True,id=1c1e2ef8-d508-4d18-b4a4-69251ae763d0,network=Network(365cbeec-3756-4258-a135-04112bdda4b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c1e2ef8-d5') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:58:39 user nova-compute[71498]: DEBUG os_vif [None req-75cd6313-474e-470b-bc41-54fadeeaafd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:d6:0c,bridge_name='br-int',has_traffic_filtering=True,id=1c1e2ef8-d508-4d18-b4a4-69251ae763d0,network=Network(365cbeec-3756-4258-a135-04112bdda4b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c1e2ef8-d5') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:58:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c1e2ef8-d5, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:58:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:58:39 user nova-compute[71498]: INFO os_vif [None req-75cd6313-474e-470b-bc41-54fadeeaafd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:d6:0c,bridge_name='br-int',has_traffic_filtering=True,id=1c1e2ef8-d508-4d18-b4a4-69251ae763d0,network=Network(365cbeec-3756-4258-a135-04112bdda4b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c1e2ef8-d5')
Apr 14 01:58:39 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-75cd6313-474e-470b-bc41-54fadeeaafd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Deleting instance files /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2_del
Apr 14 01:58:39 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-75cd6313-474e-470b-bc41-54fadeeaafd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Deletion of /opt/stack/data/nova/instances/ae82789e-1bed-419b-a580-68ff7ed03ef2_del complete
Apr 14 01:58:39 user nova-compute[71498]: INFO nova.compute.manager [None req-75cd6313-474e-470b-bc41-54fadeeaafd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 14 01:58:39 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-75cd6313-474e-470b-bc41-54fadeeaafd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 01:58:39 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 01:58:39 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 01:58:39 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:58:39 user nova-compute[71498]: DEBUG nova.compute.manager [req-066803e4-0299-406a-a81a-d39a3b99f44b req-fe6f4702-d1a2-44b5-944f-8327cb4bef47 service nova] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Received event network-vif-deleted-1c1e2ef8-d508-4d18-b4a4-69251ae763d0 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:58:39 user nova-compute[71498]: INFO nova.compute.manager [req-066803e4-0299-406a-a81a-d39a3b99f44b req-fe6f4702-d1a2-44b5-944f-8327cb4bef47 service nova] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Neutron deleted interface 1c1e2ef8-d508-4d18-b4a4-69251ae763d0; detaching it from the instance and deleting it from the info cache
Apr 14 01:58:39 user nova-compute[71498]: DEBUG nova.network.neutron [req-066803e4-0299-406a-a81a-d39a3b99f44b req-fe6f4702-d1a2-44b5-944f-8327cb4bef47 service nova] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:58:39 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Took 0.53 seconds to deallocate network for instance.
Apr 14 01:58:39 user nova-compute[71498]: DEBUG nova.compute.manager [req-066803e4-0299-406a-a81a-d39a3b99f44b req-fe6f4702-d1a2-44b5-944f-8327cb4bef47 service nova] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Detach interface failed, port_id=1c1e2ef8-d508-4d18-b4a4-69251ae763d0, reason: Instance ae82789e-1bed-419b-a580-68ff7ed03ef2 could not be found. {{(pid=71498) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 01:58:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-75cd6313-474e-470b-bc41-54fadeeaafd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:58:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-75cd6313-474e-470b-bc41-54fadeeaafd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:58:40 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-75cd6313-474e-470b-bc41-54fadeeaafd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:58:40 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-75cd6313-474e-470b-bc41-54fadeeaafd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:58:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-75cd6313-474e-470b-bc41-54fadeeaafd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.316s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:58:40 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-75cd6313-474e-470b-bc41-54fadeeaafd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Deleted allocations for instance ae82789e-1bed-419b-a580-68ff7ed03ef2
Apr 14 01:58:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-75cd6313-474e-470b-bc41-54fadeeaafd8 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "ae82789e-1bed-419b-a580-68ff7ed03ef2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.698s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:58:41 user nova-compute[71498]: DEBUG nova.compute.manager [req-7f0bd1c0-a1be-4b02-8a4a-53e6525e2762 req-06664bbd-f72b-409a-8f68-0bc45e0f3e30 service nova] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Received event network-vif-plugged-1c1e2ef8-d508-4d18-b4a4-69251ae763d0 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:58:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7f0bd1c0-a1be-4b02-8a4a-53e6525e2762 req-06664bbd-f72b-409a-8f68-0bc45e0f3e30 service nova] Acquiring lock "ae82789e-1bed-419b-a580-68ff7ed03ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:58:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7f0bd1c0-a1be-4b02-8a4a-53e6525e2762 req-06664bbd-f72b-409a-8f68-0bc45e0f3e30 service nova] Lock "ae82789e-1bed-419b-a580-68ff7ed03ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:58:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7f0bd1c0-a1be-4b02-8a4a-53e6525e2762 req-06664bbd-f72b-409a-8f68-0bc45e0f3e30 service nova] Lock "ae82789e-1bed-419b-a580-68ff7ed03ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:58:41 user nova-compute[71498]: DEBUG nova.compute.manager [req-7f0bd1c0-a1be-4b02-8a4a-53e6525e2762 req-06664bbd-f72b-409a-8f68-0bc45e0f3e30 service nova] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] No waiting events found dispatching network-vif-plugged-1c1e2ef8-d508-4d18-b4a4-69251ae763d0 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:58:41 user nova-compute[71498]: WARNING nova.compute.manager [req-7f0bd1c0-a1be-4b02-8a4a-53e6525e2762 req-06664bbd-f72b-409a-8f68-0bc45e0f3e30 service nova] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Received unexpected event network-vif-plugged-1c1e2ef8-d508-4d18-b4a4-69251ae763d0 for instance with vm_state deleted and task_state None.
Apr 14 01:58:41 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:58:41 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 01:58:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-85b399dc-62df-480d-8561-5d9d1ab75c52" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:58:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-85b399dc-62df-480d-8561-5d9d1ab75c52" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:58:41 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 01:58:41 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Updating instance_info_cache with network_info: [{"id": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "address": "fa:16:3e:c2:1d:7f", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31ffaf4-6b", "ovs_interfaceid": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:58:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-85b399dc-62df-480d-8561-5d9d1ab75c52" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:58:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 01:58:42 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:58:42 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:58:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:58:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:58:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:58:42 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 01:58:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:58:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:58:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:58:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:58:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:58:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:58:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:58:42 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:58:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:58:43 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:58:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:58:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:58:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:58:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:58:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:58:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:58:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:58:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:58:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:58:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:58:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:58:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:58:43 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:58:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:58:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:58:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:58:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:58:44 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:58:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:58:44 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:58:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:58:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:58:44 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:58:45 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:58:45 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:58:45 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=7941MB free_disk=26.186664581298828GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 01:58:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:58:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:58:45 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:58:45 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:58:45 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance a19a1c08-5454-481b-bb5a-70c39ead9afc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:58:45 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance fa29c144-0ff9-4efb-a574-f521d18f08fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:58:45 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 85b399dc-62df-480d-8561-5d9d1ab75c52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:58:45 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:58:45 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:58:45 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 618f5f0d-3594-41dd-9d8f-0c7bea255a3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:58:45 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 81666244-a2a7-4ace-969d-a3a3d0128329 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:58:45 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 01:58:45 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 01:58:45 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:58:45 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:58:45 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 01:58:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.448s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:58:47 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:58:47 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:58:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:48 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:58:48 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:58:48 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 01:58:49 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:49 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:58:49 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:58:50 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:58:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:54 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681437519.3003237, ae82789e-1bed-419b-a580-68ff7ed03ef2 => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:58:54 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] VM Stopped (Lifecycle Event)
Apr 14 01:58:54 user nova-compute[71498]: DEBUG nova.compute.manager [None req-28dd6103-d426-452c-9f0d-e70d4fcaf987 None None] [instance: ae82789e-1bed-419b-a580-68ff7ed03ef2] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:58:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:58:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:58:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:58:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:58:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:58:56 user nova-compute[71498]: INFO nova.compute.manager [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Terminating instance
Apr 14 01:58:56 user nova-compute[71498]: DEBUG nova.compute.manager [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 01:58:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG nova.compute.manager [req-da539d61-ab36-4d63-a76b-fcf6c443c6b5 req-88a02fa3-d94c-4d61-aab4-02b993298d9b service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Received event network-vif-unplugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-da539d61-ab36-4d63-a76b-fcf6c443c6b5 req-88a02fa3-d94c-4d61-aab4-02b993298d9b service nova] Acquiring lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-da539d61-ab36-4d63-a76b-fcf6c443c6b5 req-88a02fa3-d94c-4d61-aab4-02b993298d9b service nova] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-da539d61-ab36-4d63-a76b-fcf6c443c6b5 req-88a02fa3-d94c-4d61-aab4-02b993298d9b service nova] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG nova.compute.manager [req-da539d61-ab36-4d63-a76b-fcf6c443c6b5 req-88a02fa3-d94c-4d61-aab4-02b993298d9b service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] No waiting events found dispatching network-vif-unplugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG nova.compute.manager [req-da539d61-ab36-4d63-a76b-fcf6c443c6b5 req-88a02fa3-d94c-4d61-aab4-02b993298d9b service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Received event network-vif-unplugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:58:57 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Instance destroyed successfully.
Apr 14 01:58:57 user nova-compute[71498]: DEBUG nova.objects.instance [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lazy-loading 'resources' on Instance uuid 73cc8ede-babd-4281-bf1d-c5a3f8bad440 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T01:45:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-889087873',display_name='tempest-ServerActionsTestJSON-server-311342760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-889087873',id=20,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7iIvlhM+wCditCRaonOriLx8WWyehY8kYxTUZ36Z1Q4VGm2JnuefQ18D+1ncnGXJXgbpg/EWHmDPRQFx9TQ2PBQ5aNgSGRUcq/Ovi+zGjOYQDNVYkQyEvsulSNtijWoQ==',key_name='tempest-keypair-165395776',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:56:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ed4ed4ab2fd4c14b3e2afe343fd7256',ramdisk_id='',reservation_id='r-1656hccc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-2035821517',owner_user_name='tempest-ServerActionsTestJSON-2035821517-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:56:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78ccd1a1ec1b486981d850881734fe02',uuid=73cc8ede-babd-4281-bf1d-c5a3f8bad440,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converting VIF {"id": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "address": "fa:16:3e:b2:d1:94", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d281bf-16", "ovs_interfaceid": "84d281bf-164e-48f3-a3ee-ca796d9a48e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:d1:94,bridge_name='br-int',has_traffic_filtering=True,id=84d281bf-164e-48f3-a3ee-ca796d9a48e7,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d281bf-16') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG os_vif [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:d1:94,bridge_name='br-int',has_traffic_filtering=True,id=84d281bf-164e-48f3-a3ee-ca796d9a48e7,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d281bf-16') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84d281bf-16, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:57 user nova-compute[71498]: INFO os_vif [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:d1:94,bridge_name='br-int',has_traffic_filtering=True,id=84d281bf-164e-48f3-a3ee-ca796d9a48e7,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d281bf-16')
Apr 14 01:58:57 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vNWpMtFL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:58:57 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:58:57 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3ccf0a-739a-4552-8018-678e31ee3abe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:58:57 user nova-compute[71498]: No targets found.
Apr 14 01:58:57 user nova-compute[71498]: iSNS:
Apr 14 01:58:57 user nova-compute[71498]: No targets found.
Apr 14 01:58:57 user nova-compute[71498]: STATIC:
Apr 14 01:58:57 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25
Apr 14 01:58:57 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:58:57 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:58:57 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f
Apr 14 01:58:57 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:58:57 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:58:57 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860
Apr 14 01:58:57 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:58:57 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:58:57 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415
Apr 14 01:58:57 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:58:57 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:58:57 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22
Apr 14 01:58:57 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:58:57 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:58:57 user nova-compute[71498]: FIRMWARE:
Apr 14 01:58:57 user nova-compute[71498]: No targets found.
Apr 14 01:58:57 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:58:57 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:58:57 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5c5670-9307-4404-94e5-17c6946ee586]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[42070cf9-71ea-4836-8a18-8238155b7512]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:58:57 user nova-compute[71498]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)
Apr 14 01:58:57 user nova-compute[71498]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:58:57 user nova-compute[71498]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:58:57 user nova-compute[71498]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 (non-flash)
Apr 14 01:58:57 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:58:57 user nova-compute[71498]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)
Apr 14 01:58:57 user nova-compute[71498]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:58:57 user nova-compute[71498]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f (non-flash)
Apr 14 01:58:57 user nova-compute[71498]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 (non-flash)
Apr 14 01:58:57 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51e423bd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f'): ({'sdg'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Removing single pathed devices sdg {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e2b9ae-0a12-4594-aff3-15509c73a459]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[087a2958-d5a5-4be0-86f9-9937a098179d]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Flushing IO for device /dev/sdg {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb14870f-d746-46b9-8b3c-c657319042f3]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e879c5d2-392c-41fd-b6be-8620759cf3f5]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] SCSI volumes sdg have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec4c67f-eb6b-43e8-93da-20448c5e50e8]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae52d0b4-1bc5-41b9-b2d9-cd1be66dded3]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f, portal: 172.16.0.220,3260]
Apr 14 01:58:57 user nova-compute[71498]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f, portal: 172.16.0.220,3260] successful.
Apr 14 01:58:57 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55aa3df5-b363-4e8f-ac2e-f46bea9ca67f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a168d51-e718-49d3-9a3f-5b402d06a48c]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] <== disconnect_volume: return (308ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:58:57 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Deleting instance files /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440_del
Apr 14 01:58:57 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Deletion of /opt/stack/data/nova/instances/73cc8ede-babd-4281-bf1d-c5a3f8bad440_del complete
Apr 14 01:58:57 user nova-compute[71498]: INFO nova.compute.manager [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Took 1.20 seconds to destroy the instance on the hypervisor.
Apr 14 01:58:57 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 01:58:57 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 01:58:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:58:58 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:58:58 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Took 1.04 seconds to deallocate network for instance.
Apr 14 01:58:59 user nova-compute[71498]: DEBUG nova.compute.manager [req-db65afe3-4cb9-4711-978e-69821ffc531d req-74eaa9fc-f1d2-4e17-985f-50033dec02f0 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Received event network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:58:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-db65afe3-4cb9-4711-978e-69821ffc531d req-74eaa9fc-f1d2-4e17-985f-50033dec02f0 service nova] Acquiring lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:58:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-db65afe3-4cb9-4711-978e-69821ffc531d req-74eaa9fc-f1d2-4e17-985f-50033dec02f0 service nova] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:58:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-db65afe3-4cb9-4711-978e-69821ffc531d req-74eaa9fc-f1d2-4e17-985f-50033dec02f0 service nova] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:58:59 user nova-compute[71498]: DEBUG nova.compute.manager [req-db65afe3-4cb9-4711-978e-69821ffc531d req-74eaa9fc-f1d2-4e17-985f-50033dec02f0 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] No waiting events found dispatching network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:58:59 user nova-compute[71498]: WARNING nova.compute.manager [req-db65afe3-4cb9-4711-978e-69821ffc531d req-74eaa9fc-f1d2-4e17-985f-50033dec02f0 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Received unexpected event network-vif-plugged-84d281bf-164e-48f3-a3ee-ca796d9a48e7 for instance with vm_state active and task_state deleting.
Apr 14 01:58:59 user nova-compute[71498]: DEBUG nova.compute.manager [req-db65afe3-4cb9-4711-978e-69821ffc531d req-74eaa9fc-f1d2-4e17-985f-50033dec02f0 service nova] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Received event network-vif-deleted-84d281bf-164e-48f3-a3ee-ca796d9a48e7 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:58:59 user nova-compute[71498]: INFO nova.compute.manager [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Took 0.96 seconds to detach 1 volumes for instance.
Apr 14 01:59:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:59:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:59:00 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:59:00 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:59:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:59:00 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Deleted allocations for instance 73cc8ede-babd-4281-bf1d-c5a3f8bad440
Apr 14 01:59:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-5806617b-f782-42e6-847d-af93d9466ba3 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "73cc8ede-babd-4281-bf1d-c5a3f8bad440" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.703s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:59:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:59:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 01:59:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:59:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:59:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:12 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681437537.516125, 73cc8ede-babd-4281-bf1d-c5a3f8bad440 => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:59:12 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] VM Stopped (Lifecycle Event)
Apr 14 01:59:12 user nova-compute[71498]: DEBUG nova.compute.manager [None req-a10af61e-b8b7-405a-8dad-3e3e8f716519 None None] [instance: 73cc8ede-babd-4281-bf1d-c5a3f8bad440] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:59:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:59:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:21 user nova-compute[71498]: DEBUG nova.compute.manager [req-88acb611-3ea1-48f6-899f-812399c3ac16 req-5b23378e-dc79-4076-8dcc-cf597d03777b service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received event network-changed-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:59:21 user nova-compute[71498]: DEBUG nova.compute.manager [req-88acb611-3ea1-48f6-899f-812399c3ac16 req-5b23378e-dc79-4076-8dcc-cf597d03777b service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Refreshing instance network info cache due to event network-changed-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:59:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-88acb611-3ea1-48f6-899f-812399c3ac16 req-5b23378e-dc79-4076-8dcc-cf597d03777b service nova] Acquiring lock "refresh_cache-92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:59:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-88acb611-3ea1-48f6-899f-812399c3ac16 req-5b23378e-dc79-4076-8dcc-cf597d03777b service nova] Acquired lock "refresh_cache-92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:59:21 user nova-compute[71498]: DEBUG nova.network.neutron [req-88acb611-3ea1-48f6-899f-812399c3ac16 req-5b23378e-dc79-4076-8dcc-cf597d03777b service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Refreshing network info cache for port 69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:59:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:59:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:59:21 user nova-compute[71498]: INFO nova.compute.manager [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Detaching volume 4c279a98-9587-47a8-a153-408cc1232415
Apr 14 01:59:21 user nova-compute[71498]: INFO nova.virt.block_device [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Attempting to driver detach volume 4c279a98-9587-47a8-a153-408cc1232415 from mountpoint /dev/vdb
Apr 14 01:59:21 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Attempting to detach device vdb from instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 from the persistent domain config. {{(pid=71498) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 01:59:21 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 01:59:21 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:59:21 user nova-compute[71498]:   <source dev="/dev/sde"/>
Apr 14 01:59:21 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:59:21 user nova-compute[71498]:   <serial>4c279a98-9587-47a8-a153-408cc1232415</serial>
Apr 14 01:59:21 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 01:59:21 user nova-compute[71498]: </disk>
Apr 14 01:59:21 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:59:22 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Successfully detached device vdb from instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 from the persistent domain config.
Apr 14 01:59:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 from the live domain config. {{(pid=71498) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 01:59:22 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:59:22 user nova-compute[71498]:   <source dev="/dev/sde"/>
Apr 14 01:59:22 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:59:22 user nova-compute[71498]:   <serial>4c279a98-9587-47a8-a153-408cc1232415</serial>
Apr 14 01:59:22 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 01:59:22 user nova-compute[71498]: </disk>
Apr 14 01:59:22 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG nova.network.neutron [req-88acb611-3ea1-48f6-899f-812399c3ac16 req-5b23378e-dc79-4076-8dcc-cf597d03777b service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Updated VIF entry in instance network info cache for port 69ad9be5-f12b-4f3b-8a10-1e4c5f09264d. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG nova.network.neutron [req-88acb611-3ea1-48f6-899f-812399c3ac16 req-5b23378e-dc79-4076-8dcc-cf597d03777b service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Updating instance_info_cache with network_info: [{"id": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "address": "fa:16:3e:84:32:3a", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ad9be5-f1", "ovs_interfaceid": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-88acb611-3ea1-48f6-899f-812399c3ac16 req-5b23378e-dc79-4076-8dcc-cf597d03777b service nova] Releasing lock "refresh_cache-92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Received event <DeviceRemovedEvent: 1681437562.4425128, 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71498) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 {{(pid=71498) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 01:59:22 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Successfully detached device vdb from instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 from the live domain config.
Apr 14 01:59:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oHhbCuAY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:59:22 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:59:22 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bb6fc9-471f-4091-ab20-1d164c4a0d13]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:59:22 user nova-compute[71498]: No targets found.
Apr 14 01:59:22 user nova-compute[71498]: iSNS:
Apr 14 01:59:22 user nova-compute[71498]: No targets found.
Apr 14 01:59:22 user nova-compute[71498]: STATIC:
Apr 14 01:59:22 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25
Apr 14 01:59:22 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:59:22 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:59:22 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860
Apr 14 01:59:22 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:59:22 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:59:22 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415
Apr 14 01:59:22 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:59:22 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:59:22 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22
Apr 14 01:59:22 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:59:22 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:59:22 user nova-compute[71498]: FIRMWARE:
Apr 14 01:59:22 user nova-compute[71498]: No targets found.
Apr 14 01:59:22 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:59:22 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:59:22 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf2b2fa-f343-4170-905f-0cae5f1ad170]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0515c3c7-0315-4589-8191-38689417e53a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:59:22 user nova-compute[71498]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)
Apr 14 01:59:22 user nova-compute[71498]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:59:22 user nova-compute[71498]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 (non-flash)
Apr 14 01:59:22 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:59:22 user nova-compute[71498]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 (non-flash)
Apr 14 01:59:22 user nova-compute[71498]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:59:22 user nova-compute[71498]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 (non-flash)
Apr 14 01:59:22 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51f42adea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415'): ({'sde'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Removing single pathed devices sde {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bfcc63-d623-4bfe-9fcb-cf57861e19ae]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[79570f68-bd6f-4649-a3ee-63c59f620501]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Flushing IO for device /dev/sde {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[418ccaee-c137-4307-9d10-343406822f88]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[de683411-cca9-47cf-8d80-8f522c0b557c]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] SCSI volumes sde have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf73c0b-030a-417e-9610-6bc1fdc43e19]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a930a9c7-5fc6-4804-b470-0cd3a8ae32b2]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415, portal: 172.16.0.220,3260]
Apr 14 01:59:22 user nova-compute[71498]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415, portal: 172.16.0.220,3260] successful.
Apr 14 01:59:22 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c279a98-9587-47a8-a153-408cc1232415 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec3ceff-126f-4623-a22c-113aee6c6af0]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] <== disconnect_volume: return (308ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:59:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:59:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:23 user nova-compute[71498]: DEBUG nova.objects.instance [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'flavor' on Instance uuid 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:59:23 user nova-compute[71498]: DEBUG nova.compute.manager [req-246a8983-1f91-484a-9587-f95a4e4ed409 req-28cad9a6-ddd1-471e-a1a6-a40098d7d526 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received event network-changed-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:59:23 user nova-compute[71498]: DEBUG nova.compute.manager [req-246a8983-1f91-484a-9587-f95a4e4ed409 req-28cad9a6-ddd1-471e-a1a6-a40098d7d526 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Refreshing instance network info cache due to event network-changed-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:59:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-246a8983-1f91-484a-9587-f95a4e4ed409 req-28cad9a6-ddd1-471e-a1a6-a40098d7d526 service nova] Acquiring lock "refresh_cache-92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:59:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-246a8983-1f91-484a-9587-f95a4e4ed409 req-28cad9a6-ddd1-471e-a1a6-a40098d7d526 service nova] Acquired lock "refresh_cache-92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:59:23 user nova-compute[71498]: DEBUG nova.network.neutron [req-246a8983-1f91-484a-9587-f95a4e4ed409 req-28cad9a6-ddd1-471e-a1a6-a40098d7d526 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Refreshing network info cache for port 69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:59:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-870b777b-c51c-4bcc-b4b2-196e0f58d118 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.699s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:59:24 user nova-compute[71498]: DEBUG nova.network.neutron [req-246a8983-1f91-484a-9587-f95a4e4ed409 req-28cad9a6-ddd1-471e-a1a6-a40098d7d526 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Updated VIF entry in instance network info cache for port 69ad9be5-f12b-4f3b-8a10-1e4c5f09264d. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:59:24 user nova-compute[71498]: DEBUG nova.network.neutron [req-246a8983-1f91-484a-9587-f95a4e4ed409 req-28cad9a6-ddd1-471e-a1a6-a40098d7d526 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Updating instance_info_cache with network_info: [{"id": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "address": "fa:16:3e:84:32:3a", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ad9be5-f1", "ovs_interfaceid": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:59:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-246a8983-1f91-484a-9587-f95a4e4ed409 req-28cad9a6-ddd1-471e-a1a6-a40098d7d526 service nova] Releasing lock "refresh_cache-92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:59:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:59:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:59:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:59:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:59:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:59:29 user nova-compute[71498]: INFO nova.compute.manager [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Terminating instance
Apr 14 01:59:29 user nova-compute[71498]: DEBUG nova.compute.manager [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 01:59:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:29 user nova-compute[71498]: DEBUG nova.compute.manager [req-8a5c875d-1d4d-4954-b64f-c5969bea98e7 req-f506569d-f61b-465a-8ad6-0a422b75df49 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Received event network-vif-unplugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:59:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8a5c875d-1d4d-4954-b64f-c5969bea98e7 req-f506569d-f61b-465a-8ad6-0a422b75df49 service nova] Acquiring lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:59:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8a5c875d-1d4d-4954-b64f-c5969bea98e7 req-f506569d-f61b-465a-8ad6-0a422b75df49 service nova] Lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:59:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8a5c875d-1d4d-4954-b64f-c5969bea98e7 req-f506569d-f61b-465a-8ad6-0a422b75df49 service nova] Lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:59:29 user nova-compute[71498]: DEBUG nova.compute.manager [req-8a5c875d-1d4d-4954-b64f-c5969bea98e7 req-f506569d-f61b-465a-8ad6-0a422b75df49 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] No waiting events found dispatching network-vif-unplugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:59:29 user nova-compute[71498]: DEBUG nova.compute.manager [req-8a5c875d-1d4d-4954-b64f-c5969bea98e7 req-f506569d-f61b-465a-8ad6-0a422b75df49 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Received event network-vif-unplugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:59:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:29 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Instance destroyed successfully.
Apr 14 01:59:29 user nova-compute[71498]: DEBUG nova.objects.instance [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lazy-loading 'resources' on Instance uuid 73fd9bc1-af0f-41e9-adea-d73323b4a76c {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:59:29 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:43:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2126586208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2126586208',id=14,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:45:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='219c39c8299e46368012a947fdfbe5fd',ramdisk_id='',reservation_id='r-vg1kmosh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-85797606',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:47:31Z,user_data=None,user_id='7ed01a83531f4c6bb18a4593284baf05',uuid=73fd9bc1-af0f-41e9-adea-d73323b4a76c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4146457e-4b16-4c22-afd2-ffae8a58c0c5", "address": "fa:16:3e:4c:4f:e1", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4146457e-4b", "ovs_interfaceid": "4146457e-4b16-4c22-afd2-ffae8a58c0c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:59:29 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Converting VIF {"id": "4146457e-4b16-4c22-afd2-ffae8a58c0c5", "address": "fa:16:3e:4c:4f:e1", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4146457e-4b", "ovs_interfaceid": "4146457e-4b16-4c22-afd2-ffae8a58c0c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:59:29 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:4f:e1,bridge_name='br-int',has_traffic_filtering=True,id=4146457e-4b16-4c22-afd2-ffae8a58c0c5,network=Network(365cbeec-3756-4258-a135-04112bdda4b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4146457e-4b') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:59:29 user nova-compute[71498]: DEBUG os_vif [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:4f:e1,bridge_name='br-int',has_traffic_filtering=True,id=4146457e-4b16-4c22-afd2-ffae8a58c0c5,network=Network(365cbeec-3756-4258-a135-04112bdda4b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4146457e-4b') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:59:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4146457e-4b, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:59:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:29 user nova-compute[71498]: INFO os_vif [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:4f:e1,bridge_name='br-int',has_traffic_filtering=True,id=4146457e-4b16-4c22-afd2-ffae8a58c0c5,network=Network(365cbeec-3756-4258-a135-04112bdda4b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4146457e-4b')
Apr 14 01:59:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hCwSrpEd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:59:30 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:59:30 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36f67f7-c547-4b4d-ab9f-c096cd6835c6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:59:30 user nova-compute[71498]: No targets found.
Apr 14 01:59:30 user nova-compute[71498]: iSNS:
Apr 14 01:59:30 user nova-compute[71498]: No targets found.
Apr 14 01:59:30 user nova-compute[71498]: STATIC:
Apr 14 01:59:30 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25
Apr 14 01:59:30 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:59:30 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:59:30 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860
Apr 14 01:59:30 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:59:30 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:59:30 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22
Apr 14 01:59:30 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:59:30 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:59:30 user nova-compute[71498]: FIRMWARE:
Apr 14 01:59:30 user nova-compute[71498]: No targets found.
Apr 14 01:59:30 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:59:30 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:59:30 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd11aad7-44d7-49a5-95ca-d12671d7ff2c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4807f5e-3a0a-4fa7-b4b7-248c62b96826]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:59:30 user nova-compute[71498]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:59:30 user nova-compute[71498]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 (non-flash)
Apr 14 01:59:30 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 (non-flash)
Apr 14 01:59:30 user nova-compute[71498]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:59:30 user nova-compute[71498]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 (non-flash)
Apr 14 01:59:30 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51f42ac9d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22'): ({'sdb'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Removing single pathed devices sdb {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f86565-9c0a-43a9-8e7f-36b18a117ae2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d76852-351d-4f63-b643-48c8f50fc619]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Flushing IO for device /dev/sdb {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[61290109-bd53-4c12-ab5e-1428f437a06e]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6723973c-6d45-4d1f-8d60-1f3648a45c7a]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] SCSI volumes sdb have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acdc87f-ca03-4703-a5ea-e47e0408b3c8]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4471ee37-ac6f-4428-bc51-7429de236a41]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22, portal: 172.16.0.220,3260]
Apr 14 01:59:30 user nova-compute[71498]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22, portal: 172.16.0.220,3260] successful.
Apr 14 01:59:30 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0856ebd5-320b-4f5a-b305-4b1a0be6fb22 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[091ec2f0-5465-4df7-8b11-7e1ca0a2cc87]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] <== disconnect_volume: return (297ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:59:30 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Deleting instance files /opt/stack/data/nova/instances/73fd9bc1-af0f-41e9-adea-d73323b4a76c_del
Apr 14 01:59:30 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Deletion of /opt/stack/data/nova/instances/73fd9bc1-af0f-41e9-adea-d73323b4a76c_del complete
Apr 14 01:59:30 user nova-compute[71498]: INFO nova.compute.manager [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Took 1.15 seconds to destroy the instance on the hypervisor.
Apr 14 01:59:30 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 01:59:30 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 01:59:31 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:59:31 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Took 0.68 seconds to deallocate network for instance.
Apr 14 01:59:31 user nova-compute[71498]: DEBUG nova.compute.manager [req-4cbf39b3-f194-4988-9992-92e1c2158352 req-402f94e4-55c5-4991-8077-31864e6acf09 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Received event network-vif-plugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:59:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4cbf39b3-f194-4988-9992-92e1c2158352 req-402f94e4-55c5-4991-8077-31864e6acf09 service nova] Acquiring lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:59:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4cbf39b3-f194-4988-9992-92e1c2158352 req-402f94e4-55c5-4991-8077-31864e6acf09 service nova] Lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:59:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4cbf39b3-f194-4988-9992-92e1c2158352 req-402f94e4-55c5-4991-8077-31864e6acf09 service nova] Lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:59:31 user nova-compute[71498]: DEBUG nova.compute.manager [req-4cbf39b3-f194-4988-9992-92e1c2158352 req-402f94e4-55c5-4991-8077-31864e6acf09 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] No waiting events found dispatching network-vif-plugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:59:31 user nova-compute[71498]: WARNING nova.compute.manager [req-4cbf39b3-f194-4988-9992-92e1c2158352 req-402f94e4-55c5-4991-8077-31864e6acf09 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Received unexpected event network-vif-plugged-4146457e-4b16-4c22-afd2-ffae8a58c0c5 for instance with vm_state active and task_state deleting.
Apr 14 01:59:31 user nova-compute[71498]: DEBUG nova.compute.manager [req-4cbf39b3-f194-4988-9992-92e1c2158352 req-402f94e4-55c5-4991-8077-31864e6acf09 service nova] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Received event network-vif-deleted-4146457e-4b16-4c22-afd2-ffae8a58c0c5 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:59:31 user nova-compute[71498]: INFO nova.compute.manager [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Took 0.81 seconds to detach 1 volumes for instance.
Apr 14 01:59:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:59:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:59:32 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:59:32 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:59:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:59:32 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Deleted allocations for instance 73fd9bc1-af0f-41e9-adea-d73323b4a76c
Apr 14 01:59:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b2dca265-193f-4c8d-aad0-49bee5ebec0a tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "73fd9bc1-af0f-41e9-adea-d73323b4a76c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.225s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:59:34 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:38 user nova-compute[71498]: DEBUG nova.compute.manager [req-233c3dfd-7bdb-478f-b10c-2aba5e2cc2f5 req-edbccb05-1378-4a90-a2ae-2c132b883c89 service nova] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Received event network-changed-d66c282d-74db-42ba-96f3-faf43ebc6d98 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:59:38 user nova-compute[71498]: DEBUG nova.compute.manager [req-233c3dfd-7bdb-478f-b10c-2aba5e2cc2f5 req-edbccb05-1378-4a90-a2ae-2c132b883c89 service nova] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Refreshing instance network info cache due to event network-changed-d66c282d-74db-42ba-96f3-faf43ebc6d98. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:59:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-233c3dfd-7bdb-478f-b10c-2aba5e2cc2f5 req-edbccb05-1378-4a90-a2ae-2c132b883c89 service nova] Acquiring lock "refresh_cache-81666244-a2a7-4ace-969d-a3a3d0128329" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:59:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-233c3dfd-7bdb-478f-b10c-2aba5e2cc2f5 req-edbccb05-1378-4a90-a2ae-2c132b883c89 service nova] Acquired lock "refresh_cache-81666244-a2a7-4ace-969d-a3a3d0128329" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:59:38 user nova-compute[71498]: DEBUG nova.network.neutron [req-233c3dfd-7bdb-478f-b10c-2aba5e2cc2f5 req-edbccb05-1378-4a90-a2ae-2c132b883c89 service nova] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Refreshing network info cache for port d66c282d-74db-42ba-96f3-faf43ebc6d98 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:59:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:38 user nova-compute[71498]: DEBUG nova.network.neutron [req-233c3dfd-7bdb-478f-b10c-2aba5e2cc2f5 req-edbccb05-1378-4a90-a2ae-2c132b883c89 service nova] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Updated VIF entry in instance network info cache for port d66c282d-74db-42ba-96f3-faf43ebc6d98. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:59:38 user nova-compute[71498]: DEBUG nova.network.neutron [req-233c3dfd-7bdb-478f-b10c-2aba5e2cc2f5 req-edbccb05-1378-4a90-a2ae-2c132b883c89 service nova] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Updating instance_info_cache with network_info: [{"id": "d66c282d-74db-42ba-96f3-faf43ebc6d98", "address": "fa:16:3e:8a:c6:83", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd66c282d-74", "ovs_interfaceid": "d66c282d-74db-42ba-96f3-faf43ebc6d98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:59:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-233c3dfd-7bdb-478f-b10c-2aba5e2cc2f5 req-edbccb05-1378-4a90-a2ae-2c132b883c89 service nova] Releasing lock "refresh_cache-81666244-a2a7-4ace-969d-a3a3d0128329" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:59:38 user nova-compute[71498]: DEBUG nova.compute.manager [req-a751f733-f6fa-463e-93ee-82fb8f303e2d req-b1973259-113a-4476-9d1a-c772df912a96 service nova] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Received event network-changed-d66c282d-74db-42ba-96f3-faf43ebc6d98 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:59:38 user nova-compute[71498]: DEBUG nova.compute.manager [req-a751f733-f6fa-463e-93ee-82fb8f303e2d req-b1973259-113a-4476-9d1a-c772df912a96 service nova] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Refreshing instance network info cache due to event network-changed-d66c282d-74db-42ba-96f3-faf43ebc6d98. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:59:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a751f733-f6fa-463e-93ee-82fb8f303e2d req-b1973259-113a-4476-9d1a-c772df912a96 service nova] Acquiring lock "refresh_cache-81666244-a2a7-4ace-969d-a3a3d0128329" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:59:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a751f733-f6fa-463e-93ee-82fb8f303e2d req-b1973259-113a-4476-9d1a-c772df912a96 service nova] Acquired lock "refresh_cache-81666244-a2a7-4ace-969d-a3a3d0128329" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:59:38 user nova-compute[71498]: DEBUG nova.network.neutron [req-a751f733-f6fa-463e-93ee-82fb8f303e2d req-b1973259-113a-4476-9d1a-c772df912a96 service nova] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Refreshing network info cache for port d66c282d-74db-42ba-96f3-faf43ebc6d98 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:59:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "81666244-a2a7-4ace-969d-a3a3d0128329" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:59:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "81666244-a2a7-4ace-969d-a3a3d0128329" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:59:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "81666244-a2a7-4ace-969d-a3a3d0128329-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:59:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "81666244-a2a7-4ace-969d-a3a3d0128329-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:59:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "81666244-a2a7-4ace-969d-a3a3d0128329-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:59:38 user nova-compute[71498]: INFO nova.compute.manager [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Terminating instance
Apr 14 01:59:38 user nova-compute[71498]: DEBUG nova.compute.manager [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 01:59:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG nova.compute.manager [req-86c6a95e-bc96-4fd5-9eea-6ae2b8b9d0a8 req-2265e0d9-ce13-4754-975a-2703ec779926 service nova] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Received event network-vif-unplugged-d66c282d-74db-42ba-96f3-faf43ebc6d98 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-86c6a95e-bc96-4fd5-9eea-6ae2b8b9d0a8 req-2265e0d9-ce13-4754-975a-2703ec779926 service nova] Acquiring lock "81666244-a2a7-4ace-969d-a3a3d0128329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-86c6a95e-bc96-4fd5-9eea-6ae2b8b9d0a8 req-2265e0d9-ce13-4754-975a-2703ec779926 service nova] Lock "81666244-a2a7-4ace-969d-a3a3d0128329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-86c6a95e-bc96-4fd5-9eea-6ae2b8b9d0a8 req-2265e0d9-ce13-4754-975a-2703ec779926 service nova] Lock "81666244-a2a7-4ace-969d-a3a3d0128329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG nova.compute.manager [req-86c6a95e-bc96-4fd5-9eea-6ae2b8b9d0a8 req-2265e0d9-ce13-4754-975a-2703ec779926 service nova] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] No waiting events found dispatching network-vif-unplugged-d66c282d-74db-42ba-96f3-faf43ebc6d98 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG nova.compute.manager [req-86c6a95e-bc96-4fd5-9eea-6ae2b8b9d0a8 req-2265e0d9-ce13-4754-975a-2703ec779926 service nova] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Received event network-vif-unplugged-d66c282d-74db-42ba-96f3-faf43ebc6d98 for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG nova.network.neutron [req-a751f733-f6fa-463e-93ee-82fb8f303e2d req-b1973259-113a-4476-9d1a-c772df912a96 service nova] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Updated VIF entry in instance network info cache for port d66c282d-74db-42ba-96f3-faf43ebc6d98. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG nova.network.neutron [req-a751f733-f6fa-463e-93ee-82fb8f303e2d req-b1973259-113a-4476-9d1a-c772df912a96 service nova] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Updating instance_info_cache with network_info: [{"id": "d66c282d-74db-42ba-96f3-faf43ebc6d98", "address": "fa:16:3e:8a:c6:83", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd66c282d-74", "ovs_interfaceid": "d66c282d-74db-42ba-96f3-faf43ebc6d98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a751f733-f6fa-463e-93ee-82fb8f303e2d req-b1973259-113a-4476-9d1a-c772df912a96 service nova] Releasing lock "refresh_cache-81666244-a2a7-4ace-969d-a3a3d0128329" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:39 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Instance destroyed successfully.
Apr 14 01:59:39 user nova-compute[71498]: DEBUG nova.objects.instance [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lazy-loading 'resources' on Instance uuid 81666244-a2a7-4ace-969d-a3a3d0128329 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:57:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-999984632',display_name='tempest-TestVolumeBootPattern-server-999984632',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-999984632',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcODdjkXb9vqfJo6mLTbOXnPLP2HdwXcPxYgRVEM78ApSpFWKxeZveFravQCk22JVH3n1PXZDKAyefoGYrsPczv6zWWLW2pkXjL46/zFdGhb8s3BmOyjVZHJdx/Y2ktUg==',key_name='tempest-TestVolumeBootPattern-824995165',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:57:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1f4117a4adb4aa3b42951cf1fc84237',ramdisk_id='',reservation_id='r-h73i3big',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-224521177',owner_user_name='tempest-TestVolumeBootPattern-224521177-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:57:57Z,user_data=None,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',uuid=81666244-a2a7-4ace-969d-a3a3d0128329,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d66c282d-74db-42ba-96f3-faf43ebc6d98", "address": "fa:16:3e:8a:c6:83", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd66c282d-74", "ovs_interfaceid": "d66c282d-74db-42ba-96f3-faf43ebc6d98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converting VIF {"id": "d66c282d-74db-42ba-96f3-faf43ebc6d98", "address": "fa:16:3e:8a:c6:83", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd66c282d-74", "ovs_interfaceid": "d66c282d-74db-42ba-96f3-faf43ebc6d98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:c6:83,bridge_name='br-int',has_traffic_filtering=True,id=d66c282d-74db-42ba-96f3-faf43ebc6d98,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd66c282d-74') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG os_vif [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:c6:83,bridge_name='br-int',has_traffic_filtering=True,id=d66c282d-74db-42ba-96f3-faf43ebc6d98,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd66c282d-74') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd66c282d-74, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:59:39 user nova-compute[71498]: INFO os_vif [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:c6:83,bridge_name='br-int',has_traffic_filtering=True,id=d66c282d-74db-42ba-96f3-faf43ebc6d98,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd66c282d-74')
Apr 14 01:59:39 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QkZUoSzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:59:39 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:59:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[02591307-d52d-4fac-869d-d47cf4cffa13]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:59:39 user nova-compute[71498]: No targets found.
Apr 14 01:59:39 user nova-compute[71498]: iSNS:
Apr 14 01:59:39 user nova-compute[71498]: No targets found.
Apr 14 01:59:39 user nova-compute[71498]: STATIC:
Apr 14 01:59:39 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25
Apr 14 01:59:39 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:59:39 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:59:39 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860
Apr 14 01:59:39 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:59:39 user nova-compute[71498]:                 Iface Name: default
Apr 14 01:59:39 user nova-compute[71498]: FIRMWARE:
Apr 14 01:59:39 user nova-compute[71498]: No targets found.
Apr 14 01:59:39 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:59:39 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:59:39 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2917427f-46ae-441e-a4ad-bde675f74c36]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2f0ef2-1c5d-4b70-8002-3adead937fa7]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:59:39 user nova-compute[71498]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 (non-flash)
Apr 14 01:59:39 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 01:59:39 user nova-compute[71498]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 (non-flash)
Apr 14 01:59:39 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51e42381f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25'): ({'sdc'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Removing single pathed devices sdc {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6dd284-870b-4625-ad80-6282ce511935]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba81eba-d581-40c0-aa90-29633af8a560]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Flushing IO for device /dev/sdc {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b01785-b1cb-4ba1-b421-745cb6a9dbe5]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c91515b-042d-462d-9692-a8e7ac3e579a]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] SCSI volumes sdc have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1687b828-90c7-4f8d-abc2-0b1d9320e182]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[128c5607-ba7e-4f08-80eb-c7acd67a3158]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25, portal: 172.16.0.220,3260]
Apr 14 01:59:39 user nova-compute[71498]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25, portal: 172.16.0.220,3260] successful.
Apr 14 01:59:39 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd2a58c4-4fc8-4aca-8654-ae325aec4e25 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81e127d-6131-47ec-9bda-fb98a5734af5]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] <== disconnect_volume: return (310ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:59:39 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:59:39 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Deleting instance files /opt/stack/data/nova/instances/81666244-a2a7-4ace-969d-a3a3d0128329_del
Apr 14 01:59:39 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Deletion of /opt/stack/data/nova/instances/81666244-a2a7-4ace-969d-a3a3d0128329_del complete
Apr 14 01:59:40 user nova-compute[71498]: INFO nova.compute.manager [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Took 1.16 seconds to destroy the instance on the hypervisor.
Apr 14 01:59:40 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 01:59:40 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 01:59:40 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 01:59:40 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:59:40 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Took 0.47 seconds to deallocate network for instance.
Apr 14 01:59:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-78af1c48-1572-4466-ba70-8e42a2137231 req-e0ef14b0-de73-4118-ab39-770a593bd899 service nova] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Received event network-vif-deleted-d66c282d-74db-42ba-96f3-faf43ebc6d98 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:59:40 user nova-compute[71498]: INFO nova.compute.manager [req-78af1c48-1572-4466-ba70-8e42a2137231 req-e0ef14b0-de73-4118-ab39-770a593bd899 service nova] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Neutron deleted interface d66c282d-74db-42ba-96f3-faf43ebc6d98; detaching it from the instance and deleting it from the info cache
Apr 14 01:59:40 user nova-compute[71498]: DEBUG nova.network.neutron [req-78af1c48-1572-4466-ba70-8e42a2137231 req-e0ef14b0-de73-4118-ab39-770a593bd899 service nova] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:59:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-78af1c48-1572-4466-ba70-8e42a2137231 req-e0ef14b0-de73-4118-ab39-770a593bd899 service nova] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Detach interface failed, port_id=d66c282d-74db-42ba-96f3-faf43ebc6d98, reason: Instance 81666244-a2a7-4ace-969d-a3a3d0128329 could not be found. {{(pid=71498) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 01:59:41 user nova-compute[71498]: DEBUG nova.compute.manager [req-25752ab5-ac3c-461d-a9fa-871e2827f850 req-0659bb3d-4c0c-4bd5-91a9-fff8bf6e1068 service nova] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Received event network-vif-plugged-d66c282d-74db-42ba-96f3-faf43ebc6d98 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:59:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-25752ab5-ac3c-461d-a9fa-871e2827f850 req-0659bb3d-4c0c-4bd5-91a9-fff8bf6e1068 service nova] Acquiring lock "81666244-a2a7-4ace-969d-a3a3d0128329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:59:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-25752ab5-ac3c-461d-a9fa-871e2827f850 req-0659bb3d-4c0c-4bd5-91a9-fff8bf6e1068 service nova] Lock "81666244-a2a7-4ace-969d-a3a3d0128329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:59:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-25752ab5-ac3c-461d-a9fa-871e2827f850 req-0659bb3d-4c0c-4bd5-91a9-fff8bf6e1068 service nova] Lock "81666244-a2a7-4ace-969d-a3a3d0128329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:59:41 user nova-compute[71498]: DEBUG nova.compute.manager [req-25752ab5-ac3c-461d-a9fa-871e2827f850 req-0659bb3d-4c0c-4bd5-91a9-fff8bf6e1068 service nova] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] No waiting events found dispatching network-vif-plugged-d66c282d-74db-42ba-96f3-faf43ebc6d98 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:59:41 user nova-compute[71498]: WARNING nova.compute.manager [req-25752ab5-ac3c-461d-a9fa-871e2827f850 req-0659bb3d-4c0c-4bd5-91a9-fff8bf6e1068 service nova] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Received unexpected event network-vif-plugged-d66c282d-74db-42ba-96f3-faf43ebc6d98 for instance with vm_state active and task_state deleting.
Apr 14 01:59:41 user nova-compute[71498]: INFO nova.compute.manager [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Took 0.75 seconds to detach 1 volumes for instance.
Apr 14 01:59:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:59:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:59:41 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:59:41 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:59:41 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:59:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:59:41 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Deleted allocations for instance 81666244-a2a7-4ace-969d-a3a3d0128329
Apr 14 01:59:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-146f2c29-1a6d-499d-ba24-d160713b5d55 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "81666244-a2a7-4ace-969d-a3a3d0128329" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.798s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:59:42 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:59:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 01:59:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Didn't find any instances for network info cache update. {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 01:59:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:43 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:59:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:59:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:59:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:59:43 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 01:59:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:43 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json" returned: 0 in 0.129s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:44 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:44 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681437569.957878, 73fd9bc1-af0f-41e9-adea-d73323b4a76c => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:59:44 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] VM Stopped (Lifecycle Event)
Apr 14 01:59:44 user nova-compute[71498]: DEBUG nova.compute.manager [None req-cb76f638-a408-44e1-8e7b-8ca50476c503 None None] [instance: 73fd9bc1-af0f-41e9-adea-d73323b4a76c] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:59:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:45 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 01:59:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:45 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:59:45 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:59:45 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=8209MB free_disk=26.204975128173828GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 01:59:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:59:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:59:45 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:59:45 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance a19a1c08-5454-481b-bb5a-70c39ead9afc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:59:45 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance fa29c144-0ff9-4efb-a574-f521d18f08fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:59:45 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 85b399dc-62df-480d-8561-5d9d1ab75c52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:59:45 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:59:45 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 618f5f0d-3594-41dd-9d8f-0c7bea255a3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:59:45 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 01:59:45 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 01:59:46 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:59:46 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:59:46 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 01:59:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.338s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:59:47 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:59:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "5ba29111-1e9b-4947-b046-6bbe888eca06" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:59:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "5ba29111-1e9b-4947-b046-6bbe888eca06" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:59:48 user nova-compute[71498]: DEBUG nova.compute.manager [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 01:59:48 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:59:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:59:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:59:48 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:59:48 user nova-compute[71498]: INFO nova.compute.claims [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Claim successful on node user
Apr 14 01:59:48 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:59:48 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:59:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.311s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:59:48 user nova-compute[71498]: DEBUG nova.compute.manager [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 01:59:48 user nova-compute[71498]: DEBUG nova.compute.manager [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 01:59:48 user nova-compute[71498]: DEBUG nova.network.neutron [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:59:48 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 01:59:48 user nova-compute[71498]: DEBUG nova.compute.manager [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 01:59:48 user nova-compute[71498]: DEBUG nova.policy [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:59:48 user nova-compute[71498]: DEBUG nova.compute.manager [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 01:59:48 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:59:48 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Creating image(s)
Apr 14 01:59:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "/opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:59:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "/opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:59:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "/opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:59:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.131s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:59:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:59:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.147s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk 1073741824" returned: 0 in 0.057s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:59:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:49 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:59:49 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:59:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.150s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:49 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 01:59:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:59:49 user nova-compute[71498]: DEBUG nova.network.neutron [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Successfully created port: 5b8a0a31-9ecf-4b31-a458-778005d846f4 {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:59:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:59:49 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Cannot resize image /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 01:59:49 user nova-compute[71498]: DEBUG nova.objects.instance [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lazy-loading 'migration_context' on Instance uuid 5ba29111-1e9b-4947-b046-6bbe888eca06 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:59:49 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 01:59:49 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Ensure instance console log exists: /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:59:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:59:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:59:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:59:49 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG nova.network.neutron [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Successfully updated port: 5b8a0a31-9ecf-4b31-a458-778005d846f4 {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "refresh_cache-5ba29111-1e9b-4947-b046-6bbe888eca06" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquired lock "refresh_cache-5ba29111-1e9b-4947-b046-6bbe888eca06" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG nova.network.neutron [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG nova.compute.manager [req-3fab39f5-7709-455d-83f3-e55d27e2bf9c req-5e4e0799-4fb1-408f-bdc6-ab9ba0d76f53 service nova] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Received event network-changed-5b8a0a31-9ecf-4b31-a458-778005d846f4 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG nova.compute.manager [req-3fab39f5-7709-455d-83f3-e55d27e2bf9c req-5e4e0799-4fb1-408f-bdc6-ab9ba0d76f53 service nova] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Refreshing instance network info cache due to event network-changed-5b8a0a31-9ecf-4b31-a458-778005d846f4. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3fab39f5-7709-455d-83f3-e55d27e2bf9c req-5e4e0799-4fb1-408f-bdc6-ab9ba0d76f53 service nova] Acquiring lock "refresh_cache-5ba29111-1e9b-4947-b046-6bbe888eca06" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG nova.network.neutron [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG nova.network.neutron [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Updating instance_info_cache with network_info: [{"id": "5b8a0a31-9ecf-4b31-a458-778005d846f4", "address": "fa:16:3e:90:92:14", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8a0a31-9e", "ovs_interfaceid": "5b8a0a31-9ecf-4b31-a458-778005d846f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Releasing lock "refresh_cache-5ba29111-1e9b-4947-b046-6bbe888eca06" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG nova.compute.manager [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Instance network_info: |[{"id": "5b8a0a31-9ecf-4b31-a458-778005d846f4", "address": "fa:16:3e:90:92:14", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8a0a31-9e", "ovs_interfaceid": "5b8a0a31-9ecf-4b31-a458-778005d846f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3fab39f5-7709-455d-83f3-e55d27e2bf9c req-5e4e0799-4fb1-408f-bdc6-ab9ba0d76f53 service nova] Acquired lock "refresh_cache-5ba29111-1e9b-4947-b046-6bbe888eca06" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG nova.network.neutron [req-3fab39f5-7709-455d-83f3-e55d27e2bf9c req-5e4e0799-4fb1-408f-bdc6-ab9ba0d76f53 service nova] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Refreshing network info cache for port 5b8a0a31-9ecf-4b31-a458-778005d846f4 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Start _get_guest_xml network_info=[{"id": "5b8a0a31-9ecf-4b31-a458-778005d846f4", "address": "fa:16:3e:90:92:14", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8a0a31-9e", "ovs_interfaceid": "5b8a0a31-9ecf-4b31-a458-778005d846f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:59:50 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:59:50 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:59:50 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:59:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1095400783',display_name='tempest-ServerActionsTestJSON-server-1095400783',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1095400783',id=34,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7iIvlhM+wCditCRaonOriLx8WWyehY8kYxTUZ36Z1Q4VGm2JnuefQ18D+1ncnGXJXgbpg/EWHmDPRQFx9TQ2PBQ5aNgSGRUcq/Ovi+zGjOYQDNVYkQyEvsulSNtijWoQ==',key_name='tempest-keypair-165395776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ed4ed4ab2fd4c14b3e2afe343fd7256',ramdisk_id='',reservation_id='r-qvoej0va',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-2035821517',owner_user_name='tempest-ServerActionsTestJSON-2035821517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:59:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78ccd1a1ec1b486981d850881734fe02',uuid=5ba29111-1e9b-4947-b046-6bbe888eca06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b8a0a31-9ecf-4b31-a458-778005d846f4", "address": "fa:16:3e:90:92:14", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8a0a31-9e", "ovs_interfaceid": "5b8a0a31-9ecf-4b31-a458-778005d846f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converting VIF {"id": "5b8a0a31-9ecf-4b31-a458-778005d846f4", "address": "fa:16:3e:90:92:14", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8a0a31-9e", "ovs_interfaceid": "5b8a0a31-9ecf-4b31-a458-778005d846f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:92:14,bridge_name='br-int',has_traffic_filtering=True,id=5b8a0a31-9ecf-4b31-a458-778005d846f4,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b8a0a31-9e') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG nova.objects.instance [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ba29111-1e9b-4947-b046-6bbe888eca06 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:59:50 user nova-compute[71498]:   <uuid>5ba29111-1e9b-4947-b046-6bbe888eca06</uuid>
Apr 14 01:59:50 user nova-compute[71498]:   <name>instance-00000022</name>
Apr 14 01:59:50 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 01:59:50 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 01:59:50 user nova-compute[71498]:   <metadata>
Apr 14 01:59:50 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:59:50 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 01:59:50 user nova-compute[71498]:       <nova:name>tempest-ServerActionsTestJSON-server-1095400783</nova:name>
Apr 14 01:59:50 user nova-compute[71498]:       <nova:creationTime>2023-04-14 01:59:50</nova:creationTime>
Apr 14 01:59:50 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 01:59:50 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 01:59:50 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 01:59:50 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 01:59:50 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:59:50 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:59:50 user nova-compute[71498]:       </nova:flavor>
Apr 14 01:59:50 user nova-compute[71498]:       <nova:owner>
Apr 14 01:59:50 user nova-compute[71498]:         <nova:user uuid="78ccd1a1ec1b486981d850881734fe02">tempest-ServerActionsTestJSON-2035821517-project-member</nova:user>
Apr 14 01:59:50 user nova-compute[71498]:         <nova:project uuid="2ed4ed4ab2fd4c14b3e2afe343fd7256">tempest-ServerActionsTestJSON-2035821517</nova:project>
Apr 14 01:59:50 user nova-compute[71498]:       </nova:owner>
Apr 14 01:59:50 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 01:59:50 user nova-compute[71498]:       <nova:ports>
Apr 14 01:59:50 user nova-compute[71498]:         <nova:port uuid="5b8a0a31-9ecf-4b31-a458-778005d846f4">
Apr 14 01:59:50 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 01:59:50 user nova-compute[71498]:         </nova:port>
Apr 14 01:59:50 user nova-compute[71498]:       </nova:ports>
Apr 14 01:59:50 user nova-compute[71498]:     </nova:instance>
Apr 14 01:59:50 user nova-compute[71498]:   </metadata>
Apr 14 01:59:50 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 01:59:50 user nova-compute[71498]:     <system>
Apr 14 01:59:50 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:59:50 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:59:50 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 01:59:50 user nova-compute[71498]:       <entry name="serial">5ba29111-1e9b-4947-b046-6bbe888eca06</entry>
Apr 14 01:59:50 user nova-compute[71498]:       <entry name="uuid">5ba29111-1e9b-4947-b046-6bbe888eca06</entry>
Apr 14 01:59:50 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:59:50 user nova-compute[71498]:     </system>
Apr 14 01:59:50 user nova-compute[71498]:   </sysinfo>
Apr 14 01:59:50 user nova-compute[71498]:   <os>
Apr 14 01:59:50 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:59:50 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 01:59:50 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 01:59:50 user nova-compute[71498]:   </os>
Apr 14 01:59:50 user nova-compute[71498]:   <features>
Apr 14 01:59:50 user nova-compute[71498]:     <acpi/>
Apr 14 01:59:50 user nova-compute[71498]:     <apic/>
Apr 14 01:59:50 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 01:59:50 user nova-compute[71498]:   </features>
Apr 14 01:59:50 user nova-compute[71498]:   <clock offset="utc">
Apr 14 01:59:50 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:59:50 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:59:50 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 01:59:50 user nova-compute[71498]:   </clock>
Apr 14 01:59:50 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 01:59:50 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 01:59:50 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:59:50 user nova-compute[71498]:   </cpu>
Apr 14 01:59:50 user nova-compute[71498]:   <devices>
Apr 14 01:59:50 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 01:59:50 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:59:50 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk"/>
Apr 14 01:59:50 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 01:59:50 user nova-compute[71498]:     </disk>
Apr 14 01:59:50 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 01:59:50 user nova-compute[71498]:       <mac address="fa:16:3e:90:92:14"/>
Apr 14 01:59:50 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:59:50 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 01:59:50 user nova-compute[71498]:       <target dev="tap5b8a0a31-9e"/>
Apr 14 01:59:50 user nova-compute[71498]:     </interface>
Apr 14 01:59:50 user nova-compute[71498]:     <serial type="pty">
Apr 14 01:59:50 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/console.log" append="off"/>
Apr 14 01:59:50 user nova-compute[71498]:     </serial>
Apr 14 01:59:50 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:59:50 user nova-compute[71498]:     <video>
Apr 14 01:59:50 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 01:59:50 user nova-compute[71498]:     </video>
Apr 14 01:59:50 user nova-compute[71498]:     <rng model="virtio">
Apr 14 01:59:50 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:59:50 user nova-compute[71498]:     </rng>
Apr 14 01:59:50 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:59:50 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 01:59:50 user nova-compute[71498]:       <stats period="10"/>
Apr 14 01:59:50 user nova-compute[71498]:     </memballoon>
Apr 14 01:59:50 user nova-compute[71498]:   </devices>
Apr 14 01:59:50 user nova-compute[71498]: </domain>
Apr 14 01:59:50 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:59:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1095400783',display_name='tempest-ServerActionsTestJSON-server-1095400783',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1095400783',id=34,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7iIvlhM+wCditCRaonOriLx8WWyehY8kYxTUZ36Z1Q4VGm2JnuefQ18D+1ncnGXJXgbpg/EWHmDPRQFx9TQ2PBQ5aNgSGRUcq/Ovi+zGjOYQDNVYkQyEvsulSNtijWoQ==',key_name='tempest-keypair-165395776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ed4ed4ab2fd4c14b3e2afe343fd7256',ramdisk_id='',reservation_id='r-qvoej0va',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-2035821517',owner_user_name='tempest-ServerActionsTestJSON-2035821517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:59:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78ccd1a1ec1b486981d850881734fe02',uuid=5ba29111-1e9b-4947-b046-6bbe888eca06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b8a0a31-9ecf-4b31-a458-778005d846f4", "address": "fa:16:3e:90:92:14", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8a0a31-9e", "ovs_interfaceid": "5b8a0a31-9ecf-4b31-a458-778005d846f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converting VIF {"id": "5b8a0a31-9ecf-4b31-a458-778005d846f4", "address": "fa:16:3e:90:92:14", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8a0a31-9e", "ovs_interfaceid": "5b8a0a31-9ecf-4b31-a458-778005d846f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:92:14,bridge_name='br-int',has_traffic_filtering=True,id=5b8a0a31-9ecf-4b31-a458-778005d846f4,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b8a0a31-9e') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG os_vif [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:92:14,bridge_name='br-int',has_traffic_filtering=True,id=5b8a0a31-9ecf-4b31-a458-778005d846f4,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b8a0a31-9e') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b8a0a31-9e, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5b8a0a31-9e, col_values=(('external_ids', {'iface-id': '5b8a0a31-9ecf-4b31-a458-778005d846f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:92:14', 'vm-uuid': '5ba29111-1e9b-4947-b046-6bbe888eca06'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:50 user nova-compute[71498]: INFO os_vif [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:92:14,bridge_name='br-int',has_traffic_filtering=True,id=5b8a0a31-9ecf-4b31-a458-778005d846f4,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b8a0a31-9e')
Apr 14 01:59:50 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:59:50 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] No VIF found with MAC fa:16:3e:90:92:14, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:59:51 user nova-compute[71498]: DEBUG nova.network.neutron [req-3fab39f5-7709-455d-83f3-e55d27e2bf9c req-5e4e0799-4fb1-408f-bdc6-ab9ba0d76f53 service nova] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Updated VIF entry in instance network info cache for port 5b8a0a31-9ecf-4b31-a458-778005d846f4. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:59:51 user nova-compute[71498]: DEBUG nova.network.neutron [req-3fab39f5-7709-455d-83f3-e55d27e2bf9c req-5e4e0799-4fb1-408f-bdc6-ab9ba0d76f53 service nova] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Updating instance_info_cache with network_info: [{"id": "5b8a0a31-9ecf-4b31-a458-778005d846f4", "address": "fa:16:3e:90:92:14", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8a0a31-9e", "ovs_interfaceid": "5b8a0a31-9ecf-4b31-a458-778005d846f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:59:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3fab39f5-7709-455d-83f3-e55d27e2bf9c req-5e4e0799-4fb1-408f-bdc6-ab9ba0d76f53 service nova] Releasing lock "refresh_cache-5ba29111-1e9b-4947-b046-6bbe888eca06" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:59:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:52 user nova-compute[71498]: DEBUG nova.compute.manager [req-4215367c-d9ef-4442-a19c-e92e5d6a5f40 req-361f7c94-0c8c-4164-a898-34d7dd00621c service nova] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Received event network-vif-plugged-5b8a0a31-9ecf-4b31-a458-778005d846f4 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:59:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4215367c-d9ef-4442-a19c-e92e5d6a5f40 req-361f7c94-0c8c-4164-a898-34d7dd00621c service nova] Acquiring lock "5ba29111-1e9b-4947-b046-6bbe888eca06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:59:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4215367c-d9ef-4442-a19c-e92e5d6a5f40 req-361f7c94-0c8c-4164-a898-34d7dd00621c service nova] Lock "5ba29111-1e9b-4947-b046-6bbe888eca06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:59:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4215367c-d9ef-4442-a19c-e92e5d6a5f40 req-361f7c94-0c8c-4164-a898-34d7dd00621c service nova] Lock "5ba29111-1e9b-4947-b046-6bbe888eca06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:59:52 user nova-compute[71498]: DEBUG nova.compute.manager [req-4215367c-d9ef-4442-a19c-e92e5d6a5f40 req-361f7c94-0c8c-4164-a898-34d7dd00621c service nova] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] No waiting events found dispatching network-vif-plugged-5b8a0a31-9ecf-4b31-a458-778005d846f4 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:59:52 user nova-compute[71498]: WARNING nova.compute.manager [req-4215367c-d9ef-4442-a19c-e92e5d6a5f40 req-361f7c94-0c8c-4164-a898-34d7dd00621c service nova] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Received unexpected event network-vif-plugged-5b8a0a31-9ecf-4b31-a458-778005d846f4 for instance with vm_state building and task_state spawning.
Apr 14 01:59:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:54 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437594.195088, 5ba29111-1e9b-4947-b046-6bbe888eca06 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:59:54 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] VM Resumed (Lifecycle Event)
Apr 14 01:59:54 user nova-compute[71498]: DEBUG nova.compute.manager [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:59:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:59:54 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Instance spawned successfully.
Apr 14 01:59:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:59:54 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:59:54 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:59:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:59:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:59:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:59:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:59:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:59:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:59:54 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:59:54 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437594.195452, 5ba29111-1e9b-4947-b046-6bbe888eca06 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:59:54 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] VM Started (Lifecycle Event)
Apr 14 01:59:54 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:59:54 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:59:54 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:59:54 user nova-compute[71498]: INFO nova.compute.manager [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Took 5.35 seconds to spawn the instance on the hypervisor.
Apr 14 01:59:54 user nova-compute[71498]: DEBUG nova.compute.manager [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:59:54 user nova-compute[71498]: INFO nova.compute.manager [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Took 5.99 seconds to build instance.
Apr 14 01:59:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-71945f39-f333-4550-a40c-75f2a3acb216 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "5ba29111-1e9b-4947-b046-6bbe888eca06" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.086s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:59:54 user nova-compute[71498]: DEBUG nova.compute.manager [req-8c39a9f9-8870-48a3-ab01-94fea17048af req-036677bb-777e-424b-8cd1-267e71850fd4 service nova] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Received event network-vif-plugged-5b8a0a31-9ecf-4b31-a458-778005d846f4 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:59:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8c39a9f9-8870-48a3-ab01-94fea17048af req-036677bb-777e-424b-8cd1-267e71850fd4 service nova] Acquiring lock "5ba29111-1e9b-4947-b046-6bbe888eca06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:59:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8c39a9f9-8870-48a3-ab01-94fea17048af req-036677bb-777e-424b-8cd1-267e71850fd4 service nova] Lock "5ba29111-1e9b-4947-b046-6bbe888eca06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:59:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8c39a9f9-8870-48a3-ab01-94fea17048af req-036677bb-777e-424b-8cd1-267e71850fd4 service nova] Lock "5ba29111-1e9b-4947-b046-6bbe888eca06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:59:54 user nova-compute[71498]: DEBUG nova.compute.manager [req-8c39a9f9-8870-48a3-ab01-94fea17048af req-036677bb-777e-424b-8cd1-267e71850fd4 service nova] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] No waiting events found dispatching network-vif-plugged-5b8a0a31-9ecf-4b31-a458-778005d846f4 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:59:54 user nova-compute[71498]: WARNING nova.compute.manager [req-8c39a9f9-8870-48a3-ab01-94fea17048af req-036677bb-777e-424b-8cd1-267e71850fd4 service nova] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Received unexpected event network-vif-plugged-5b8a0a31-9ecf-4b31-a458-778005d846f4 for instance with vm_state active and task_state None.
Apr 14 01:59:54 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681437579.6301203, 81666244-a2a7-4ace-969d-a3a3d0128329 => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:59:54 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] VM Stopped (Lifecycle Event)
Apr 14 01:59:54 user nova-compute[71498]: DEBUG nova.compute.manager [None req-7b4428bb-61c0-46b0-bd91-91f5dd90c845 None None] [instance: 81666244-a2a7-4ace-969d-a3a3d0128329] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:59:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:59:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:00 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0ca65bf5-4609-4515-9605-7306e06851d1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "85b399dc-62df-480d-8561-5d9d1ab75c52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0ca65bf5-4609-4515-9605-7306e06851d1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0ca65bf5-4609-4515-9605-7306e06851d1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0ca65bf5-4609-4515-9605-7306e06851d1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0ca65bf5-4609-4515-9605-7306e06851d1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:00:01 user nova-compute[71498]: INFO nova.compute.manager [None req-0ca65bf5-4609-4515-9605-7306e06851d1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Terminating instance
Apr 14 02:00:01 user nova-compute[71498]: DEBUG nova.compute.manager [None req-0ca65bf5-4609-4515-9605-7306e06851d1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 02:00:01 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:01 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:01 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:01 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:01 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Instance destroyed successfully.
Apr 14 02:00:01 user nova-compute[71498]: DEBUG nova.objects.instance [None req-0ca65bf5-4609-4515-9605-7306e06851d1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'resources' on Instance uuid 85b399dc-62df-480d-8561-5d9d1ab75c52 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:00:01 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-0ca65bf5-4609-4515-9605-7306e06851d1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:50:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-325708357',display_name='tempest-AttachVolumeTestJSON-server-325708357',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-325708357',id=27,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvk+JYMt+HZ39UKnyK9XjRAYXFTfLUFV2C7qQoN4BD8jI9jpYJTV8jA9OgD5QAxdNshSqirCRpZ3xA98RiAsOOX3u/3A0BiHL6YVfgoocjrtHZ6NQNKyL6LjNBDUv8OmA==',key_name='tempest-keypair-2007571811',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:50:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f650e04d2c947498b9e7a8d002862ad',ramdisk_id='',reservation_id='r-d003i0bm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-296004410',owner_user_name='tempest-AttachVolumeTestJSON-296004410-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:58:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba0894753a074f99ab226fde0565dd28',uuid=85b399dc-62df-480d-8561-5d9d1ab75c52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "address": "fa:16:3e:c2:1d:7f", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31ffaf4-6b", "ovs_interfaceid": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 02:00:01 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-0ca65bf5-4609-4515-9605-7306e06851d1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Converting VIF {"id": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "address": "fa:16:3e:c2:1d:7f", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape31ffaf4-6b", "ovs_interfaceid": "e31ffaf4-6b2b-4099-88b5-683bc51ccfdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:00:01 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-0ca65bf5-4609-4515-9605-7306e06851d1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:1d:7f,bridge_name='br-int',has_traffic_filtering=True,id=e31ffaf4-6b2b-4099-88b5-683bc51ccfdf,network=Network(fe9d57b9-96e8-424e-8dc9-0c95f1aff03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape31ffaf4-6b') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:00:01 user nova-compute[71498]: DEBUG os_vif [None req-0ca65bf5-4609-4515-9605-7306e06851d1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:1d:7f,bridge_name='br-int',has_traffic_filtering=True,id=e31ffaf4-6b2b-4099-88b5-683bc51ccfdf,network=Network(fe9d57b9-96e8-424e-8dc9-0c95f1aff03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape31ffaf4-6b') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 02:00:01 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:01 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape31ffaf4-6b, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:00:01 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:01 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:00:01 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:02 user nova-compute[71498]: DEBUG nova.compute.manager [req-5a79a8fb-dbbf-467f-990c-52339a15c976 req-3156fece-da15-48ce-993f-e7b49ca48507 service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Received event network-vif-unplugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:00:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5a79a8fb-dbbf-467f-990c-52339a15c976 req-3156fece-da15-48ce-993f-e7b49ca48507 service nova] Acquiring lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5a79a8fb-dbbf-467f-990c-52339a15c976 req-3156fece-da15-48ce-993f-e7b49ca48507 service nova] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-5a79a8fb-dbbf-467f-990c-52339a15c976 req-3156fece-da15-48ce-993f-e7b49ca48507 service nova] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:00:02 user nova-compute[71498]: DEBUG nova.compute.manager [req-5a79a8fb-dbbf-467f-990c-52339a15c976 req-3156fece-da15-48ce-993f-e7b49ca48507 service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] No waiting events found dispatching network-vif-unplugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:00:02 user nova-compute[71498]: DEBUG nova.compute.manager [req-5a79a8fb-dbbf-467f-990c-52339a15c976 req-3156fece-da15-48ce-993f-e7b49ca48507 service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Received event network-vif-unplugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 02:00:02 user nova-compute[71498]: INFO os_vif [None req-0ca65bf5-4609-4515-9605-7306e06851d1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:1d:7f,bridge_name='br-int',has_traffic_filtering=True,id=e31ffaf4-6b2b-4099-88b5-683bc51ccfdf,network=Network(fe9d57b9-96e8-424e-8dc9-0c95f1aff03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape31ffaf4-6b')
Apr 14 02:00:02 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-0ca65bf5-4609-4515-9605-7306e06851d1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Deleting instance files /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52_del
Apr 14 02:00:02 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-0ca65bf5-4609-4515-9605-7306e06851d1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Deletion of /opt/stack/data/nova/instances/85b399dc-62df-480d-8561-5d9d1ab75c52_del complete
Apr 14 02:00:02 user nova-compute[71498]: INFO nova.compute.manager [None req-0ca65bf5-4609-4515-9605-7306e06851d1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Took 0.70 seconds to destroy the instance on the hypervisor.
Apr 14 02:00:02 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-0ca65bf5-4609-4515-9605-7306e06851d1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 02:00:02 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 02:00:02 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 02:00:02 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:00:02 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Took 0.82 seconds to deallocate network for instance.
Apr 14 02:00:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0ca65bf5-4609-4515-9605-7306e06851d1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0ca65bf5-4609-4515-9605-7306e06851d1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:03 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-0ca65bf5-4609-4515-9605-7306e06851d1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:00:03 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-0ca65bf5-4609-4515-9605-7306e06851d1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:00:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0ca65bf5-4609-4515-9605-7306e06851d1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:00:03 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-0ca65bf5-4609-4515-9605-7306e06851d1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Deleted allocations for instance 85b399dc-62df-480d-8561-5d9d1ab75c52
Apr 14 02:00:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0ca65bf5-4609-4515-9605-7306e06851d1 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.925s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:00:04 user nova-compute[71498]: DEBUG nova.compute.manager [req-0b842336-abb0-4b53-aa75-ad6bc39d8533 req-edfeaf06-852c-475f-8602-d5693c9bd80b service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Received event network-vif-plugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:00:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0b842336-abb0-4b53-aa75-ad6bc39d8533 req-edfeaf06-852c-475f-8602-d5693c9bd80b service nova] Acquiring lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0b842336-abb0-4b53-aa75-ad6bc39d8533 req-edfeaf06-852c-475f-8602-d5693c9bd80b service nova] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0b842336-abb0-4b53-aa75-ad6bc39d8533 req-edfeaf06-852c-475f-8602-d5693c9bd80b service nova] Lock "85b399dc-62df-480d-8561-5d9d1ab75c52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:00:04 user nova-compute[71498]: DEBUG nova.compute.manager [req-0b842336-abb0-4b53-aa75-ad6bc39d8533 req-edfeaf06-852c-475f-8602-d5693c9bd80b service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] No waiting events found dispatching network-vif-plugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:00:04 user nova-compute[71498]: WARNING nova.compute.manager [req-0b842336-abb0-4b53-aa75-ad6bc39d8533 req-edfeaf06-852c-475f-8602-d5693c9bd80b service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Received unexpected event network-vif-plugged-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf for instance with vm_state deleted and task_state None.
Apr 14 02:00:04 user nova-compute[71498]: DEBUG nova.compute.manager [req-0b842336-abb0-4b53-aa75-ad6bc39d8533 req-edfeaf06-852c-475f-8602-d5693c9bd80b service nova] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Received event network-vif-deleted-e31ffaf4-6b2b-4099-88b5-683bc51ccfdf {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:00:06 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8e08e673-6132-4486-b333-47707cdcbbbf tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8e08e673-6132-4486-b333-47707cdcbbbf tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8e08e673-6132-4486-b333-47707cdcbbbf tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8e08e673-6132-4486-b333-47707cdcbbbf tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8e08e673-6132-4486-b333-47707cdcbbbf tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:00:12 user nova-compute[71498]: INFO nova.compute.manager [None req-8e08e673-6132-4486-b333-47707cdcbbbf tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Terminating instance
Apr 14 02:00:12 user nova-compute[71498]: DEBUG nova.compute.manager [None req-8e08e673-6132-4486-b333-47707cdcbbbf tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 02:00:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:12 user nova-compute[71498]: DEBUG nova.compute.manager [req-f2d67dda-fe4b-4c5d-af70-059b044a69ad req-e2f17221-ef27-4eba-a64b-688318b56c3a service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received event network-vif-unplugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:00:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f2d67dda-fe4b-4c5d-af70-059b044a69ad req-e2f17221-ef27-4eba-a64b-688318b56c3a service nova] Acquiring lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f2d67dda-fe4b-4c5d-af70-059b044a69ad req-e2f17221-ef27-4eba-a64b-688318b56c3a service nova] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f2d67dda-fe4b-4c5d-af70-059b044a69ad req-e2f17221-ef27-4eba-a64b-688318b56c3a service nova] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:00:12 user nova-compute[71498]: DEBUG nova.compute.manager [req-f2d67dda-fe4b-4c5d-af70-059b044a69ad req-e2f17221-ef27-4eba-a64b-688318b56c3a service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] No waiting events found dispatching network-vif-unplugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:00:12 user nova-compute[71498]: DEBUG nova.compute.manager [req-f2d67dda-fe4b-4c5d-af70-059b044a69ad req-e2f17221-ef27-4eba-a64b-688318b56c3a service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received event network-vif-unplugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 02:00:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:13 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Instance destroyed successfully.
Apr 14 02:00:13 user nova-compute[71498]: DEBUG nova.objects.instance [None req-8e08e673-6132-4486-b333-47707cdcbbbf tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'resources' on Instance uuid 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:00:13 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-8e08e673-6132-4486-b333-47707cdcbbbf tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:53:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2091181391',display_name='tempest-ServerRescueNegativeTestJSON-server-2091181391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2091181391',id=30,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+OdZSGBEkWqqj7kuDmKwl/+l4bHkD0nIQkpmr7DuvkGkz+hkeVv46cz6D3tLWZ7TOclqa0k/xgkvW1kl0/hacLGQfyoaWAHTyjX568DZBdMmvuK27rWMMV+9zvHM6h7g==',key_name='tempest-keypair-843861517',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:55:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d3de04739384e3ea3a475fee28be3c0',ramdisk_id='',reservation_id='r-4mnwzjvx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1453869246',owner_user_name='tempest-ServerRescueNegativeTestJSON-1453869246-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:57:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eeb5f26be86e43b3b61fff98fdc83cf3',uuid=92e640b7-a222-4b2f-8d9f-7151cfc7dcc7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "address": "fa:16:3e:84:32:3a", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ad9be5-f1", "ovs_interfaceid": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 02:00:13 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8e08e673-6132-4486-b333-47707cdcbbbf tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Converting VIF {"id": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "address": "fa:16:3e:84:32:3a", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ad9be5-f1", "ovs_interfaceid": "69ad9be5-f12b-4f3b-8a10-1e4c5f09264d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:00:13 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8e08e673-6132-4486-b333-47707cdcbbbf tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:32:3a,bridge_name='br-int',has_traffic_filtering=True,id=69ad9be5-f12b-4f3b-8a10-1e4c5f09264d,network=Network(2c4fba9e-0217-4e37-af1c-065b3f0cd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69ad9be5-f1') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:00:13 user nova-compute[71498]: DEBUG os_vif [None req-8e08e673-6132-4486-b333-47707cdcbbbf tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:32:3a,bridge_name='br-int',has_traffic_filtering=True,id=69ad9be5-f12b-4f3b-8a10-1e4c5f09264d,network=Network(2c4fba9e-0217-4e37-af1c-065b3f0cd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69ad9be5-f1') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 02:00:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69ad9be5-f1, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:00:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:13 user nova-compute[71498]: INFO os_vif [None req-8e08e673-6132-4486-b333-47707cdcbbbf tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:32:3a,bridge_name='br-int',has_traffic_filtering=True,id=69ad9be5-f12b-4f3b-8a10-1e4c5f09264d,network=Network(2c4fba9e-0217-4e37-af1c-065b3f0cd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69ad9be5-f1')
Apr 14 02:00:13 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-8e08e673-6132-4486-b333-47707cdcbbbf tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Deleting instance files /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7_del
Apr 14 02:00:13 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-8e08e673-6132-4486-b333-47707cdcbbbf tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Deletion of /opt/stack/data/nova/instances/92e640b7-a222-4b2f-8d9f-7151cfc7dcc7_del complete
Apr 14 02:00:13 user nova-compute[71498]: INFO nova.compute.manager [None req-8e08e673-6132-4486-b333-47707cdcbbbf tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 14 02:00:13 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-8e08e673-6132-4486-b333-47707cdcbbbf tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 02:00:13 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 02:00:13 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 02:00:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:14 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:00:14 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Took 1.31 seconds to deallocate network for instance.
Apr 14 02:00:14 user nova-compute[71498]: DEBUG nova.compute.manager [req-50979cb5-3576-47ed-9b89-94bb11863ec0 req-44e6af88-0c21-4ecc-a7af-a436779bafb1 service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received event network-vif-deleted-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:00:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8e08e673-6132-4486-b333-47707cdcbbbf tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8e08e673-6132-4486-b333-47707cdcbbbf tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:14 user nova-compute[71498]: DEBUG nova.compute.manager [req-0af0e1df-3c51-4ce9-92f2-65352865d7f4 req-666cd916-f40c-4ce3-a92e-0cb7fb765b1d service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received event network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:00:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0af0e1df-3c51-4ce9-92f2-65352865d7f4 req-666cd916-f40c-4ce3-a92e-0cb7fb765b1d service nova] Acquiring lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0af0e1df-3c51-4ce9-92f2-65352865d7f4 req-666cd916-f40c-4ce3-a92e-0cb7fb765b1d service nova] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0af0e1df-3c51-4ce9-92f2-65352865d7f4 req-666cd916-f40c-4ce3-a92e-0cb7fb765b1d service nova] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:00:14 user nova-compute[71498]: DEBUG nova.compute.manager [req-0af0e1df-3c51-4ce9-92f2-65352865d7f4 req-666cd916-f40c-4ce3-a92e-0cb7fb765b1d service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] No waiting events found dispatching network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:00:14 user nova-compute[71498]: WARNING nova.compute.manager [req-0af0e1df-3c51-4ce9-92f2-65352865d7f4 req-666cd916-f40c-4ce3-a92e-0cb7fb765b1d service nova] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Received unexpected event network-vif-plugged-69ad9be5-f12b-4f3b-8a10-1e4c5f09264d for instance with vm_state deleted and task_state None.
Apr 14 02:00:14 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-8e08e673-6132-4486-b333-47707cdcbbbf tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:00:14 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-8e08e673-6132-4486-b333-47707cdcbbbf tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:00:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8e08e673-6132-4486-b333-47707cdcbbbf tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.241s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:00:14 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-8e08e673-6132-4486-b333-47707cdcbbbf tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Deleted allocations for instance 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7
Apr 14 02:00:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8e08e673-6132-4486-b333-47707cdcbbbf tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "92e640b7-a222-4b2f-8d9f-7151cfc7dcc7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.576s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:00:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "9152f969-e279-4182-aa0a-8534458acbca" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "9152f969-e279-4182-aa0a-8534458acbca" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:15 user nova-compute[71498]: INFO nova.compute.manager [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Unshelving
Apr 14 02:00:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:15 user nova-compute[71498]: DEBUG nova.objects.instance [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lazy-loading 'pci_requests' on Instance uuid 9152f969-e279-4182-aa0a-8534458acbca {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:00:15 user nova-compute[71498]: DEBUG nova.objects.instance [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lazy-loading 'numa_topology' on Instance uuid 9152f969-e279-4182-aa0a-8534458acbca {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:00:16 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 02:00:16 user nova-compute[71498]: INFO nova.compute.claims [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Claim successful on node user
Apr 14 02:00:16 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:00:16 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:00:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.647s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:00:16 user nova-compute[71498]: INFO nova.network.neutron [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Updating port cb0b5d20-30a0-4636-82c8-0c7637d66465 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 14 02:00:16 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681437601.9512002, 85b399dc-62df-480d-8561-5d9d1ab75c52 => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:00:16 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] VM Stopped (Lifecycle Event)
Apr 14 02:00:16 user nova-compute[71498]: DEBUG nova.compute.manager [None req-1ab7f5d8-0cba-4c16-8c22-03d7666dd2f8 None None] [instance: 85b399dc-62df-480d-8561-5d9d1ab75c52] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:00:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "refresh_cache-9152f969-e279-4182-aa0a-8534458acbca" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:00:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquired lock "refresh_cache-9152f969-e279-4182-aa0a-8534458acbca" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:00:17 user nova-compute[71498]: DEBUG nova.network.neutron [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 02:00:17 user nova-compute[71498]: DEBUG nova.compute.manager [req-9b94431e-1838-4e42-8599-f40e043555cf req-a1d38fc6-4139-45a6-b313-ad1a7806b9d7 service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Received event network-changed-cb0b5d20-30a0-4636-82c8-0c7637d66465 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:00:17 user nova-compute[71498]: DEBUG nova.compute.manager [req-9b94431e-1838-4e42-8599-f40e043555cf req-a1d38fc6-4139-45a6-b313-ad1a7806b9d7 service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Refreshing instance network info cache due to event network-changed-cb0b5d20-30a0-4636-82c8-0c7637d66465. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 02:00:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-9b94431e-1838-4e42-8599-f40e043555cf req-a1d38fc6-4139-45a6-b313-ad1a7806b9d7 service nova] Acquiring lock "refresh_cache-9152f969-e279-4182-aa0a-8534458acbca" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:00:17 user nova-compute[71498]: DEBUG nova.network.neutron [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Updating instance_info_cache with network_info: [{"id": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "address": "fa:16:3e:66:5e:af", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0b5d20-30", "ovs_interfaceid": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:00:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Releasing lock "refresh_cache-9152f969-e279-4182-aa0a-8534458acbca" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:00:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 02:00:17 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Creating image(s)
Apr 14 02:00:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "/opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "/opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "/opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:00:17 user nova-compute[71498]: DEBUG nova.objects.instance [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9152f969-e279-4182-aa0a-8534458acbca {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:00:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-9b94431e-1838-4e42-8599-f40e043555cf req-a1d38fc6-4139-45a6-b313-ad1a7806b9d7 service nova] Acquired lock "refresh_cache-9152f969-e279-4182-aa0a-8534458acbca" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:00:17 user nova-compute[71498]: DEBUG nova.network.neutron [req-9b94431e-1838-4e42-8599-f40e043555cf req-a1d38fc6-4139-45a6-b313-ad1a7806b9d7 service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Refreshing network info cache for port cb0b5d20-30a0-4636-82c8-0c7637d66465 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 02:00:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "2eef28a082da4c6b84a85500a0218354691e6469" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "2eef28a082da4c6b84a85500a0218354691e6469" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2eef28a082da4c6b84a85500a0218354691e6469.part --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:00:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2eef28a082da4c6b84a85500a0218354691e6469.part --force-share --output=json" returned: 0 in 0.139s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:00:18 user nova-compute[71498]: DEBUG nova.virt.images [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] 613b68a2-7fbe-45d8-9865-8b80ea916153 was qcow2, converting to raw {{(pid=71498) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 02:00:18 user nova-compute[71498]: DEBUG nova.privsep.utils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71498) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 02:00:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2eef28a082da4c6b84a85500a0218354691e6469.part /opt/stack/data/nova/instances/_base/2eef28a082da4c6b84a85500a0218354691e6469.converted {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:00:19 user nova-compute[71498]: DEBUG nova.network.neutron [req-9b94431e-1838-4e42-8599-f40e043555cf req-a1d38fc6-4139-45a6-b313-ad1a7806b9d7 service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Updated VIF entry in instance network info cache for port cb0b5d20-30a0-4636-82c8-0c7637d66465. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 02:00:19 user nova-compute[71498]: DEBUG nova.network.neutron [req-9b94431e-1838-4e42-8599-f40e043555cf req-a1d38fc6-4139-45a6-b313-ad1a7806b9d7 service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Updating instance_info_cache with network_info: [{"id": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "address": "fa:16:3e:66:5e:af", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0b5d20-30", "ovs_interfaceid": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:00:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-9b94431e-1838-4e42-8599-f40e043555cf req-a1d38fc6-4139-45a6-b313-ad1a7806b9d7 service nova] Releasing lock "refresh_cache-9152f969-e279-4182-aa0a-8534458acbca" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:00:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2eef28a082da4c6b84a85500a0218354691e6469.part /opt/stack/data/nova/instances/_base/2eef28a082da4c6b84a85500a0218354691e6469.converted" returned: 0 in 0.352s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:00:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2eef28a082da4c6b84a85500a0218354691e6469.converted --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:00:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2eef28a082da4c6b84a85500a0218354691e6469.converted --force-share --output=json" returned: 0 in 0.137s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:00:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "2eef28a082da4c6b84a85500a0218354691e6469" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.430s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:00:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2eef28a082da4c6b84a85500a0218354691e6469 --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:00:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2eef28a082da4c6b84a85500a0218354691e6469 --force-share --output=json" returned: 0 in 0.132s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:00:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "2eef28a082da4c6b84a85500a0218354691e6469" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "2eef28a082da4c6b84a85500a0218354691e6469" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2eef28a082da4c6b84a85500a0218354691e6469 --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:00:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2eef28a082da4c6b84a85500a0218354691e6469 --force-share --output=json" returned: 0 in 0.133s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:00:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2eef28a082da4c6b84a85500a0218354691e6469,backing_fmt=raw /opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:00:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2eef28a082da4c6b84a85500a0218354691e6469,backing_fmt=raw /opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk 1073741824" returned: 0 in 0.053s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:00:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "2eef28a082da4c6b84a85500a0218354691e6469" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:00:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2eef28a082da4c6b84a85500a0218354691e6469 --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:00:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b54c7cd7-725f-475f-9727-7ebb8df5ea60 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "8e042a42-7cc2-4d72-b7ed-2b80339f2c85" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b54c7cd7-725f-475f-9727-7ebb8df5ea60 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "8e042a42-7cc2-4d72-b7ed-2b80339f2c85" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b54c7cd7-725f-475f-9727-7ebb8df5ea60 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "8e042a42-7cc2-4d72-b7ed-2b80339f2c85-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b54c7cd7-725f-475f-9727-7ebb8df5ea60 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "8e042a42-7cc2-4d72-b7ed-2b80339f2c85-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b54c7cd7-725f-475f-9727-7ebb8df5ea60 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "8e042a42-7cc2-4d72-b7ed-2b80339f2c85-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:00:19 user nova-compute[71498]: INFO nova.compute.manager [None req-b54c7cd7-725f-475f-9727-7ebb8df5ea60 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Terminating instance
Apr 14 02:00:19 user nova-compute[71498]: DEBUG nova.compute.manager [None req-b54c7cd7-725f-475f-9727-7ebb8df5ea60 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 02:00:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2eef28a082da4c6b84a85500a0218354691e6469 --force-share --output=json" returned: 0 in 0.152s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:00:19 user nova-compute[71498]: DEBUG nova.objects.instance [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lazy-loading 'migration_context' on Instance uuid 9152f969-e279-4182-aa0a-8534458acbca {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:00:19 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:19 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Rebasing disk image.
Apr 14 02:00:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:00:19 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:20 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.147s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:00:20 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab -F raw /opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:00:20 user nova-compute[71498]: DEBUG nova.compute.manager [req-9c94dc23-9e2d-4045-ac4e-99423e3f6c74 req-d80bfc9c-123f-4f7f-840e-d794aad91162 service nova] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Received event network-vif-unplugged-ed749832-992f-44d3-8316-87f59088b737 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:00:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-9c94dc23-9e2d-4045-ac4e-99423e3f6c74 req-d80bfc9c-123f-4f7f-840e-d794aad91162 service nova] Acquiring lock "8e042a42-7cc2-4d72-b7ed-2b80339f2c85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-9c94dc23-9e2d-4045-ac4e-99423e3f6c74 req-d80bfc9c-123f-4f7f-840e-d794aad91162 service nova] Lock "8e042a42-7cc2-4d72-b7ed-2b80339f2c85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-9c94dc23-9e2d-4045-ac4e-99423e3f6c74 req-d80bfc9c-123f-4f7f-840e-d794aad91162 service nova] Lock "8e042a42-7cc2-4d72-b7ed-2b80339f2c85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:00:20 user nova-compute[71498]: DEBUG nova.compute.manager [req-9c94dc23-9e2d-4045-ac4e-99423e3f6c74 req-d80bfc9c-123f-4f7f-840e-d794aad91162 service nova] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] No waiting events found dispatching network-vif-unplugged-ed749832-992f-44d3-8316-87f59088b737 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:00:20 user nova-compute[71498]: DEBUG nova.compute.manager [req-9c94dc23-9e2d-4045-ac4e-99423e3f6c74 req-d80bfc9c-123f-4f7f-840e-d794aad91162 service nova] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Received event network-vif-unplugged-ed749832-992f-44d3-8316-87f59088b737 for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 02:00:20 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Instance destroyed successfully.
Apr 14 02:00:20 user nova-compute[71498]: DEBUG nova.objects.instance [None req-b54c7cd7-725f-475f-9727-7ebb8df5ea60 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lazy-loading 'resources' on Instance uuid 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:00:20 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-b54c7cd7-725f-475f-9727-7ebb8df5ea60 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:40:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2013173860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2013173860',id=2,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:41:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='219c39c8299e46368012a947fdfbe5fd',ramdisk_id='',reservation_id='r-zu419vy4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-85797606',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:42:41Z,user_data=None,user_id='7ed01a83531f4c6bb18a4593284baf05',uuid=8e042a42-7cc2-4d72-b7ed-2b80339f2c85,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed749832-992f-44d3-8316-87f59088b737", "address": "fa:16:3e:98:9d:2e", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped749832-99", "ovs_interfaceid": "ed749832-992f-44d3-8316-87f59088b737", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 02:00:20 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-b54c7cd7-725f-475f-9727-7ebb8df5ea60 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Converting VIF {"id": "ed749832-992f-44d3-8316-87f59088b737", "address": "fa:16:3e:98:9d:2e", "network": {"id": "365cbeec-3756-4258-a135-04112bdda4b4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1460759683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219c39c8299e46368012a947fdfbe5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped749832-99", "ovs_interfaceid": "ed749832-992f-44d3-8316-87f59088b737", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:00:20 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-b54c7cd7-725f-475f-9727-7ebb8df5ea60 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:9d:2e,bridge_name='br-int',has_traffic_filtering=True,id=ed749832-992f-44d3-8316-87f59088b737,network=Network(365cbeec-3756-4258-a135-04112bdda4b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped749832-99') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:00:20 user nova-compute[71498]: DEBUG os_vif [None req-b54c7cd7-725f-475f-9727-7ebb8df5ea60 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:9d:2e,bridge_name='br-int',has_traffic_filtering=True,id=ed749832-992f-44d3-8316-87f59088b737,network=Network(365cbeec-3756-4258-a135-04112bdda4b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped749832-99') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 02:00:20 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:20 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped749832-99, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:00:20 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:00:20 user nova-compute[71498]: INFO os_vif [None req-b54c7cd7-725f-475f-9727-7ebb8df5ea60 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:9d:2e,bridge_name='br-int',has_traffic_filtering=True,id=ed749832-992f-44d3-8316-87f59088b737,network=Network(365cbeec-3756-4258-a135-04112bdda4b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped749832-99')
Apr 14 02:00:20 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-b54c7cd7-725f-475f-9727-7ebb8df5ea60 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Deleting instance files /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85_del
Apr 14 02:00:20 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-b54c7cd7-725f-475f-9727-7ebb8df5ea60 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Deletion of /opt/stack/data/nova/instances/8e042a42-7cc2-4d72-b7ed-2b80339f2c85_del complete
Apr 14 02:00:20 user nova-compute[71498]: INFO nova.compute.manager [None req-b54c7cd7-725f-475f-9727-7ebb8df5ea60 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Took 0.71 seconds to destroy the instance on the hypervisor.
Apr 14 02:00:20 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-b54c7cd7-725f-475f-9727-7ebb8df5ea60 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 02:00:20 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 02:00:20 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 02:00:21 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:00:21 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Took 0.58 seconds to deallocate network for instance.
Apr 14 02:00:21 user nova-compute[71498]: DEBUG nova.compute.manager [req-150c32c9-272a-4ac6-9793-cf1e5f016156 req-fb366236-bb4d-4704-b157-e104b8391a50 service nova] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Received event network-vif-deleted-ed749832-992f-44d3-8316-87f59088b737 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:00:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b54c7cd7-725f-475f-9727-7ebb8df5ea60 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b54c7cd7-725f-475f-9727-7ebb8df5ea60 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:21 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-b54c7cd7-725f-475f-9727-7ebb8df5ea60 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:00:21 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-b54c7cd7-725f-475f-9727-7ebb8df5ea60 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:00:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b54c7cd7-725f-475f-9727-7ebb8df5ea60 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.302s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:00:21 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-b54c7cd7-725f-475f-9727-7ebb8df5ea60 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Deleted allocations for instance 8e042a42-7cc2-4d72-b7ed-2b80339f2c85
Apr 14 02:00:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b54c7cd7-725f-475f-9727-7ebb8df5ea60 tempest-ServerBootFromVolumeStableRescueTest-85797606 tempest-ServerBootFromVolumeStableRescueTest-85797606-project-member] Lock "8e042a42-7cc2-4d72-b7ed-2b80339f2c85" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.796s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG nova.compute.manager [req-a1b8bf2b-f7f1-4435-9e02-581f3ded0377 req-c7c23fe9-08f6-4ec2-8410-29fc671fb14f service nova] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Received event network-vif-plugged-ed749832-992f-44d3-8316-87f59088b737 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a1b8bf2b-f7f1-4435-9e02-581f3ded0377 req-c7c23fe9-08f6-4ec2-8410-29fc671fb14f service nova] Acquiring lock "8e042a42-7cc2-4d72-b7ed-2b80339f2c85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a1b8bf2b-f7f1-4435-9e02-581f3ded0377 req-c7c23fe9-08f6-4ec2-8410-29fc671fb14f service nova] Lock "8e042a42-7cc2-4d72-b7ed-2b80339f2c85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a1b8bf2b-f7f1-4435-9e02-581f3ded0377 req-c7c23fe9-08f6-4ec2-8410-29fc671fb14f service nova] Lock "8e042a42-7cc2-4d72-b7ed-2b80339f2c85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG nova.compute.manager [req-a1b8bf2b-f7f1-4435-9e02-581f3ded0377 req-c7c23fe9-08f6-4ec2-8410-29fc671fb14f service nova] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] No waiting events found dispatching network-vif-plugged-ed749832-992f-44d3-8316-87f59088b737 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:00:22 user nova-compute[71498]: WARNING nova.compute.manager [req-a1b8bf2b-f7f1-4435-9e02-581f3ded0377 req-c7c23fe9-08f6-4ec2-8410-29fc671fb14f service nova] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Received unexpected event network-vif-plugged-ed749832-992f-44d3-8316-87f59088b737 for instance with vm_state deleted and task_state None.
Apr 14 02:00:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab -F raw /opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk" returned: 0 in 2.598s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Ensure instance console log exists: /opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Start _get_guest_xml network_info=[{"id": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "address": "fa:16:3e:66:5e:af", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0b5d20-30", "ovs_interfaceid": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='a1a1bb08d85f9259a13f6af67b6c957a',container_format='bare',created_at=2023-04-14T01:58:23Z,direct_url=<?>,disk_format='qcow2',id=613b68a2-7fbe-45d8-9865-8b80ea916153,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1283417408-shelved',owner='a6d05ca328d64f2aa1d19550475edba3',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T01:58:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 02:00:22 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:00:22 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:00:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='a1a1bb08d85f9259a13f6af67b6c957a',container_format='bare',created_at=2023-04-14T01:58:23Z,direct_url=<?>,disk_format='qcow2',id=613b68a2-7fbe-45d8-9865-8b80ea916153,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1283417408-shelved',owner='a6d05ca328d64f2aa1d19550475edba3',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T01:58:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG nova.objects.instance [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9152f969-e279-4182-aa0a-8534458acbca {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T01:56:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1283417408',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1283417408',id=32,image_ref='613b68a2-7fbe-45d8-9865-8b80ea916153',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1419165173',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:56:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a6d05ca328d64f2aa1d19550475edba3',ramdisk_id='',reservation_id='r-wryfyacz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2042065984',owner_user_name='tempest-AttachVolumeShelveTestJSON-2042065984-project-member',shelved_at='2023-04-14T01:58:27.035819',shelved_host='user',shelved_image_id='613b68a2-7fbe-45d8-9865-8b80ea916153'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T02:00:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a5da3e233c74524a953ce0d4e074077',uuid=9152f969-e279-4182-aa0a-8534458acbca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "address": "fa:16:3e:66:5e:af", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0b5d20-30", "ovs_interfaceid": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Converting VIF {"id": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "address": "fa:16:3e:66:5e:af", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0b5d20-30", "ovs_interfaceid": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:5e:af,bridge_name='br-int',has_traffic_filtering=True,id=cb0b5d20-30a0-4636-82c8-0c7637d66465,network=Network(a7b6c0bc-d2de-4431-821b-c2917738e556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb0b5d20-30') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG nova.objects.instance [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lazy-loading 'pci_devices' on Instance uuid 9152f969-e279-4182-aa0a-8534458acbca {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] End _get_guest_xml xml=<domain type="kvm">
Apr 14 02:00:22 user nova-compute[71498]:   <uuid>9152f969-e279-4182-aa0a-8534458acbca</uuid>
Apr 14 02:00:22 user nova-compute[71498]:   <name>instance-00000020</name>
Apr 14 02:00:22 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 02:00:22 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 02:00:22 user nova-compute[71498]:   <metadata>
Apr 14 02:00:22 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 02:00:22 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 02:00:22 user nova-compute[71498]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1283417408</nova:name>
Apr 14 02:00:22 user nova-compute[71498]:       <nova:creationTime>2023-04-14 02:00:22</nova:creationTime>
Apr 14 02:00:22 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 02:00:22 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 02:00:22 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 02:00:22 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 02:00:22 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 02:00:22 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 02:00:22 user nova-compute[71498]:       </nova:flavor>
Apr 14 02:00:22 user nova-compute[71498]:       <nova:owner>
Apr 14 02:00:22 user nova-compute[71498]:         <nova:user uuid="2a5da3e233c74524a953ce0d4e074077">tempest-AttachVolumeShelveTestJSON-2042065984-project-member</nova:user>
Apr 14 02:00:22 user nova-compute[71498]:         <nova:project uuid="a6d05ca328d64f2aa1d19550475edba3">tempest-AttachVolumeShelveTestJSON-2042065984</nova:project>
Apr 14 02:00:22 user nova-compute[71498]:       </nova:owner>
Apr 14 02:00:22 user nova-compute[71498]:       <nova:root type="image" uuid="613b68a2-7fbe-45d8-9865-8b80ea916153"/>
Apr 14 02:00:22 user nova-compute[71498]:       <nova:ports>
Apr 14 02:00:22 user nova-compute[71498]:         <nova:port uuid="cb0b5d20-30a0-4636-82c8-0c7637d66465">
Apr 14 02:00:22 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 02:00:22 user nova-compute[71498]:         </nova:port>
Apr 14 02:00:22 user nova-compute[71498]:       </nova:ports>
Apr 14 02:00:22 user nova-compute[71498]:     </nova:instance>
Apr 14 02:00:22 user nova-compute[71498]:   </metadata>
Apr 14 02:00:22 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 02:00:22 user nova-compute[71498]:     <system>
Apr 14 02:00:22 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 02:00:22 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 02:00:22 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 02:00:22 user nova-compute[71498]:       <entry name="serial">9152f969-e279-4182-aa0a-8534458acbca</entry>
Apr 14 02:00:22 user nova-compute[71498]:       <entry name="uuid">9152f969-e279-4182-aa0a-8534458acbca</entry>
Apr 14 02:00:22 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 02:00:22 user nova-compute[71498]:     </system>
Apr 14 02:00:22 user nova-compute[71498]:   </sysinfo>
Apr 14 02:00:22 user nova-compute[71498]:   <os>
Apr 14 02:00:22 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 02:00:22 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 02:00:22 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 02:00:22 user nova-compute[71498]:   </os>
Apr 14 02:00:22 user nova-compute[71498]:   <features>
Apr 14 02:00:22 user nova-compute[71498]:     <acpi/>
Apr 14 02:00:22 user nova-compute[71498]:     <apic/>
Apr 14 02:00:22 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 02:00:22 user nova-compute[71498]:   </features>
Apr 14 02:00:22 user nova-compute[71498]:   <clock offset="utc">
Apr 14 02:00:22 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 02:00:22 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 02:00:22 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 02:00:22 user nova-compute[71498]:   </clock>
Apr 14 02:00:22 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 02:00:22 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 02:00:22 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 02:00:22 user nova-compute[71498]:   </cpu>
Apr 14 02:00:22 user nova-compute[71498]:   <devices>
Apr 14 02:00:22 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 02:00:22 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 02:00:22 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk"/>
Apr 14 02:00:22 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 02:00:22 user nova-compute[71498]:     </disk>
Apr 14 02:00:22 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 02:00:22 user nova-compute[71498]:       <mac address="fa:16:3e:66:5e:af"/>
Apr 14 02:00:22 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 02:00:22 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 02:00:22 user nova-compute[71498]:       <target dev="tapcb0b5d20-30"/>
Apr 14 02:00:22 user nova-compute[71498]:     </interface>
Apr 14 02:00:22 user nova-compute[71498]:     <serial type="pty">
Apr 14 02:00:22 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/console.log" append="off"/>
Apr 14 02:00:22 user nova-compute[71498]:     </serial>
Apr 14 02:00:22 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 02:00:22 user nova-compute[71498]:     <video>
Apr 14 02:00:22 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 02:00:22 user nova-compute[71498]:     </video>
Apr 14 02:00:22 user nova-compute[71498]:     <rng model="virtio">
Apr 14 02:00:22 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 02:00:22 user nova-compute[71498]:     </rng>
Apr 14 02:00:22 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 02:00:22 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 02:00:22 user nova-compute[71498]:       <stats period="10"/>
Apr 14 02:00:22 user nova-compute[71498]:     </memballoon>
Apr 14 02:00:22 user nova-compute[71498]:   </devices>
Apr 14 02:00:22 user nova-compute[71498]: </domain>
Apr 14 02:00:22 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T01:56:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1283417408',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1283417408',id=32,image_ref='613b68a2-7fbe-45d8-9865-8b80ea916153',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1419165173',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:56:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a6d05ca328d64f2aa1d19550475edba3',ramdisk_id='',reservation_id='r-wryfyacz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2042065984',owner_user_name='tempest-AttachVolumeShelveTestJSON-2042065984-project-member',shelved_at='2023-04-14T01:58:27.035819',shelved_host='user',shelved_image_id='613b68a2-7fbe-45d8-9865-8b80ea916153'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T02:00:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a5da3e233c74524a953ce0d4e074077',uuid=9152f969-e279-4182-aa0a-8534458acbca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "address": "fa:16:3e:66:5e:af", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0b5d20-30", "ovs_interfaceid": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Converting VIF {"id": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "address": "fa:16:3e:66:5e:af", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0b5d20-30", "ovs_interfaceid": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:5e:af,bridge_name='br-int',has_traffic_filtering=True,id=cb0b5d20-30a0-4636-82c8-0c7637d66465,network=Network(a7b6c0bc-d2de-4431-821b-c2917738e556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb0b5d20-30') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG os_vif [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:5e:af,bridge_name='br-int',has_traffic_filtering=True,id=cb0b5d20-30a0-4636-82c8-0c7637d66465,network=Network(a7b6c0bc-d2de-4431-821b-c2917738e556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb0b5d20-30') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb0b5d20-30, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcb0b5d20-30, col_values=(('external_ids', {'iface-id': 'cb0b5d20-30a0-4636-82c8-0c7637d66465', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:5e:af', 'vm-uuid': '9152f969-e279-4182-aa0a-8534458acbca'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:22 user nova-compute[71498]: INFO os_vif [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:5e:af,bridge_name='br-int',has_traffic_filtering=True,id=cb0b5d20-30a0-4636-82c8-0c7637d66465,network=Network(a7b6c0bc-d2de-4431-821b-c2917738e556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb0b5d20-30')
Apr 14 02:00:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:00:22 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] No VIF found with MAC fa:16:3e:66:5e:af, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 02:00:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:24 user nova-compute[71498]: DEBUG nova.compute.manager [req-a60881f3-3216-44d2-854f-3e14a7f74814 req-9b82363f-606b-40d6-803a-e8cd86c3598e service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Received event network-vif-plugged-cb0b5d20-30a0-4636-82c8-0c7637d66465 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:00:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a60881f3-3216-44d2-854f-3e14a7f74814 req-9b82363f-606b-40d6-803a-e8cd86c3598e service nova] Acquiring lock "9152f969-e279-4182-aa0a-8534458acbca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a60881f3-3216-44d2-854f-3e14a7f74814 req-9b82363f-606b-40d6-803a-e8cd86c3598e service nova] Lock "9152f969-e279-4182-aa0a-8534458acbca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a60881f3-3216-44d2-854f-3e14a7f74814 req-9b82363f-606b-40d6-803a-e8cd86c3598e service nova] Lock "9152f969-e279-4182-aa0a-8534458acbca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:00:24 user nova-compute[71498]: DEBUG nova.compute.manager [req-a60881f3-3216-44d2-854f-3e14a7f74814 req-9b82363f-606b-40d6-803a-e8cd86c3598e service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] No waiting events found dispatching network-vif-plugged-cb0b5d20-30a0-4636-82c8-0c7637d66465 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:00:24 user nova-compute[71498]: WARNING nova.compute.manager [req-a60881f3-3216-44d2-854f-3e14a7f74814 req-9b82363f-606b-40d6-803a-e8cd86c3598e service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Received unexpected event network-vif-plugged-cb0b5d20-30a0-4636-82c8-0c7637d66465 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 02:00:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:26 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437626.2776878, 9152f969-e279-4182-aa0a-8534458acbca => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:00:26 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9152f969-e279-4182-aa0a-8534458acbca] VM Resumed (Lifecycle Event)
Apr 14 02:00:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 02:00:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 02:00:26 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Instance spawned successfully.
Apr 14 02:00:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:00:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 02:00:26 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9152f969-e279-4182-aa0a-8534458acbca] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 02:00:26 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437626.2806382, 9152f969-e279-4182-aa0a-8534458acbca => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:00:26 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9152f969-e279-4182-aa0a-8534458acbca] VM Started (Lifecycle Event)
Apr 14 02:00:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:00:26 user nova-compute[71498]: DEBUG nova.compute.manager [req-b80851be-8c58-4b88-85ca-1e8d939887f0 req-8118ae05-bcad-403b-8208-8563dea8b38b service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Received event network-vif-plugged-cb0b5d20-30a0-4636-82c8-0c7637d66465 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:00:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b80851be-8c58-4b88-85ca-1e8d939887f0 req-8118ae05-bcad-403b-8208-8563dea8b38b service nova] Acquiring lock "9152f969-e279-4182-aa0a-8534458acbca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b80851be-8c58-4b88-85ca-1e8d939887f0 req-8118ae05-bcad-403b-8208-8563dea8b38b service nova] Lock "9152f969-e279-4182-aa0a-8534458acbca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b80851be-8c58-4b88-85ca-1e8d939887f0 req-8118ae05-bcad-403b-8208-8563dea8b38b service nova] Lock "9152f969-e279-4182-aa0a-8534458acbca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:00:26 user nova-compute[71498]: DEBUG nova.compute.manager [req-b80851be-8c58-4b88-85ca-1e8d939887f0 req-8118ae05-bcad-403b-8208-8563dea8b38b service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] No waiting events found dispatching network-vif-plugged-cb0b5d20-30a0-4636-82c8-0c7637d66465 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:00:26 user nova-compute[71498]: WARNING nova.compute.manager [req-b80851be-8c58-4b88-85ca-1e8d939887f0 req-8118ae05-bcad-403b-8208-8563dea8b38b service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Received unexpected event network-vif-plugged-cb0b5d20-30a0-4636-82c8-0c7637d66465 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 02:00:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 02:00:26 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9152f969-e279-4182-aa0a-8534458acbca] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 02:00:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:00:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fa1348ad-8272-40a7-92bd-36398b57ce1f tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "9152f969-e279-4182-aa0a-8534458acbca" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.738s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:00:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:28 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681437613.0006392, 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7 => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:00:28 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] VM Stopped (Lifecycle Event)
Apr 14 02:00:28 user nova-compute[71498]: DEBUG nova.compute.manager [None req-9d7b04a6-405f-482b-b47b-cfe9e9557fd2 None None] [instance: 92e640b7-a222-4b2f-8d9f-7151cfc7dcc7] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:00:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:35 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681437620.383957, 8e042a42-7cc2-4d72-b7ed-2b80339f2c85 => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:00:35 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] VM Stopped (Lifecycle Event)
Apr 14 02:00:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-af45990e-d0de-4168-a4bf-6180899e5306 None None] [instance: 8e042a42-7cc2-4d72-b7ed-2b80339f2c85] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:00:36 user nova-compute[71498]: DEBUG nova.compute.manager [req-f18f1868-a8f3-4612-8b5d-0a68907de7e3 req-ea08ebde-bff1-4a6c-ba1c-26228b5860b0 service nova] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Received event network-changed-7eb65ace-3427-4415-a8ef-26064243471e {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:00:36 user nova-compute[71498]: DEBUG nova.compute.manager [req-f18f1868-a8f3-4612-8b5d-0a68907de7e3 req-ea08ebde-bff1-4a6c-ba1c-26228b5860b0 service nova] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Refreshing instance network info cache due to event network-changed-7eb65ace-3427-4415-a8ef-26064243471e. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 02:00:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f18f1868-a8f3-4612-8b5d-0a68907de7e3 req-ea08ebde-bff1-4a6c-ba1c-26228b5860b0 service nova] Acquiring lock "refresh_cache-618f5f0d-3594-41dd-9d8f-0c7bea255a3f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:00:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f18f1868-a8f3-4612-8b5d-0a68907de7e3 req-ea08ebde-bff1-4a6c-ba1c-26228b5860b0 service nova] Acquired lock "refresh_cache-618f5f0d-3594-41dd-9d8f-0c7bea255a3f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:00:36 user nova-compute[71498]: DEBUG nova.network.neutron [req-f18f1868-a8f3-4612-8b5d-0a68907de7e3 req-ea08ebde-bff1-4a6c-ba1c-26228b5860b0 service nova] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Refreshing network info cache for port 7eb65ace-3427-4415-a8ef-26064243471e {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 02:00:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "618f5f0d-3594-41dd-9d8f-0c7bea255a3f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "618f5f0d-3594-41dd-9d8f-0c7bea255a3f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "618f5f0d-3594-41dd-9d8f-0c7bea255a3f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "618f5f0d-3594-41dd-9d8f-0c7bea255a3f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "618f5f0d-3594-41dd-9d8f-0c7bea255a3f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:00:36 user nova-compute[71498]: INFO nova.compute.manager [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Terminating instance
Apr 14 02:00:36 user nova-compute[71498]: DEBUG nova.compute.manager [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 02:00:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG nova.compute.manager [req-8524794e-bc83-4cd9-9f29-5cc46a6732b9 req-213b7252-212c-4eef-a4c5-088a75f260cb service nova] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Received event network-vif-unplugged-7eb65ace-3427-4415-a8ef-26064243471e {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8524794e-bc83-4cd9-9f29-5cc46a6732b9 req-213b7252-212c-4eef-a4c5-088a75f260cb service nova] Acquiring lock "618f5f0d-3594-41dd-9d8f-0c7bea255a3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8524794e-bc83-4cd9-9f29-5cc46a6732b9 req-213b7252-212c-4eef-a4c5-088a75f260cb service nova] Lock "618f5f0d-3594-41dd-9d8f-0c7bea255a3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8524794e-bc83-4cd9-9f29-5cc46a6732b9 req-213b7252-212c-4eef-a4c5-088a75f260cb service nova] Lock "618f5f0d-3594-41dd-9d8f-0c7bea255a3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG nova.compute.manager [req-8524794e-bc83-4cd9-9f29-5cc46a6732b9 req-213b7252-212c-4eef-a4c5-088a75f260cb service nova] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] No waiting events found dispatching network-vif-unplugged-7eb65ace-3427-4415-a8ef-26064243471e {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG nova.compute.manager [req-8524794e-bc83-4cd9-9f29-5cc46a6732b9 req-213b7252-212c-4eef-a4c5-088a75f260cb service nova] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Received event network-vif-unplugged-7eb65ace-3427-4415-a8ef-26064243471e for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG nova.network.neutron [req-f18f1868-a8f3-4612-8b5d-0a68907de7e3 req-ea08ebde-bff1-4a6c-ba1c-26228b5860b0 service nova] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Updated VIF entry in instance network info cache for port 7eb65ace-3427-4415-a8ef-26064243471e. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG nova.network.neutron [req-f18f1868-a8f3-4612-8b5d-0a68907de7e3 req-ea08ebde-bff1-4a6c-ba1c-26228b5860b0 service nova] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Updating instance_info_cache with network_info: [{"id": "7eb65ace-3427-4415-a8ef-26064243471e", "address": "fa:16:3e:0f:86:e9", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb65ace-34", "ovs_interfaceid": "7eb65ace-3427-4415-a8ef-26064243471e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f18f1868-a8f3-4612-8b5d-0a68907de7e3 req-ea08ebde-bff1-4a6c-ba1c-26228b5860b0 service nova] Releasing lock "refresh_cache-618f5f0d-3594-41dd-9d8f-0c7bea255a3f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:00:37 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Instance destroyed successfully.
Apr 14 02:00:37 user nova-compute[71498]: DEBUG nova.objects.instance [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lazy-loading 'resources' on Instance uuid 618f5f0d-3594-41dd-9d8f-0c7bea255a3f {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:55:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1218439158',display_name='tempest-TestVolumeBootPattern-server-1218439158',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1218439158',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcODdjkXb9vqfJo6mLTbOXnPLP2HdwXcPxYgRVEM78ApSpFWKxeZveFravQCk22JVH3n1PXZDKAyefoGYrsPczv6zWWLW2pkXjL46/zFdGhb8s3BmOyjVZHJdx/Y2ktUg==',key_name='tempest-TestVolumeBootPattern-824995165',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:55:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1f4117a4adb4aa3b42951cf1fc84237',ramdisk_id='',reservation_id='r-1h2cwt4h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-224521177',owner_user_name='tempest-TestVolumeBootPattern-224521177-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:55:59Z,user_data=None,user_id='50e3354ac1a84c59a7dee8e1ae6e771a',uuid=618f5f0d-3594-41dd-9d8f-0c7bea255a3f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7eb65ace-3427-4415-a8ef-26064243471e", "address": "fa:16:3e:0f:86:e9", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb65ace-34", "ovs_interfaceid": "7eb65ace-3427-4415-a8ef-26064243471e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converting VIF {"id": "7eb65ace-3427-4415-a8ef-26064243471e", "address": "fa:16:3e:0f:86:e9", "network": {"id": "74c65fc2-ff90-46a4-a5e1-300009f92343", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-866966071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1f4117a4adb4aa3b42951cf1fc84237", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eb65ace-34", "ovs_interfaceid": "7eb65ace-3427-4415-a8ef-26064243471e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:86:e9,bridge_name='br-int',has_traffic_filtering=True,id=7eb65ace-3427-4415-a8ef-26064243471e,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eb65ace-34') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG os_vif [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:86:e9,bridge_name='br-int',has_traffic_filtering=True,id=7eb65ace-3427-4415-a8ef-26064243471e,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eb65ace-34') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7eb65ace-34, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:37 user nova-compute[71498]: INFO os_vif [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:86:e9,bridge_name='br-int',has_traffic_filtering=True,id=7eb65ace-3427-4415-a8ef-26064243471e,network=Network(74c65fc2-ff90-46a4-a5e1-300009f92343),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eb65ace-34')
Apr 14 02:00:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XIKaoMjg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:00:37 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:00:37 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d499a5-4d6f-41b3-917c-840f1f129baf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 02:00:37 user nova-compute[71498]: No targets found.
Apr 14 02:00:37 user nova-compute[71498]: iSNS:
Apr 14 02:00:37 user nova-compute[71498]: No targets found.
Apr 14 02:00:37 user nova-compute[71498]: STATIC:
Apr 14 02:00:37 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860
Apr 14 02:00:37 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 02:00:37 user nova-compute[71498]:                 Iface Name: default
Apr 14 02:00:37 user nova-compute[71498]: FIRMWARE:
Apr 14 02:00:37 user nova-compute[71498]: No targets found.
Apr 14 02:00:37 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 02:00:37 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 02:00:37 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[39af68c3-95bc-4777-8ffb-99faa947ba04]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0469a11f-0bdf-4be8-9fa1-dfece5d7bc8f]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 02:00:37 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 (non-flash)
Apr 14 02:00:37 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51c45317e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860'): ({'sdf'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Removing single pathed devices sdf {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a49329c-e53e-45d1-a244-eca1cc66a308]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6d7519-5362-471b-a6d4-c2b507a6596d]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Flushing IO for device /dev/sdf {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a96e60-5edc-4719-88cb-dc404fd97f31]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8dc83c-18f0-4c85-a684-511754ed37d7]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] SCSI volumes sdf have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO268d929c-677087efeb0f91ec', '/dev/disk/by-id/scsi-23637373038376566', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_268d929c') {{(pid=81721) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b78ce5c-7038-4954-a85c-681193783fe2]: (4, None) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb355b12-b886-4a06-851d-c14003164f92]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[439cd2a1-4f29-4a90-bd31-023c66875a8f]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860, portal: 172.16.0.220,3260]
Apr 14 02:00:37 user nova-compute[71498]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860, portal: 172.16.0.220,3260] successful.
Apr 14 02:00:37 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:450914a2-96ae-4c21-a717-2b391be59860 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[150df557-7986-4f3d-b225-bc90b9f5d078]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] <== disconnect_volume: return (330ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 02:00:37 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Deleting instance files /opt/stack/data/nova/instances/618f5f0d-3594-41dd-9d8f-0c7bea255a3f_del
Apr 14 02:00:37 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Deletion of /opt/stack/data/nova/instances/618f5f0d-3594-41dd-9d8f-0c7bea255a3f_del complete
Apr 14 02:00:37 user nova-compute[71498]: INFO nova.compute.manager [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Took 1.25 seconds to destroy the instance on the hypervisor.
Apr 14 02:00:37 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 02:00:37 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 02:00:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:38 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:00:38 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Took 0.48 seconds to deallocate network for instance.
Apr 14 02:00:39 user nova-compute[71498]: DEBUG nova.compute.manager [req-8e83755f-5c8e-4f60-9ad7-eef030d39835 req-f4cee8cc-dd8a-4a8c-a59f-8a8fc79b6beb service nova] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Received event network-vif-plugged-7eb65ace-3427-4415-a8ef-26064243471e {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:00:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8e83755f-5c8e-4f60-9ad7-eef030d39835 req-f4cee8cc-dd8a-4a8c-a59f-8a8fc79b6beb service nova] Acquiring lock "618f5f0d-3594-41dd-9d8f-0c7bea255a3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8e83755f-5c8e-4f60-9ad7-eef030d39835 req-f4cee8cc-dd8a-4a8c-a59f-8a8fc79b6beb service nova] Lock "618f5f0d-3594-41dd-9d8f-0c7bea255a3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8e83755f-5c8e-4f60-9ad7-eef030d39835 req-f4cee8cc-dd8a-4a8c-a59f-8a8fc79b6beb service nova] Lock "618f5f0d-3594-41dd-9d8f-0c7bea255a3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:00:39 user nova-compute[71498]: DEBUG nova.compute.manager [req-8e83755f-5c8e-4f60-9ad7-eef030d39835 req-f4cee8cc-dd8a-4a8c-a59f-8a8fc79b6beb service nova] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] No waiting events found dispatching network-vif-plugged-7eb65ace-3427-4415-a8ef-26064243471e {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:00:39 user nova-compute[71498]: WARNING nova.compute.manager [req-8e83755f-5c8e-4f60-9ad7-eef030d39835 req-f4cee8cc-dd8a-4a8c-a59f-8a8fc79b6beb service nova] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Received unexpected event network-vif-plugged-7eb65ace-3427-4415-a8ef-26064243471e for instance with vm_state active and task_state deleting.
Apr 14 02:00:39 user nova-compute[71498]: DEBUG nova.compute.manager [req-8e83755f-5c8e-4f60-9ad7-eef030d39835 req-f4cee8cc-dd8a-4a8c-a59f-8a8fc79b6beb service nova] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Received event network-vif-deleted-7eb65ace-3427-4415-a8ef-26064243471e {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:00:39 user nova-compute[71498]: INFO nova.compute.manager [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Took 0.78 seconds to detach 1 volumes for instance.
Apr 14 02:00:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:39 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:00:39 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:00:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:00:39 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Deleted allocations for instance 618f5f0d-3594-41dd-9d8f-0c7bea255a3f
Apr 14 02:00:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b09cff50-0d2e-42d9-a1d9-256b29b060d0 tempest-TestVolumeBootPattern-224521177 tempest-TestVolumeBootPattern-224521177-project-member] Lock "618f5f0d-3594-41dd-9d8f-0c7bea255a3f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.893s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:00:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:43 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:00:43 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 02:00:43 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Rebuilding the list of instances to heal {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 02:00:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-a19a1c08-5454-481b-bb5a-70c39ead9afc" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:00:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-a19a1c08-5454-481b-bb5a-70c39ead9afc" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:00:43 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 02:00:43 user nova-compute[71498]: DEBUG nova.objects.instance [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lazy-loading 'info_cache' on Instance uuid a19a1c08-5454-481b-bb5a-70c39ead9afc {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:00:43 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Updating instance_info_cache with network_info: [{"id": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "address": "fa:16:3e:1f:54:6c", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b00fd21-ee", "ovs_interfaceid": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:00:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-a19a1c08-5454-481b-bb5a-70c39ead9afc" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:00:43 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 02:00:43 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:00:44 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:00:45 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:00:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:00:45 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 02:00:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:00:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:00:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:00:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:00:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:00:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:00:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:00:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:00:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:00:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:00:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:00:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:00:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:00:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:00:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:00:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:00:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:00:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:00:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:00:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:00:47 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:00:47 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:00:47 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=8407MB free_disk=26.296161651611328GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 02:00:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:47 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance a19a1c08-5454-481b-bb5a-70c39ead9afc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:00:47 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance fa29c144-0ff9-4efb-a574-f521d18f08fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:00:47 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 5ba29111-1e9b-4947-b046-6bbe888eca06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:00:47 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 9152f969-e279-4182-aa0a-8534458acbca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:00:47 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 02:00:47 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 02:00:47 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:00:47 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:00:47 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 02:00:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.295s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:00:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:51 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:00:51 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:00:51 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:00:51 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:00:51 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:00:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:52 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:00:52 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 02:00:52 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681437637.4298208, 618f5f0d-3594-41dd-9d8f-0c7bea255a3f => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:00:52 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] VM Stopped (Lifecycle Event)
Apr 14 02:00:52 user nova-compute[71498]: DEBUG nova.compute.manager [None req-a7bee821-2565-4e0d-b295-2b3bbba95191 None None] [instance: 618f5f0d-3594-41dd-9d8f-0c7bea255a3f] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:00:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:55 user nova-compute[71498]: DEBUG nova.compute.manager [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 02:00:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:55 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 02:00:55 user nova-compute[71498]: INFO nova.compute.claims [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Claim successful on node user
Apr 14 02:00:55 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:00:55 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:00:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.268s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:00:55 user nova-compute[71498]: DEBUG nova.compute.manager [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 02:00:55 user nova-compute[71498]: DEBUG nova.compute.manager [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 02:00:55 user nova-compute[71498]: DEBUG nova.network.neutron [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 02:00:55 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 02:00:55 user nova-compute[71498]: DEBUG nova.compute.manager [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 02:00:55 user nova-compute[71498]: DEBUG nova.policy [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba0894753a074f99ab226fde0565dd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f650e04d2c947498b9e7a8d002862ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 02:00:55 user nova-compute[71498]: DEBUG nova.compute.manager [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 02:00:55 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 02:00:55 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Creating image(s)
Apr 14 02:00:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "/opt/stack/data/nova/instances/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "/opt/stack/data/nova/instances/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "/opt/stack/data/nova/instances/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:00:55 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:00:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.134s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:00:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:00:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.137s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:00:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:00:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/disk 1073741824" returned: 0 in 0.045s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:00:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:00:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:00:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.133s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:00:56 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 02:00:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:00:56 user nova-compute[71498]: DEBUG nova.network.neutron [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Successfully created port: 617da89e-c0c3-455c-992f-893a43fa7d3e {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 02:00:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:00:56 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Cannot resize image /opt/stack/data/nova/instances/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 02:00:56 user nova-compute[71498]: DEBUG nova.objects.instance [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'migration_context' on Instance uuid b7c5d54a-48a6-4600-b87b-e1318e35c1fe {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:00:56 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 02:00:56 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Ensure instance console log exists: /opt/stack/data/nova/instances/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 02:00:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG nova.network.neutron [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Successfully updated port: 617da89e-c0c3-455c-992f-893a43fa7d3e {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "refresh_cache-b7c5d54a-48a6-4600-b87b-e1318e35c1fe" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquired lock "refresh_cache-b7c5d54a-48a6-4600-b87b-e1318e35c1fe" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG nova.network.neutron [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG nova.compute.manager [req-1463b974-b296-4bdb-a829-23f525ccd196 req-bc8e1445-ff0b-42d2-b892-46eb685c4b2a service nova] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Received event network-changed-617da89e-c0c3-455c-992f-893a43fa7d3e {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG nova.compute.manager [req-1463b974-b296-4bdb-a829-23f525ccd196 req-bc8e1445-ff0b-42d2-b892-46eb685c4b2a service nova] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Refreshing instance network info cache due to event network-changed-617da89e-c0c3-455c-992f-893a43fa7d3e. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1463b974-b296-4bdb-a829-23f525ccd196 req-bc8e1445-ff0b-42d2-b892-46eb685c4b2a service nova] Acquiring lock "refresh_cache-b7c5d54a-48a6-4600-b87b-e1318e35c1fe" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG nova.network.neutron [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG nova.network.neutron [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Updating instance_info_cache with network_info: [{"id": "617da89e-c0c3-455c-992f-893a43fa7d3e", "address": "fa:16:3e:e8:54:11", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617da89e-c0", "ovs_interfaceid": "617da89e-c0c3-455c-992f-893a43fa7d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Releasing lock "refresh_cache-b7c5d54a-48a6-4600-b87b-e1318e35c1fe" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG nova.compute.manager [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Instance network_info: |[{"id": "617da89e-c0c3-455c-992f-893a43fa7d3e", "address": "fa:16:3e:e8:54:11", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617da89e-c0", "ovs_interfaceid": "617da89e-c0c3-455c-992f-893a43fa7d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1463b974-b296-4bdb-a829-23f525ccd196 req-bc8e1445-ff0b-42d2-b892-46eb685c4b2a service nova] Acquired lock "refresh_cache-b7c5d54a-48a6-4600-b87b-e1318e35c1fe" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG nova.network.neutron [req-1463b974-b296-4bdb-a829-23f525ccd196 req-bc8e1445-ff0b-42d2-b892-46eb685c4b2a service nova] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Refreshing network info cache for port 617da89e-c0c3-455c-992f-893a43fa7d3e {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Start _get_guest_xml network_info=[{"id": "617da89e-c0c3-455c-992f-893a43fa7d3e", "address": "fa:16:3e:e8:54:11", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617da89e-c0", "ovs_interfaceid": "617da89e-c0c3-455c-992f-893a43fa7d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 02:00:57 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:00:57 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:00:57 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:00:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-894252915',display_name='tempest-AttachVolumeTestJSON-server-894252915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-894252915',id=35,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDYgxLG6u+CLZO6ez2euu9C5tc+/T2XOCpUbIazierEJc6wvMtj8tQF3K8twfznW6n+gHEfT2+fHG3IrWuhzSDZudXAmAV0UsgnPo1pT6EO7QTUJ4jJt7CdfqhPDSKhung==',key_name='tempest-keypair-1642286085',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f650e04d2c947498b9e7a8d002862ad',ramdisk_id='',reservation_id='r-fc6checp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-296004410',owner_user_name='tempest-AttachVolumeTestJSON-296004410-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T02:00:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba0894753a074f99ab226fde0565dd28',uuid=b7c5d54a-48a6-4600-b87b-e1318e35c1fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "617da89e-c0c3-455c-992f-893a43fa7d3e", "address": "fa:16:3e:e8:54:11", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617da89e-c0", "ovs_interfaceid": "617da89e-c0c3-455c-992f-893a43fa7d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Converting VIF {"id": "617da89e-c0c3-455c-992f-893a43fa7d3e", "address": "fa:16:3e:e8:54:11", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617da89e-c0", "ovs_interfaceid": "617da89e-c0c3-455c-992f-893a43fa7d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:54:11,bridge_name='br-int',has_traffic_filtering=True,id=617da89e-c0c3-455c-992f-893a43fa7d3e,network=Network(fe9d57b9-96e8-424e-8dc9-0c95f1aff03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617da89e-c0') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG nova.objects.instance [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'pci_devices' on Instance uuid b7c5d54a-48a6-4600-b87b-e1318e35c1fe {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] End _get_guest_xml xml=<domain type="kvm">
Apr 14 02:00:57 user nova-compute[71498]:   <uuid>b7c5d54a-48a6-4600-b87b-e1318e35c1fe</uuid>
Apr 14 02:00:57 user nova-compute[71498]:   <name>instance-00000023</name>
Apr 14 02:00:57 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 02:00:57 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 02:00:57 user nova-compute[71498]:   <metadata>
Apr 14 02:00:57 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 02:00:57 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 02:00:57 user nova-compute[71498]:       <nova:name>tempest-AttachVolumeTestJSON-server-894252915</nova:name>
Apr 14 02:00:57 user nova-compute[71498]:       <nova:creationTime>2023-04-14 02:00:57</nova:creationTime>
Apr 14 02:00:57 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 02:00:57 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 02:00:57 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 02:00:57 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 02:00:57 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 02:00:57 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 02:00:57 user nova-compute[71498]:       </nova:flavor>
Apr 14 02:00:57 user nova-compute[71498]:       <nova:owner>
Apr 14 02:00:57 user nova-compute[71498]:         <nova:user uuid="ba0894753a074f99ab226fde0565dd28">tempest-AttachVolumeTestJSON-296004410-project-member</nova:user>
Apr 14 02:00:57 user nova-compute[71498]:         <nova:project uuid="0f650e04d2c947498b9e7a8d002862ad">tempest-AttachVolumeTestJSON-296004410</nova:project>
Apr 14 02:00:57 user nova-compute[71498]:       </nova:owner>
Apr 14 02:00:57 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 02:00:57 user nova-compute[71498]:       <nova:ports>
Apr 14 02:00:57 user nova-compute[71498]:         <nova:port uuid="617da89e-c0c3-455c-992f-893a43fa7d3e">
Apr 14 02:00:57 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 02:00:57 user nova-compute[71498]:         </nova:port>
Apr 14 02:00:57 user nova-compute[71498]:       </nova:ports>
Apr 14 02:00:57 user nova-compute[71498]:     </nova:instance>
Apr 14 02:00:57 user nova-compute[71498]:   </metadata>
Apr 14 02:00:57 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 02:00:57 user nova-compute[71498]:     <system>
Apr 14 02:00:57 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 02:00:57 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 02:00:57 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 02:00:57 user nova-compute[71498]:       <entry name="serial">b7c5d54a-48a6-4600-b87b-e1318e35c1fe</entry>
Apr 14 02:00:57 user nova-compute[71498]:       <entry name="uuid">b7c5d54a-48a6-4600-b87b-e1318e35c1fe</entry>
Apr 14 02:00:57 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 02:00:57 user nova-compute[71498]:     </system>
Apr 14 02:00:57 user nova-compute[71498]:   </sysinfo>
Apr 14 02:00:57 user nova-compute[71498]:   <os>
Apr 14 02:00:57 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 02:00:57 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 02:00:57 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 02:00:57 user nova-compute[71498]:   </os>
Apr 14 02:00:57 user nova-compute[71498]:   <features>
Apr 14 02:00:57 user nova-compute[71498]:     <acpi/>
Apr 14 02:00:57 user nova-compute[71498]:     <apic/>
Apr 14 02:00:57 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 02:00:57 user nova-compute[71498]:   </features>
Apr 14 02:00:57 user nova-compute[71498]:   <clock offset="utc">
Apr 14 02:00:57 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 02:00:57 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 02:00:57 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 02:00:57 user nova-compute[71498]:   </clock>
Apr 14 02:00:57 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 02:00:57 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 02:00:57 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 02:00:57 user nova-compute[71498]:   </cpu>
Apr 14 02:00:57 user nova-compute[71498]:   <devices>
Apr 14 02:00:57 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 02:00:57 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 02:00:57 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/disk"/>
Apr 14 02:00:57 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 02:00:57 user nova-compute[71498]:     </disk>
Apr 14 02:00:57 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 02:00:57 user nova-compute[71498]:       <mac address="fa:16:3e:e8:54:11"/>
Apr 14 02:00:57 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 02:00:57 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 02:00:57 user nova-compute[71498]:       <target dev="tap617da89e-c0"/>
Apr 14 02:00:57 user nova-compute[71498]:     </interface>
Apr 14 02:00:57 user nova-compute[71498]:     <serial type="pty">
Apr 14 02:00:57 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/console.log" append="off"/>
Apr 14 02:00:57 user nova-compute[71498]:     </serial>
Apr 14 02:00:57 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 02:00:57 user nova-compute[71498]:     <video>
Apr 14 02:00:57 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 02:00:57 user nova-compute[71498]:     </video>
Apr 14 02:00:57 user nova-compute[71498]:     <rng model="virtio">
Apr 14 02:00:57 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 02:00:57 user nova-compute[71498]:     </rng>
Apr 14 02:00:57 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 02:00:57 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 02:00:57 user nova-compute[71498]:       <stats period="10"/>
Apr 14 02:00:57 user nova-compute[71498]:     </memballoon>
Apr 14 02:00:57 user nova-compute[71498]:   </devices>
Apr 14 02:00:57 user nova-compute[71498]: </domain>
Apr 14 02:00:57 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:00:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-894252915',display_name='tempest-AttachVolumeTestJSON-server-894252915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-894252915',id=35,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDYgxLG6u+CLZO6ez2euu9C5tc+/T2XOCpUbIazierEJc6wvMtj8tQF3K8twfznW6n+gHEfT2+fHG3IrWuhzSDZudXAmAV0UsgnPo1pT6EO7QTUJ4jJt7CdfqhPDSKhung==',key_name='tempest-keypair-1642286085',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f650e04d2c947498b9e7a8d002862ad',ramdisk_id='',reservation_id='r-fc6checp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-296004410',owner_user_name='tempest-AttachVolumeTestJSON-296004410-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T02:00:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba0894753a074f99ab226fde0565dd28',uuid=b7c5d54a-48a6-4600-b87b-e1318e35c1fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "617da89e-c0c3-455c-992f-893a43fa7d3e", "address": "fa:16:3e:e8:54:11", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617da89e-c0", "ovs_interfaceid": "617da89e-c0c3-455c-992f-893a43fa7d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Converting VIF {"id": "617da89e-c0c3-455c-992f-893a43fa7d3e", "address": "fa:16:3e:e8:54:11", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617da89e-c0", "ovs_interfaceid": "617da89e-c0c3-455c-992f-893a43fa7d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:54:11,bridge_name='br-int',has_traffic_filtering=True,id=617da89e-c0c3-455c-992f-893a43fa7d3e,network=Network(fe9d57b9-96e8-424e-8dc9-0c95f1aff03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617da89e-c0') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG os_vif [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:54:11,bridge_name='br-int',has_traffic_filtering=True,id=617da89e-c0c3-455c-992f-893a43fa7d3e,network=Network(fe9d57b9-96e8-424e-8dc9-0c95f1aff03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617da89e-c0') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap617da89e-c0, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap617da89e-c0, col_values=(('external_ids', {'iface-id': '617da89e-c0c3-455c-992f-893a43fa7d3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:54:11', 'vm-uuid': 'b7c5d54a-48a6-4600-b87b-e1318e35c1fe'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:57 user nova-compute[71498]: INFO os_vif [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:54:11,bridge_name='br-int',has_traffic_filtering=True,id=617da89e-c0c3-455c-992f-893a43fa7d3e,network=Network(fe9d57b9-96e8-424e-8dc9-0c95f1aff03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617da89e-c0')
Apr 14 02:00:57 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:00:57 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] No VIF found with MAC fa:16:3e:e8:54:11, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 02:00:58 user nova-compute[71498]: DEBUG nova.network.neutron [req-1463b974-b296-4bdb-a829-23f525ccd196 req-bc8e1445-ff0b-42d2-b892-46eb685c4b2a service nova] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Updated VIF entry in instance network info cache for port 617da89e-c0c3-455c-992f-893a43fa7d3e. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 02:00:58 user nova-compute[71498]: DEBUG nova.network.neutron [req-1463b974-b296-4bdb-a829-23f525ccd196 req-bc8e1445-ff0b-42d2-b892-46eb685c4b2a service nova] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Updating instance_info_cache with network_info: [{"id": "617da89e-c0c3-455c-992f-893a43fa7d3e", "address": "fa:16:3e:e8:54:11", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617da89e-c0", "ovs_interfaceid": "617da89e-c0c3-455c-992f-893a43fa7d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:00:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1463b974-b296-4bdb-a829-23f525ccd196 req-bc8e1445-ff0b-42d2-b892-46eb685c4b2a service nova] Releasing lock "refresh_cache-b7c5d54a-48a6-4600-b87b-e1318e35c1fe" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:00:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:59 user nova-compute[71498]: DEBUG nova.compute.manager [req-e45ae7b5-c554-42f0-8f99-a9173f2be711 req-033cca06-384d-434e-8e6c-6007ef0e049f service nova] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Received event network-vif-plugged-617da89e-c0c3-455c-992f-893a43fa7d3e {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:00:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e45ae7b5-c554-42f0-8f99-a9173f2be711 req-033cca06-384d-434e-8e6c-6007ef0e049f service nova] Acquiring lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:00:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e45ae7b5-c554-42f0-8f99-a9173f2be711 req-033cca06-384d-434e-8e6c-6007ef0e049f service nova] Lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:00:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e45ae7b5-c554-42f0-8f99-a9173f2be711 req-033cca06-384d-434e-8e6c-6007ef0e049f service nova] Lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:00:59 user nova-compute[71498]: DEBUG nova.compute.manager [req-e45ae7b5-c554-42f0-8f99-a9173f2be711 req-033cca06-384d-434e-8e6c-6007ef0e049f service nova] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] No waiting events found dispatching network-vif-plugged-617da89e-c0c3-455c-992f-893a43fa7d3e {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:00:59 user nova-compute[71498]: WARNING nova.compute.manager [req-e45ae7b5-c554-42f0-8f99-a9173f2be711 req-033cca06-384d-434e-8e6c-6007ef0e049f service nova] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Received unexpected event network-vif-plugged-617da89e-c0c3-455c-992f-893a43fa7d3e for instance with vm_state building and task_state spawning.
Apr 14 02:00:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:00:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:01 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437661.130326, b7c5d54a-48a6-4600-b87b-e1318e35c1fe => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:01:01 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] VM Resumed (Lifecycle Event)
Apr 14 02:01:01 user nova-compute[71498]: DEBUG nova.compute.manager [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 02:01:01 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 02:01:01 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Instance spawned successfully.
Apr 14 02:01:01 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 02:01:01 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:01:01 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 02:01:01 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:01:01 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:01:01 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:01:01 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:01:01 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:01:01 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:01:01 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 02:01:01 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437661.1323023, b7c5d54a-48a6-4600-b87b-e1318e35c1fe => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:01:01 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] VM Started (Lifecycle Event)
Apr 14 02:01:01 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:01:01 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 02:01:01 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 02:01:01 user nova-compute[71498]: INFO nova.compute.manager [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Took 5.34 seconds to spawn the instance on the hypervisor.
Apr 14 02:01:01 user nova-compute[71498]: DEBUG nova.compute.manager [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:01:01 user nova-compute[71498]: DEBUG nova.compute.manager [req-1ed92e1a-2533-46e7-a8b6-c2032ffded62 req-3a41594c-0d6b-4636-895e-add037dfc507 service nova] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Received event network-vif-plugged-617da89e-c0c3-455c-992f-893a43fa7d3e {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:01:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1ed92e1a-2533-46e7-a8b6-c2032ffded62 req-3a41594c-0d6b-4636-895e-add037dfc507 service nova] Acquiring lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:01:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1ed92e1a-2533-46e7-a8b6-c2032ffded62 req-3a41594c-0d6b-4636-895e-add037dfc507 service nova] Lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:01:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1ed92e1a-2533-46e7-a8b6-c2032ffded62 req-3a41594c-0d6b-4636-895e-add037dfc507 service nova] Lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:01:01 user nova-compute[71498]: DEBUG nova.compute.manager [req-1ed92e1a-2533-46e7-a8b6-c2032ffded62 req-3a41594c-0d6b-4636-895e-add037dfc507 service nova] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] No waiting events found dispatching network-vif-plugged-617da89e-c0c3-455c-992f-893a43fa7d3e {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:01:01 user nova-compute[71498]: WARNING nova.compute.manager [req-1ed92e1a-2533-46e7-a8b6-c2032ffded62 req-3a41594c-0d6b-4636-895e-add037dfc507 service nova] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Received unexpected event network-vif-plugged-617da89e-c0c3-455c-992f-893a43fa7d3e for instance with vm_state building and task_state spawning.
Apr 14 02:01:01 user nova-compute[71498]: INFO nova.compute.manager [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Took 5.90 seconds to build instance.
Apr 14 02:01:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e7148d12-7350-47fa-9f3e-be7d6dd63be9 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.998s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:01:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a90c9768-8efd-4501-9a62-cbcd71d01bf5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "fa29c144-0ff9-4efb-a574-f521d18f08fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:01:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a90c9768-8efd-4501-9a62-cbcd71d01bf5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "fa29c144-0ff9-4efb-a574-f521d18f08fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:01:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a90c9768-8efd-4501-9a62-cbcd71d01bf5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "fa29c144-0ff9-4efb-a574-f521d18f08fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:01:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a90c9768-8efd-4501-9a62-cbcd71d01bf5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "fa29c144-0ff9-4efb-a574-f521d18f08fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:01:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a90c9768-8efd-4501-9a62-cbcd71d01bf5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "fa29c144-0ff9-4efb-a574-f521d18f08fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:01:09 user nova-compute[71498]: INFO nova.compute.manager [None req-a90c9768-8efd-4501-9a62-cbcd71d01bf5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Terminating instance
Apr 14 02:01:09 user nova-compute[71498]: DEBUG nova.compute.manager [None req-a90c9768-8efd-4501-9a62-cbcd71d01bf5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 02:01:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:10 user nova-compute[71498]: DEBUG nova.compute.manager [req-02ff66e0-136d-42a9-ac36-41fc1619a574 req-7045f91a-cacb-46bb-953d-40fa56e0907b service nova] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Received event network-vif-unplugged-6a841349-4e6e-40e1-90f0-998d46c60567 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:01:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-02ff66e0-136d-42a9-ac36-41fc1619a574 req-7045f91a-cacb-46bb-953d-40fa56e0907b service nova] Acquiring lock "fa29c144-0ff9-4efb-a574-f521d18f08fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:01:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-02ff66e0-136d-42a9-ac36-41fc1619a574 req-7045f91a-cacb-46bb-953d-40fa56e0907b service nova] Lock "fa29c144-0ff9-4efb-a574-f521d18f08fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:01:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-02ff66e0-136d-42a9-ac36-41fc1619a574 req-7045f91a-cacb-46bb-953d-40fa56e0907b service nova] Lock "fa29c144-0ff9-4efb-a574-f521d18f08fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:01:10 user nova-compute[71498]: DEBUG nova.compute.manager [req-02ff66e0-136d-42a9-ac36-41fc1619a574 req-7045f91a-cacb-46bb-953d-40fa56e0907b service nova] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] No waiting events found dispatching network-vif-unplugged-6a841349-4e6e-40e1-90f0-998d46c60567 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:01:10 user nova-compute[71498]: DEBUG nova.compute.manager [req-02ff66e0-136d-42a9-ac36-41fc1619a574 req-7045f91a-cacb-46bb-953d-40fa56e0907b service nova] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Received event network-vif-unplugged-6a841349-4e6e-40e1-90f0-998d46c60567 for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 02:01:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:10 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Instance destroyed successfully.
Apr 14 02:01:10 user nova-compute[71498]: DEBUG nova.objects.instance [None req-a90c9768-8efd-4501-9a62-cbcd71d01bf5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'resources' on Instance uuid fa29c144-0ff9-4efb-a574-f521d18f08fa {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:01:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-a90c9768-8efd-4501-9a62-cbcd71d01bf5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:45:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2109836040',display_name='tempest-ServerRescueNegativeTestJSON-server-2109836040',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2109836040',id=19,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:47:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d3de04739384e3ea3a475fee28be3c0',ramdisk_id='',reservation_id='r-9ja500p2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1453869246',owner_user_name='tempest-ServerRescueNegativeTestJSON-1453869246-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:47:04Z,user_data=None,user_id='eeb5f26be86e43b3b61fff98fdc83cf3',uuid=fa29c144-0ff9-4efb-a574-f521d18f08fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "6a841349-4e6e-40e1-90f0-998d46c60567", "address": "fa:16:3e:49:5d:eb", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a841349-4e", "ovs_interfaceid": "6a841349-4e6e-40e1-90f0-998d46c60567", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 02:01:10 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-a90c9768-8efd-4501-9a62-cbcd71d01bf5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Converting VIF {"id": "6a841349-4e6e-40e1-90f0-998d46c60567", "address": "fa:16:3e:49:5d:eb", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a841349-4e", "ovs_interfaceid": "6a841349-4e6e-40e1-90f0-998d46c60567", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:01:10 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-a90c9768-8efd-4501-9a62-cbcd71d01bf5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:5d:eb,bridge_name='br-int',has_traffic_filtering=True,id=6a841349-4e6e-40e1-90f0-998d46c60567,network=Network(2c4fba9e-0217-4e37-af1c-065b3f0cd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a841349-4e') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:01:10 user nova-compute[71498]: DEBUG os_vif [None req-a90c9768-8efd-4501-9a62-cbcd71d01bf5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:5d:eb,bridge_name='br-int',has_traffic_filtering=True,id=6a841349-4e6e-40e1-90f0-998d46c60567,network=Network(2c4fba9e-0217-4e37-af1c-065b3f0cd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a841349-4e') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 02:01:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a841349-4e, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:01:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:01:10 user nova-compute[71498]: INFO os_vif [None req-a90c9768-8efd-4501-9a62-cbcd71d01bf5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:5d:eb,bridge_name='br-int',has_traffic_filtering=True,id=6a841349-4e6e-40e1-90f0-998d46c60567,network=Network(2c4fba9e-0217-4e37-af1c-065b3f0cd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a841349-4e')
Apr 14 02:01:10 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-a90c9768-8efd-4501-9a62-cbcd71d01bf5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Deleting instance files /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa_del
Apr 14 02:01:10 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-a90c9768-8efd-4501-9a62-cbcd71d01bf5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Deletion of /opt/stack/data/nova/instances/fa29c144-0ff9-4efb-a574-f521d18f08fa_del complete
Apr 14 02:01:10 user nova-compute[71498]: INFO nova.compute.manager [None req-a90c9768-8efd-4501-9a62-cbcd71d01bf5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 14 02:01:10 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-a90c9768-8efd-4501-9a62-cbcd71d01bf5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 02:01:10 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 02:01:10 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 02:01:11 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:01:11 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Took 0.49 seconds to deallocate network for instance.
Apr 14 02:01:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a90c9768-8efd-4501-9a62-cbcd71d01bf5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:01:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a90c9768-8efd-4501-9a62-cbcd71d01bf5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:01:11 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-a90c9768-8efd-4501-9a62-cbcd71d01bf5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:01:11 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-a90c9768-8efd-4501-9a62-cbcd71d01bf5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:01:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a90c9768-8efd-4501-9a62-cbcd71d01bf5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.207s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:01:11 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-a90c9768-8efd-4501-9a62-cbcd71d01bf5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Deleted allocations for instance fa29c144-0ff9-4efb-a574-f521d18f08fa
Apr 14 02:01:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a90c9768-8efd-4501-9a62-cbcd71d01bf5 tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "fa29c144-0ff9-4efb-a574-f521d18f08fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.762s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:01:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:12 user nova-compute[71498]: DEBUG nova.compute.manager [req-18a007ec-0496-43b1-94b9-78e61f906998 req-5ea7e342-b8af-4407-97dc-417925b099cf service nova] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Received event network-vif-plugged-6a841349-4e6e-40e1-90f0-998d46c60567 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:01:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-18a007ec-0496-43b1-94b9-78e61f906998 req-5ea7e342-b8af-4407-97dc-417925b099cf service nova] Acquiring lock "fa29c144-0ff9-4efb-a574-f521d18f08fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:01:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-18a007ec-0496-43b1-94b9-78e61f906998 req-5ea7e342-b8af-4407-97dc-417925b099cf service nova] Lock "fa29c144-0ff9-4efb-a574-f521d18f08fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:01:12 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-18a007ec-0496-43b1-94b9-78e61f906998 req-5ea7e342-b8af-4407-97dc-417925b099cf service nova] Lock "fa29c144-0ff9-4efb-a574-f521d18f08fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:01:12 user nova-compute[71498]: DEBUG nova.compute.manager [req-18a007ec-0496-43b1-94b9-78e61f906998 req-5ea7e342-b8af-4407-97dc-417925b099cf service nova] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] No waiting events found dispatching network-vif-plugged-6a841349-4e6e-40e1-90f0-998d46c60567 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:01:12 user nova-compute[71498]: WARNING nova.compute.manager [req-18a007ec-0496-43b1-94b9-78e61f906998 req-5ea7e342-b8af-4407-97dc-417925b099cf service nova] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Received unexpected event network-vif-plugged-6a841349-4e6e-40e1-90f0-998d46c60567 for instance with vm_state deleted and task_state None.
Apr 14 02:01:12 user nova-compute[71498]: DEBUG nova.compute.manager [req-18a007ec-0496-43b1-94b9-78e61f906998 req-5ea7e342-b8af-4407-97dc-417925b099cf service nova] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Received event network-vif-deleted-6a841349-4e6e-40e1-90f0-998d46c60567 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:01:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:15 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:20 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:25 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681437670.7105706, fa29c144-0ff9-4efb-a574-f521d18f08fa => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:01:25 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] VM Stopped (Lifecycle Event)
Apr 14 02:01:25 user nova-compute[71498]: DEBUG nova.compute.manager [None req-0c07fb2b-f8b7-4150-b37c-90f0629b6027 None None] [instance: fa29c144-0ff9-4efb-a574-f521d18f08fa] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:01:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:01:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:01:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:01:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:01:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-6592ab8d-a657-41f1-86c7-cd19d83a444c req-234fb8e5-6038-4271-9a9c-c29bd3a1542e service nova] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Received event network-changed-5b8a0a31-9ecf-4b31-a458-778005d846f4 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:01:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-6592ab8d-a657-41f1-86c7-cd19d83a444c req-234fb8e5-6038-4271-9a9c-c29bd3a1542e service nova] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Refreshing instance network info cache due to event network-changed-5b8a0a31-9ecf-4b31-a458-778005d846f4. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 02:01:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6592ab8d-a657-41f1-86c7-cd19d83a444c req-234fb8e5-6038-4271-9a9c-c29bd3a1542e service nova] Acquiring lock "refresh_cache-5ba29111-1e9b-4947-b046-6bbe888eca06" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:01:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6592ab8d-a657-41f1-86c7-cd19d83a444c req-234fb8e5-6038-4271-9a9c-c29bd3a1542e service nova] Acquired lock "refresh_cache-5ba29111-1e9b-4947-b046-6bbe888eca06" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:01:40 user nova-compute[71498]: DEBUG nova.network.neutron [req-6592ab8d-a657-41f1-86c7-cd19d83a444c req-234fb8e5-6038-4271-9a9c-c29bd3a1542e service nova] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Refreshing network info cache for port 5b8a0a31-9ecf-4b31-a458-778005d846f4 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 02:01:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:41 user nova-compute[71498]: DEBUG nova.network.neutron [req-6592ab8d-a657-41f1-86c7-cd19d83a444c req-234fb8e5-6038-4271-9a9c-c29bd3a1542e service nova] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Updated VIF entry in instance network info cache for port 5b8a0a31-9ecf-4b31-a458-778005d846f4. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 02:01:41 user nova-compute[71498]: DEBUG nova.network.neutron [req-6592ab8d-a657-41f1-86c7-cd19d83a444c req-234fb8e5-6038-4271-9a9c-c29bd3a1542e service nova] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Updating instance_info_cache with network_info: [{"id": "5b8a0a31-9ecf-4b31-a458-778005d846f4", "address": "fa:16:3e:90:92:14", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8a0a31-9e", "ovs_interfaceid": "5b8a0a31-9ecf-4b31-a458-778005d846f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:01:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6592ab8d-a657-41f1-86c7-cd19d83a444c req-234fb8e5-6038-4271-9a9c-c29bd3a1542e service nova] Releasing lock "refresh_cache-5ba29111-1e9b-4947-b046-6bbe888eca06" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:01:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:43 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:01:44 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:01:44 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 02:01:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-9152f969-e279-4182-aa0a-8534458acbca" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:01:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-9152f969-e279-4182-aa0a-8534458acbca" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:01:44 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 02:01:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "24db983d-4ad5-45be-a8e5-8448b3e5e065" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:01:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "24db983d-4ad5-45be-a8e5-8448b3e5e065" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:01:44 user nova-compute[71498]: DEBUG nova.compute.manager [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 02:01:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:01:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:01:44 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 02:01:44 user nova-compute[71498]: INFO nova.compute.claims [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Claim successful on node user
Apr 14 02:01:45 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Updating instance_info_cache with network_info: [{"id": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "address": "fa:16:3e:66:5e:af", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0b5d20-30", "ovs_interfaceid": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:01:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-9152f969-e279-4182-aa0a-8534458acbca" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:01:45 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 02:01:45 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:01:45 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:01:45 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:01:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.348s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:01:45 user nova-compute[71498]: DEBUG nova.compute.manager [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 02:01:45 user nova-compute[71498]: DEBUG nova.compute.manager [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 02:01:45 user nova-compute[71498]: DEBUG nova.network.neutron [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 02:01:45 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 02:01:45 user nova-compute[71498]: DEBUG nova.compute.manager [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 02:01:45 user nova-compute[71498]: DEBUG nova.policy [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '78ccd1a1ec1b486981d850881734fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4ed4ab2fd4c14b3e2afe343fd7256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 02:01:45 user nova-compute[71498]: INFO nova.virt.block_device [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Booting with volume 06b73a5e-5178-4561-af91-11e1028d2238 at /dev/vda
Apr 14 02:01:45 user nova-compute[71498]: DEBUG os_brick.utils [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:01:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:01:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:01:45 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fadd7c-be81-4c73-83a2-da494848f75e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:01:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:01:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:01:45 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[760ff397-6277-4966-96ab-812bac5bfc4d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:01:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:01:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:01:45 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[86720eb6-edfe-4435-8b1e-49313d598b95]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:01:45 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd913aaa-7528-46e6-accb-849497512051]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:01:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:01:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 02:01:45 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 02:01:45 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:01:45 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 02:01:45 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 02:01:45 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae323af-f0bf-4d58-9ff5-90ff8e75dfc9]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:01:45 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 02:01:45 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 02:01:45 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 02:01:45 user nova-compute[71498]: DEBUG os_brick.utils [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:01:45 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Updating existing volume attachment record: f932be5d-eab5-4d37-aaba-5e5df63df9f6 {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 02:01:46 user nova-compute[71498]: DEBUG nova.network.neutron [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Successfully created port: 9f06d104-c24c-4287-817c-9f05b53fbb29 {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 02:01:46 user nova-compute[71498]: DEBUG nova.network.neutron [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Successfully updated port: 9f06d104-c24c-4287-817c-9f05b53fbb29 {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 02:01:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "refresh_cache-24db983d-4ad5-45be-a8e5-8448b3e5e065" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:01:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquired lock "refresh_cache-24db983d-4ad5-45be-a8e5-8448b3e5e065" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:01:46 user nova-compute[71498]: DEBUG nova.network.neutron [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 02:01:47 user nova-compute[71498]: DEBUG nova.compute.manager [req-031f74c3-8d89-4b43-a89d-b81fdceefa85 req-769d123a-3d8e-4acc-b29d-40b80078b90a service nova] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Received event network-changed-9f06d104-c24c-4287-817c-9f05b53fbb29 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:01:47 user nova-compute[71498]: DEBUG nova.compute.manager [req-031f74c3-8d89-4b43-a89d-b81fdceefa85 req-769d123a-3d8e-4acc-b29d-40b80078b90a service nova] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Refreshing instance network info cache due to event network-changed-9f06d104-c24c-4287-817c-9f05b53fbb29. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 02:01:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-031f74c3-8d89-4b43-a89d-b81fdceefa85 req-769d123a-3d8e-4acc-b29d-40b80078b90a service nova] Acquiring lock "refresh_cache-24db983d-4ad5-45be-a8e5-8448b3e5e065" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:01:47 user nova-compute[71498]: DEBUG nova.network.neutron [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 02:01:47 user nova-compute[71498]: DEBUG nova.network.neutron [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Updating instance_info_cache with network_info: [{"id": "9f06d104-c24c-4287-817c-9f05b53fbb29", "address": "fa:16:3e:7b:17:65", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f06d104-c2", "ovs_interfaceid": "9f06d104-c24c-4287-817c-9f05b53fbb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:01:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Releasing lock "refresh_cache-24db983d-4ad5-45be-a8e5-8448b3e5e065" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:01:47 user nova-compute[71498]: DEBUG nova.compute.manager [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Instance network_info: |[{"id": "9f06d104-c24c-4287-817c-9f05b53fbb29", "address": "fa:16:3e:7b:17:65", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f06d104-c2", "ovs_interfaceid": "9f06d104-c24c-4287-817c-9f05b53fbb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 02:01:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-031f74c3-8d89-4b43-a89d-b81fdceefa85 req-769d123a-3d8e-4acc-b29d-40b80078b90a service nova] Acquired lock "refresh_cache-24db983d-4ad5-45be-a8e5-8448b3e5e065" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:01:47 user nova-compute[71498]: DEBUG nova.network.neutron [req-031f74c3-8d89-4b43-a89d-b81fdceefa85 req-769d123a-3d8e-4acc-b29d-40b80078b90a service nova] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Refreshing network info cache for port 9f06d104-c24c-4287-817c-9f05b53fbb29 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 02:01:47 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:01:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:01:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:01:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:01:47 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 02:01:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:01:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:01:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:01:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:01:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:01:47 user nova-compute[71498]: DEBUG nova.network.neutron [req-031f74c3-8d89-4b43-a89d-b81fdceefa85 req-769d123a-3d8e-4acc-b29d-40b80078b90a service nova] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Updated VIF entry in instance network info cache for port 9f06d104-c24c-4287-817c-9f05b53fbb29. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 02:01:47 user nova-compute[71498]: DEBUG nova.network.neutron [req-031f74c3-8d89-4b43-a89d-b81fdceefa85 req-769d123a-3d8e-4acc-b29d-40b80078b90a service nova] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Updating instance_info_cache with network_info: [{"id": "9f06d104-c24c-4287-817c-9f05b53fbb29", "address": "fa:16:3e:7b:17:65", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f06d104-c2", "ovs_interfaceid": "9f06d104-c24c-4287-817c-9f05b53fbb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:01:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-031f74c3-8d89-4b43-a89d-b81fdceefa85 req-769d123a-3d8e-4acc-b29d-40b80078b90a service nova] Releasing lock "refresh_cache-24db983d-4ad5-45be-a8e5-8448b3e5e065" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:01:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:01:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:01:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:01:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:01:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:01:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:01:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:01:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:01:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:01:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:01:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:01:49 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:01:49 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:01:49 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=8364MB free_disk=26.30169677734375GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 02:01:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:01:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:01:49 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance a19a1c08-5454-481b-bb5a-70c39ead9afc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:01:49 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 5ba29111-1e9b-4947-b046-6bbe888eca06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:01:49 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 9152f969-e279-4182-aa0a-8534458acbca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:01:49 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:01:49 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:01:49 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 02:01:49 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 02:01:49 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:01:49 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:01:49 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 02:01:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.334s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:01:50 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:01:50 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Cleaning up deleted instances with incomplete migration  {{(pid=71498) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 02:01:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:51 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:01:51 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:01:51 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:01:51 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Cleaning up deleted instances {{(pid=71498) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 02:01:51 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] There are 0 instances to clean {{(pid=71498) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG nova.compute.manager [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 02:01:53 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Creating image(s)
Apr 14 02:01:53 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Did not create local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Ensure instance console log exists: /opt/stack/data/nova/instances/24db983d-4ad5-45be-a8e5-8448b3e5e065/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Start _get_guest_xml network_info=[{"id": "9f06d104-c24c-4287-817c-9f05b53fbb29", "address": "fa:16:3e:7b:17:65", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f06d104-c2", "ovs_interfaceid": "9f06d104-c24c-4287-817c-9f05b53fbb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f932be5d-eab5-4d37-aaba-5e5df63df9f6', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBVCXlJa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '24db983d-4ad5-45be-a8e5-8448b3e5e065', 'attached_at': '', 'detached_at': '', 'volume_id': '06b73a5e-5178-4561-af91-11e1028d2238', 'serial': '06b73a5e-5178-4561-af91-11e1028d2238'}, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 02:01:53 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:01:53 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:01:53 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBVCXlJa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:01:53 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:01:53 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:01:53 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:01:53 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:01:53 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff1fcb5-b3a5-4995-95bd-ea30f6df28c0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 02:01:53 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2711af11-5d7e-4dc5-b5ee-7fb1ffdaea45]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238] added
Apr 14 02:01:53 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9764902-8e98-48bc-84df-bf9eba2ed605]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf60bd98-3f2e-430b-96d6-3dee8eda1f33]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HBVCXlJa {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HBVCXlJa" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b8e215-9b27-49ad-8b39-6d0660bbb208]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HBVCXlJa'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60cb82d-b5ba-4b26-b2a5-c851c266433a]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[191d1330-b70a-4664-b43b-bbe4345849ad]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 02:01:53 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 02:01:53 user nova-compute[71498]:  {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:01:53 user nova-compute[71498]: WARNING os_brick.initiator.connectors.iscsi [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 02:01:53 user nova-compute[71498]: 
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[763eba50-421a-4bbb-8fe1-55f224cc51fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238, portal: 172.16.0.220,3260]
Apr 14 02:01:53 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238, portal: 172.16.0.220,3260] successful.
Apr 14 02:01:53 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f346b7a-3e01-4be8-b762-ec8587e89d1a]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3512cd14-fb1f-43a3-ab38-bc1846020319]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:01:53 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:01:53 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a447662-dee1-4477-b7d2-f65e5ced24be]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 02:01:53 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBVCXlJa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 02:01:54 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:01:54 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 02:01:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:01:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '23466306261366663', 'path': '/dev/sdb'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:01:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466306261366663', 'path': '/dev/sdb'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 02:01:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:01:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-240203784',display_name='tempest-ServerActionsTestJSON-server-240203784',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-240203784',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7iIvlhM+wCditCRaonOriLx8WWyehY8kYxTUZ36Z1Q4VGm2JnuefQ18D+1ncnGXJXgbpg/EWHmDPRQFx9TQ2PBQ5aNgSGRUcq/Ovi+zGjOYQDNVYkQyEvsulSNtijWoQ==',key_name='tempest-keypair-165395776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ed4ed4ab2fd4c14b3e2afe343fd7256',ramdisk_id='',reservation_id='r-wapff4we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-2035821517',owner_user_name='tempest-ServerActionsTestJSON-2035821517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T02:01:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78ccd1a1ec1b486981d850881734fe02',uuid=24db983d-4ad5-45be-a8e5-8448b3e5e065,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f06d104-c24c-4287-817c-9f05b53fbb29", "address": "fa:16:3e:7b:17:65", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f06d104-c2", "ovs_interfaceid": "9f06d104-c24c-4287-817c-9f05b53fbb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 02:01:54 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converting VIF {"id": "9f06d104-c24c-4287-817c-9f05b53fbb29", "address": "fa:16:3e:7b:17:65", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f06d104-c2", "ovs_interfaceid": "9f06d104-c24c-4287-817c-9f05b53fbb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:01:54 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:17:65,bridge_name='br-int',has_traffic_filtering=True,id=9f06d104-c24c-4287-817c-9f05b53fbb29,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f06d104-c2') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:01:54 user nova-compute[71498]: DEBUG nova.objects.instance [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lazy-loading 'pci_devices' on Instance uuid 24db983d-4ad5-45be-a8e5-8448b3e5e065 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:01:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] End _get_guest_xml xml=<domain type="kvm">
Apr 14 02:01:54 user nova-compute[71498]:   <uuid>24db983d-4ad5-45be-a8e5-8448b3e5e065</uuid>
Apr 14 02:01:54 user nova-compute[71498]:   <name>instance-00000024</name>
Apr 14 02:01:54 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 02:01:54 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 02:01:54 user nova-compute[71498]:   <metadata>
Apr 14 02:01:54 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 02:01:54 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 02:01:54 user nova-compute[71498]:       <nova:name>tempest-ServerActionsTestJSON-server-240203784</nova:name>
Apr 14 02:01:54 user nova-compute[71498]:       <nova:creationTime>2023-04-14 02:01:53</nova:creationTime>
Apr 14 02:01:54 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 02:01:54 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 02:01:54 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 02:01:54 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 02:01:54 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 02:01:54 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 02:01:54 user nova-compute[71498]:       </nova:flavor>
Apr 14 02:01:54 user nova-compute[71498]:       <nova:owner>
Apr 14 02:01:54 user nova-compute[71498]:         <nova:user uuid="78ccd1a1ec1b486981d850881734fe02">tempest-ServerActionsTestJSON-2035821517-project-member</nova:user>
Apr 14 02:01:54 user nova-compute[71498]:         <nova:project uuid="2ed4ed4ab2fd4c14b3e2afe343fd7256">tempest-ServerActionsTestJSON-2035821517</nova:project>
Apr 14 02:01:54 user nova-compute[71498]:       </nova:owner>
Apr 14 02:01:54 user nova-compute[71498]:       <nova:ports>
Apr 14 02:01:54 user nova-compute[71498]:         <nova:port uuid="9f06d104-c24c-4287-817c-9f05b53fbb29">
Apr 14 02:01:54 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 02:01:54 user nova-compute[71498]:         </nova:port>
Apr 14 02:01:54 user nova-compute[71498]:       </nova:ports>
Apr 14 02:01:54 user nova-compute[71498]:     </nova:instance>
Apr 14 02:01:54 user nova-compute[71498]:   </metadata>
Apr 14 02:01:54 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 02:01:54 user nova-compute[71498]:     <system>
Apr 14 02:01:54 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 02:01:54 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 02:01:54 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 02:01:54 user nova-compute[71498]:       <entry name="serial">24db983d-4ad5-45be-a8e5-8448b3e5e065</entry>
Apr 14 02:01:54 user nova-compute[71498]:       <entry name="uuid">24db983d-4ad5-45be-a8e5-8448b3e5e065</entry>
Apr 14 02:01:54 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 02:01:54 user nova-compute[71498]:     </system>
Apr 14 02:01:54 user nova-compute[71498]:   </sysinfo>
Apr 14 02:01:54 user nova-compute[71498]:   <os>
Apr 14 02:01:54 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 02:01:54 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 02:01:54 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 02:01:54 user nova-compute[71498]:   </os>
Apr 14 02:01:54 user nova-compute[71498]:   <features>
Apr 14 02:01:54 user nova-compute[71498]:     <acpi/>
Apr 14 02:01:54 user nova-compute[71498]:     <apic/>
Apr 14 02:01:54 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 02:01:54 user nova-compute[71498]:   </features>
Apr 14 02:01:54 user nova-compute[71498]:   <clock offset="utc">
Apr 14 02:01:54 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 02:01:54 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 02:01:54 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 02:01:54 user nova-compute[71498]:   </clock>
Apr 14 02:01:54 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 02:01:54 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 02:01:54 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 02:01:54 user nova-compute[71498]:   </cpu>
Apr 14 02:01:54 user nova-compute[71498]:   <devices>
Apr 14 02:01:54 user nova-compute[71498]:     <disk type="block" device="disk">
Apr 14 02:01:54 user nova-compute[71498]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:01:54 user nova-compute[71498]:       <source dev="/dev/sdb"/>
Apr 14 02:01:54 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 02:01:54 user nova-compute[71498]:       <serial>06b73a5e-5178-4561-af91-11e1028d2238</serial>
Apr 14 02:01:54 user nova-compute[71498]:     </disk>
Apr 14 02:01:54 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 02:01:54 user nova-compute[71498]:       <mac address="fa:16:3e:7b:17:65"/>
Apr 14 02:01:54 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 02:01:54 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 02:01:54 user nova-compute[71498]:       <target dev="tap9f06d104-c2"/>
Apr 14 02:01:54 user nova-compute[71498]:     </interface>
Apr 14 02:01:54 user nova-compute[71498]:     <serial type="pty">
Apr 14 02:01:54 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/24db983d-4ad5-45be-a8e5-8448b3e5e065/console.log" append="off"/>
Apr 14 02:01:54 user nova-compute[71498]:     </serial>
Apr 14 02:01:54 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 02:01:54 user nova-compute[71498]:     <video>
Apr 14 02:01:54 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 02:01:54 user nova-compute[71498]:     </video>
Apr 14 02:01:54 user nova-compute[71498]:     <rng model="virtio">
Apr 14 02:01:54 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 02:01:54 user nova-compute[71498]:     </rng>
Apr 14 02:01:54 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 02:01:54 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 02:01:54 user nova-compute[71498]:       <stats period="10"/>
Apr 14 02:01:54 user nova-compute[71498]:     </memballoon>
Apr 14 02:01:54 user nova-compute[71498]:   </devices>
Apr 14 02:01:54 user nova-compute[71498]: </domain>
Apr 14 02:01:54 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 02:01:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:01:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-240203784',display_name='tempest-ServerActionsTestJSON-server-240203784',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-240203784',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7iIvlhM+wCditCRaonOriLx8WWyehY8kYxTUZ36Z1Q4VGm2JnuefQ18D+1ncnGXJXgbpg/EWHmDPRQFx9TQ2PBQ5aNgSGRUcq/Ovi+zGjOYQDNVYkQyEvsulSNtijWoQ==',key_name='tempest-keypair-165395776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ed4ed4ab2fd4c14b3e2afe343fd7256',ramdisk_id='',reservation_id='r-wapff4we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-2035821517',owner_user_name='tempest-ServerActionsTestJSON-2035821517-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T02:01:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78ccd1a1ec1b486981d850881734fe02',uuid=24db983d-4ad5-45be-a8e5-8448b3e5e065,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f06d104-c24c-4287-817c-9f05b53fbb29", "address": "fa:16:3e:7b:17:65", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f06d104-c2", "ovs_interfaceid": "9f06d104-c24c-4287-817c-9f05b53fbb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 02:01:54 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converting VIF {"id": "9f06d104-c24c-4287-817c-9f05b53fbb29", "address": "fa:16:3e:7b:17:65", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f06d104-c2", "ovs_interfaceid": "9f06d104-c24c-4287-817c-9f05b53fbb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:01:54 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:17:65,bridge_name='br-int',has_traffic_filtering=True,id=9f06d104-c24c-4287-817c-9f05b53fbb29,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f06d104-c2') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:01:54 user nova-compute[71498]: DEBUG os_vif [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:17:65,bridge_name='br-int',has_traffic_filtering=True,id=9f06d104-c24c-4287-817c-9f05b53fbb29,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f06d104-c2') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 02:01:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:01:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 02:01:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f06d104-c2, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:01:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9f06d104-c2, col_values=(('external_ids', {'iface-id': '9f06d104-c24c-4287-817c-9f05b53fbb29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:17:65', 'vm-uuid': '24db983d-4ad5-45be-a8e5-8448b3e5e065'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:01:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:01:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:54 user nova-compute[71498]: INFO os_vif [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:17:65,bridge_name='br-int',has_traffic_filtering=True,id=9f06d104-c24c-4287-817c-9f05b53fbb29,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f06d104-c2')
Apr 14 02:01:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:01:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] No VIF found with MAC fa:16:3e:7b:17:65, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 02:01:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:56 user nova-compute[71498]: DEBUG nova.compute.manager [req-7c072ffc-75ee-410b-9cfd-3f9816c4eb09 req-55ff5218-fb94-46db-9409-7509ab9e2f66 service nova] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Received event network-vif-plugged-9f06d104-c24c-4287-817c-9f05b53fbb29 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:01:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7c072ffc-75ee-410b-9cfd-3f9816c4eb09 req-55ff5218-fb94-46db-9409-7509ab9e2f66 service nova] Acquiring lock "24db983d-4ad5-45be-a8e5-8448b3e5e065-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:01:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7c072ffc-75ee-410b-9cfd-3f9816c4eb09 req-55ff5218-fb94-46db-9409-7509ab9e2f66 service nova] Lock "24db983d-4ad5-45be-a8e5-8448b3e5e065-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:01:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7c072ffc-75ee-410b-9cfd-3f9816c4eb09 req-55ff5218-fb94-46db-9409-7509ab9e2f66 service nova] Lock "24db983d-4ad5-45be-a8e5-8448b3e5e065-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:01:56 user nova-compute[71498]: DEBUG nova.compute.manager [req-7c072ffc-75ee-410b-9cfd-3f9816c4eb09 req-55ff5218-fb94-46db-9409-7509ab9e2f66 service nova] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] No waiting events found dispatching network-vif-plugged-9f06d104-c24c-4287-817c-9f05b53fbb29 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:01:56 user nova-compute[71498]: WARNING nova.compute.manager [req-7c072ffc-75ee-410b-9cfd-3f9816c4eb09 req-55ff5218-fb94-46db-9409-7509ab9e2f66 service nova] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Received unexpected event network-vif-plugged-9f06d104-c24c-4287-817c-9f05b53fbb29 for instance with vm_state building and task_state spawning.
Apr 14 02:01:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:58 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437718.016439, 24db983d-4ad5-45be-a8e5-8448b3e5e065 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:01:58 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] VM Resumed (Lifecycle Event)
Apr 14 02:01:58 user nova-compute[71498]: DEBUG nova.compute.manager [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 02:01:58 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 02:01:58 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Instance spawned successfully.
Apr 14 02:01:58 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 02:01:58 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:01:58 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 02:01:58 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:01:58 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:01:58 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:01:58 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:01:58 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:01:58 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:01:58 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 02:01:58 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437718.0223503, 24db983d-4ad5-45be-a8e5-8448b3e5e065 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:01:58 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] VM Started (Lifecycle Event)
Apr 14 02:01:58 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:01:58 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 02:01:58 user nova-compute[71498]: DEBUG nova.compute.manager [req-1765f6f1-efc6-419c-9672-2e271172f202 req-9c0b9969-e591-44d4-97ef-3ea5c82b9691 service nova] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Received event network-vif-plugged-9f06d104-c24c-4287-817c-9f05b53fbb29 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:01:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1765f6f1-efc6-419c-9672-2e271172f202 req-9c0b9969-e591-44d4-97ef-3ea5c82b9691 service nova] Acquiring lock "24db983d-4ad5-45be-a8e5-8448b3e5e065-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:01:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1765f6f1-efc6-419c-9672-2e271172f202 req-9c0b9969-e591-44d4-97ef-3ea5c82b9691 service nova] Lock "24db983d-4ad5-45be-a8e5-8448b3e5e065-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:01:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1765f6f1-efc6-419c-9672-2e271172f202 req-9c0b9969-e591-44d4-97ef-3ea5c82b9691 service nova] Lock "24db983d-4ad5-45be-a8e5-8448b3e5e065-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:01:58 user nova-compute[71498]: DEBUG nova.compute.manager [req-1765f6f1-efc6-419c-9672-2e271172f202 req-9c0b9969-e591-44d4-97ef-3ea5c82b9691 service nova] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] No waiting events found dispatching network-vif-plugged-9f06d104-c24c-4287-817c-9f05b53fbb29 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:01:58 user nova-compute[71498]: WARNING nova.compute.manager [req-1765f6f1-efc6-419c-9672-2e271172f202 req-9c0b9969-e591-44d4-97ef-3ea5c82b9691 service nova] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Received unexpected event network-vif-plugged-9f06d104-c24c-4287-817c-9f05b53fbb29 for instance with vm_state building and task_state spawning.
Apr 14 02:01:58 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 02:01:58 user nova-compute[71498]: INFO nova.compute.manager [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Took 4.98 seconds to spawn the instance on the hypervisor.
Apr 14 02:01:58 user nova-compute[71498]: DEBUG nova.compute.manager [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:01:58 user nova-compute[71498]: INFO nova.compute.manager [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Took 13.32 seconds to build instance.
Apr 14 02:01:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4aaef0ce-ac16-4469-84d1-c561aa585b26 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "24db983d-4ad5-45be-a8e5-8448b3e5e065" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.411s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:01:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:01:58 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:01:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-1cc9311c-40fc-4bba-8a2c-0e1c12ebf2aa tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "a19a1c08-5454-481b-bb5a-70c39ead9afc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:02:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-1cc9311c-40fc-4bba-8a2c-0e1c12ebf2aa tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "a19a1c08-5454-481b-bb5a-70c39ead9afc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:02:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-1cc9311c-40fc-4bba-8a2c-0e1c12ebf2aa tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:02:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-1cc9311c-40fc-4bba-8a2c-0e1c12ebf2aa tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:02:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-1cc9311c-40fc-4bba-8a2c-0e1c12ebf2aa tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:02:00 user nova-compute[71498]: INFO nova.compute.manager [None req-1cc9311c-40fc-4bba-8a2c-0e1c12ebf2aa tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Terminating instance
Apr 14 02:02:00 user nova-compute[71498]: DEBUG nova.compute.manager [None req-1cc9311c-40fc-4bba-8a2c-0e1c12ebf2aa tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 02:02:00 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:00 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:00 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:00 user nova-compute[71498]: DEBUG nova.compute.manager [req-982f78b1-098d-4a34-bf2c-3cf33fc48b38 req-742b4400-8765-4901-b7fd-09d6b8f798b3 service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Received event network-vif-unplugged-2b00fd21-ee22-48c1-beb5-66e60de9876a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:02:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-982f78b1-098d-4a34-bf2c-3cf33fc48b38 req-742b4400-8765-4901-b7fd-09d6b8f798b3 service nova] Acquiring lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:02:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-982f78b1-098d-4a34-bf2c-3cf33fc48b38 req-742b4400-8765-4901-b7fd-09d6b8f798b3 service nova] Lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:02:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-982f78b1-098d-4a34-bf2c-3cf33fc48b38 req-742b4400-8765-4901-b7fd-09d6b8f798b3 service nova] Lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:02:00 user nova-compute[71498]: DEBUG nova.compute.manager [req-982f78b1-098d-4a34-bf2c-3cf33fc48b38 req-742b4400-8765-4901-b7fd-09d6b8f798b3 service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] No waiting events found dispatching network-vif-unplugged-2b00fd21-ee22-48c1-beb5-66e60de9876a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:02:00 user nova-compute[71498]: DEBUG nova.compute.manager [req-982f78b1-098d-4a34-bf2c-3cf33fc48b38 req-742b4400-8765-4901-b7fd-09d6b8f798b3 service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Received event network-vif-unplugged-2b00fd21-ee22-48c1-beb5-66e60de9876a for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 02:02:01 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:01 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Instance destroyed successfully.
Apr 14 02:02:01 user nova-compute[71498]: DEBUG nova.objects.instance [None req-1cc9311c-40fc-4bba-8a2c-0e1c12ebf2aa tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lazy-loading 'resources' on Instance uuid a19a1c08-5454-481b-bb5a-70c39ead9afc {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:02:01 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-1cc9311c-40fc-4bba-8a2c-0e1c12ebf2aa tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:45:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-611036692',display_name='tempest-ServerRescueNegativeTestJSON-server-611036692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-611036692',id=18,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:49:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d3de04739384e3ea3a475fee28be3c0',ramdisk_id='',reservation_id='r-nnoryzj4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1453869246',owner_user_name='tempest-ServerRescueNegativeTestJSON-1453869246-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:51:48Z,user_data=None,user_id='eeb5f26be86e43b3b61fff98fdc83cf3',uuid=a19a1c08-5454-481b-bb5a-70c39ead9afc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "address": "fa:16:3e:1f:54:6c", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b00fd21-ee", "ovs_interfaceid": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 02:02:01 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-1cc9311c-40fc-4bba-8a2c-0e1c12ebf2aa tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Converting VIF {"id": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "address": "fa:16:3e:1f:54:6c", "network": {"id": "2c4fba9e-0217-4e37-af1c-065b3f0cd093", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1118504246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d3de04739384e3ea3a475fee28be3c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b00fd21-ee", "ovs_interfaceid": "2b00fd21-ee22-48c1-beb5-66e60de9876a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:02:01 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-1cc9311c-40fc-4bba-8a2c-0e1c12ebf2aa tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:54:6c,bridge_name='br-int',has_traffic_filtering=True,id=2b00fd21-ee22-48c1-beb5-66e60de9876a,network=Network(2c4fba9e-0217-4e37-af1c-065b3f0cd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b00fd21-ee') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:02:01 user nova-compute[71498]: DEBUG os_vif [None req-1cc9311c-40fc-4bba-8a2c-0e1c12ebf2aa tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:54:6c,bridge_name='br-int',has_traffic_filtering=True,id=2b00fd21-ee22-48c1-beb5-66e60de9876a,network=Network(2c4fba9e-0217-4e37-af1c-065b3f0cd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b00fd21-ee') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 02:02:01 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:01 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b00fd21-ee, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:02:01 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:01 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:01 user nova-compute[71498]: INFO os_vif [None req-1cc9311c-40fc-4bba-8a2c-0e1c12ebf2aa tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:54:6c,bridge_name='br-int',has_traffic_filtering=True,id=2b00fd21-ee22-48c1-beb5-66e60de9876a,network=Network(2c4fba9e-0217-4e37-af1c-065b3f0cd093),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b00fd21-ee')
Apr 14 02:02:01 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-1cc9311c-40fc-4bba-8a2c-0e1c12ebf2aa tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Deleting instance files /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc_del
Apr 14 02:02:01 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-1cc9311c-40fc-4bba-8a2c-0e1c12ebf2aa tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Deletion of /opt/stack/data/nova/instances/a19a1c08-5454-481b-bb5a-70c39ead9afc_del complete
Apr 14 02:02:01 user nova-compute[71498]: INFO nova.compute.manager [None req-1cc9311c-40fc-4bba-8a2c-0e1c12ebf2aa tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 14 02:02:01 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-1cc9311c-40fc-4bba-8a2c-0e1c12ebf2aa tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 02:02:01 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 02:02:01 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 02:02:02 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:02:02 user nova-compute[71498]: DEBUG nova.compute.manager [req-9dcc9f7f-fcd0-4de8-9bf7-6e95a1f84422 req-93a32b3c-0e85-4d7d-b4a9-2a9b18ba78ae service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Received event network-vif-deleted-2b00fd21-ee22-48c1-beb5-66e60de9876a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:02:02 user nova-compute[71498]: INFO nova.compute.manager [req-9dcc9f7f-fcd0-4de8-9bf7-6e95a1f84422 req-93a32b3c-0e85-4d7d-b4a9-2a9b18ba78ae service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Neutron deleted interface 2b00fd21-ee22-48c1-beb5-66e60de9876a; detaching it from the instance and deleting it from the info cache
Apr 14 02:02:02 user nova-compute[71498]: DEBUG nova.network.neutron [req-9dcc9f7f-fcd0-4de8-9bf7-6e95a1f84422 req-93a32b3c-0e85-4d7d-b4a9-2a9b18ba78ae service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:02:02 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Took 0.63 seconds to deallocate network for instance.
Apr 14 02:02:02 user nova-compute[71498]: DEBUG nova.compute.manager [req-9dcc9f7f-fcd0-4de8-9bf7-6e95a1f84422 req-93a32b3c-0e85-4d7d-b4a9-2a9b18ba78ae service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Detach interface failed, port_id=2b00fd21-ee22-48c1-beb5-66e60de9876a, reason: Instance a19a1c08-5454-481b-bb5a-70c39ead9afc could not be found. {{(pid=71498) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 02:02:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-1cc9311c-40fc-4bba-8a2c-0e1c12ebf2aa tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:02:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-1cc9311c-40fc-4bba-8a2c-0e1c12ebf2aa tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:02:02 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-1cc9311c-40fc-4bba-8a2c-0e1c12ebf2aa tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:02:02 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-1cc9311c-40fc-4bba-8a2c-0e1c12ebf2aa tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:02:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-1cc9311c-40fc-4bba-8a2c-0e1c12ebf2aa tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.234s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:02:02 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-1cc9311c-40fc-4bba-8a2c-0e1c12ebf2aa tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Deleted allocations for instance a19a1c08-5454-481b-bb5a-70c39ead9afc
Apr 14 02:02:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-1cc9311c-40fc-4bba-8a2c-0e1c12ebf2aa tempest-ServerRescueNegativeTestJSON-1453869246 tempest-ServerRescueNegativeTestJSON-1453869246-project-member] Lock "a19a1c08-5454-481b-bb5a-70c39ead9afc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.967s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:02:02 user nova-compute[71498]: DEBUG nova.compute.manager [req-e7aa6c87-b9af-4e28-b620-bbe478e3dd8c req-05257013-acb2-489d-aecb-c02e31c68d76 service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Received event network-vif-plugged-2b00fd21-ee22-48c1-beb5-66e60de9876a {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:02:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e7aa6c87-b9af-4e28-b620-bbe478e3dd8c req-05257013-acb2-489d-aecb-c02e31c68d76 service nova] Acquiring lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:02:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e7aa6c87-b9af-4e28-b620-bbe478e3dd8c req-05257013-acb2-489d-aecb-c02e31c68d76 service nova] Lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:02:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e7aa6c87-b9af-4e28-b620-bbe478e3dd8c req-05257013-acb2-489d-aecb-c02e31c68d76 service nova] Lock "a19a1c08-5454-481b-bb5a-70c39ead9afc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:02:02 user nova-compute[71498]: DEBUG nova.compute.manager [req-e7aa6c87-b9af-4e28-b620-bbe478e3dd8c req-05257013-acb2-489d-aecb-c02e31c68d76 service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] No waiting events found dispatching network-vif-plugged-2b00fd21-ee22-48c1-beb5-66e60de9876a {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:02:02 user nova-compute[71498]: WARNING nova.compute.manager [req-e7aa6c87-b9af-4e28-b620-bbe478e3dd8c req-05257013-acb2-489d-aecb-c02e31c68d76 service nova] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Received unexpected event network-vif-plugged-2b00fd21-ee22-48c1-beb5-66e60de9876a for instance with vm_state deleted and task_state None.
Apr 14 02:02:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-509d7d8b-d3b6-4c23-93ed-ff52f1533deb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "9152f969-e279-4182-aa0a-8534458acbca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:02:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-509d7d8b-d3b6-4c23-93ed-ff52f1533deb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "9152f969-e279-4182-aa0a-8534458acbca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:02:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-509d7d8b-d3b6-4c23-93ed-ff52f1533deb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "9152f969-e279-4182-aa0a-8534458acbca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:02:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-509d7d8b-d3b6-4c23-93ed-ff52f1533deb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "9152f969-e279-4182-aa0a-8534458acbca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:02:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-509d7d8b-d3b6-4c23-93ed-ff52f1533deb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "9152f969-e279-4182-aa0a-8534458acbca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:02:05 user nova-compute[71498]: INFO nova.compute.manager [None req-509d7d8b-d3b6-4c23-93ed-ff52f1533deb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Terminating instance
Apr 14 02:02:05 user nova-compute[71498]: DEBUG nova.compute.manager [None req-509d7d8b-d3b6-4c23-93ed-ff52f1533deb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 02:02:06 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:06 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:06 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:06 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:06 user nova-compute[71498]: DEBUG nova.compute.manager [req-b839c3bf-19ea-4965-b43d-1956c6f86aff req-ab459823-b8c9-4f25-a71a-9f5ac6d58aab service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Received event network-vif-unplugged-cb0b5d20-30a0-4636-82c8-0c7637d66465 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:02:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b839c3bf-19ea-4965-b43d-1956c6f86aff req-ab459823-b8c9-4f25-a71a-9f5ac6d58aab service nova] Acquiring lock "9152f969-e279-4182-aa0a-8534458acbca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:02:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b839c3bf-19ea-4965-b43d-1956c6f86aff req-ab459823-b8c9-4f25-a71a-9f5ac6d58aab service nova] Lock "9152f969-e279-4182-aa0a-8534458acbca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:02:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b839c3bf-19ea-4965-b43d-1956c6f86aff req-ab459823-b8c9-4f25-a71a-9f5ac6d58aab service nova] Lock "9152f969-e279-4182-aa0a-8534458acbca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:02:06 user nova-compute[71498]: DEBUG nova.compute.manager [req-b839c3bf-19ea-4965-b43d-1956c6f86aff req-ab459823-b8c9-4f25-a71a-9f5ac6d58aab service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] No waiting events found dispatching network-vif-unplugged-cb0b5d20-30a0-4636-82c8-0c7637d66465 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:02:06 user nova-compute[71498]: DEBUG nova.compute.manager [req-b839c3bf-19ea-4965-b43d-1956c6f86aff req-ab459823-b8c9-4f25-a71a-9f5ac6d58aab service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Received event network-vif-unplugged-cb0b5d20-30a0-4636-82c8-0c7637d66465 for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 02:02:06 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:06 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:06 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Instance destroyed successfully.
Apr 14 02:02:06 user nova-compute[71498]: DEBUG nova.objects.instance [None req-509d7d8b-d3b6-4c23-93ed-ff52f1533deb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lazy-loading 'resources' on Instance uuid 9152f969-e279-4182-aa0a-8534458acbca {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:02:06 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-509d7d8b-d3b6-4c23-93ed-ff52f1533deb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T01:56:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1283417408',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1283417408',id=32,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIopxcmtvU7zv42zkIa4Oz1jEP4DNyyAzFY9+vRTU16RetxI5ZPVi+sg5XXxOyu9RTbP8T9qWJjnsbfeLu0C5tcKuN56PwVxP5mYkQsJP0kN6YvWI8oVts6rIeLy1vmUYw==',key_name='tempest-keypair-1419165173',keypairs=<?>,launch_index=0,launched_at=2023-04-14T02:00:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6d05ca328d64f2aa1d19550475edba3',ramdisk_id='',reservation_id='r-wryfyacz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2042065984',owner_user_name='tempest-AttachVolumeShelveTestJSON-2042065984-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T02:00:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a5da3e233c74524a953ce0d4e074077',uuid=9152f969-e279-4182-aa0a-8534458acbca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "address": "fa:16:3e:66:5e:af", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0b5d20-30", "ovs_interfaceid": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 02:02:06 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-509d7d8b-d3b6-4c23-93ed-ff52f1533deb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Converting VIF {"id": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "address": "fa:16:3e:66:5e:af", "network": {"id": "a7b6c0bc-d2de-4431-821b-c2917738e556", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-307434699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d05ca328d64f2aa1d19550475edba3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb0b5d20-30", "ovs_interfaceid": "cb0b5d20-30a0-4636-82c8-0c7637d66465", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:02:06 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-509d7d8b-d3b6-4c23-93ed-ff52f1533deb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:5e:af,bridge_name='br-int',has_traffic_filtering=True,id=cb0b5d20-30a0-4636-82c8-0c7637d66465,network=Network(a7b6c0bc-d2de-4431-821b-c2917738e556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb0b5d20-30') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:02:06 user nova-compute[71498]: DEBUG os_vif [None req-509d7d8b-d3b6-4c23-93ed-ff52f1533deb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:5e:af,bridge_name='br-int',has_traffic_filtering=True,id=cb0b5d20-30a0-4636-82c8-0c7637d66465,network=Network(a7b6c0bc-d2de-4431-821b-c2917738e556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb0b5d20-30') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 02:02:06 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:06 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb0b5d20-30, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:02:06 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:02:06 user nova-compute[71498]: INFO os_vif [None req-509d7d8b-d3b6-4c23-93ed-ff52f1533deb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:5e:af,bridge_name='br-int',has_traffic_filtering=True,id=cb0b5d20-30a0-4636-82c8-0c7637d66465,network=Network(a7b6c0bc-d2de-4431-821b-c2917738e556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb0b5d20-30')
Apr 14 02:02:06 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-509d7d8b-d3b6-4c23-93ed-ff52f1533deb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Deleting instance files /opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca_del
Apr 14 02:02:06 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-509d7d8b-d3b6-4c23-93ed-ff52f1533deb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Deletion of /opt/stack/data/nova/instances/9152f969-e279-4182-aa0a-8534458acbca_del complete
Apr 14 02:02:06 user nova-compute[71498]: INFO nova.compute.manager [None req-509d7d8b-d3b6-4c23-93ed-ff52f1533deb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 14 02:02:06 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-509d7d8b-d3b6-4c23-93ed-ff52f1533deb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 02:02:06 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 02:02:06 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 9152f969-e279-4182-aa0a-8534458acbca] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 02:02:07 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:02:07 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Took 0.76 seconds to deallocate network for instance.
Apr 14 02:02:07 user nova-compute[71498]: DEBUG nova.compute.manager [req-e7f6ba30-f10a-49dd-bc1a-9d1aadc50129 req-862a2392-4719-4d67-9c97-5a06a6115532 service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Received event network-vif-deleted-cb0b5d20-30a0-4636-82c8-0c7637d66465 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:02:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-509d7d8b-d3b6-4c23-93ed-ff52f1533deb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:02:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-509d7d8b-d3b6-4c23-93ed-ff52f1533deb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:02:07 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-509d7d8b-d3b6-4c23-93ed-ff52f1533deb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:02:07 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-509d7d8b-d3b6-4c23-93ed-ff52f1533deb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:02:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-509d7d8b-d3b6-4c23-93ed-ff52f1533deb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.294s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:02:08 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-509d7d8b-d3b6-4c23-93ed-ff52f1533deb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Deleted allocations for instance 9152f969-e279-4182-aa0a-8534458acbca
Apr 14 02:02:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-509d7d8b-d3b6-4c23-93ed-ff52f1533deb tempest-AttachVolumeShelveTestJSON-2042065984 tempest-AttachVolumeShelveTestJSON-2042065984-project-member] Lock "9152f969-e279-4182-aa0a-8534458acbca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.164s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:02:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:08 user nova-compute[71498]: DEBUG nova.compute.manager [req-c1ecb28a-537e-481e-a713-787ef3d74a97 req-2a38e907-ccae-49dd-b816-dbd5322301bd service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Received event network-vif-plugged-cb0b5d20-30a0-4636-82c8-0c7637d66465 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:02:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c1ecb28a-537e-481e-a713-787ef3d74a97 req-2a38e907-ccae-49dd-b816-dbd5322301bd service nova] Acquiring lock "9152f969-e279-4182-aa0a-8534458acbca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:02:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c1ecb28a-537e-481e-a713-787ef3d74a97 req-2a38e907-ccae-49dd-b816-dbd5322301bd service nova] Lock "9152f969-e279-4182-aa0a-8534458acbca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:02:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c1ecb28a-537e-481e-a713-787ef3d74a97 req-2a38e907-ccae-49dd-b816-dbd5322301bd service nova] Lock "9152f969-e279-4182-aa0a-8534458acbca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:02:08 user nova-compute[71498]: DEBUG nova.compute.manager [req-c1ecb28a-537e-481e-a713-787ef3d74a97 req-2a38e907-ccae-49dd-b816-dbd5322301bd service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] No waiting events found dispatching network-vif-plugged-cb0b5d20-30a0-4636-82c8-0c7637d66465 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:02:08 user nova-compute[71498]: WARNING nova.compute.manager [req-c1ecb28a-537e-481e-a713-787ef3d74a97 req-2a38e907-ccae-49dd-b816-dbd5322301bd service nova] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Received unexpected event network-vif-plugged-cb0b5d20-30a0-4636-82c8-0c7637d66465 for instance with vm_state deleted and task_state None.
Apr 14 02:02:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:15 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:16 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681437721.3173904, a19a1c08-5454-481b-bb5a-70c39ead9afc => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:02:16 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] VM Stopped (Lifecycle Event)
Apr 14 02:02:16 user nova-compute[71498]: DEBUG nova.compute.manager [None req-9975163d-ea6c-472f-b8d1-e76871fac8a1 None None] [instance: a19a1c08-5454-481b-bb5a-70c39ead9afc] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:02:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:19 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:21 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:21 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681437726.7492614, 9152f969-e279-4182-aa0a-8534458acbca => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:02:21 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 9152f969-e279-4182-aa0a-8534458acbca] VM Stopped (Lifecycle Event)
Apr 14 02:02:21 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:21 user nova-compute[71498]: DEBUG nova.compute.manager [None req-888b1231-348e-4c11-9271-96d7634390dd None None] [instance: 9152f969-e279-4182-aa0a-8534458acbca] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:02:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:26 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "57b15ad5-341a-47f8-9e3e-5cec8a85098a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:02:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "57b15ad5-341a-47f8-9e3e-5cec8a85098a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:02:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 02:02:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:02:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:02:27 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 02:02:27 user nova-compute[71498]: INFO nova.compute.claims [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Claim successful on node user
Apr 14 02:02:27 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:02:27 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:02:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.262s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:02:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 02:02:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 02:02:27 user nova-compute[71498]: DEBUG nova.network.neutron [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 02:02:27 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 02:02:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 02:02:27 user nova-compute[71498]: DEBUG nova.policy [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ae5170969344b9fa5294231f8ffbe72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dc405e16434633956ed2cd7e1791cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 02:02:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 02:02:27 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 02:02:27 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Creating image(s)
Apr 14 02:02:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "/opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:02:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "/opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:02:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "/opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:02:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:02:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.147s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:02:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:02:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:02:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:02:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.151s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:02:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:02:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk 1073741824" returned: 0 in 0.048s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:02:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:02:27 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:02:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.135s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:02:28 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Checking if we can resize image /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 02:02:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:02:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:02:28 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Cannot resize image /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 02:02:28 user nova-compute[71498]: DEBUG nova.objects.instance [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lazy-loading 'migration_context' on Instance uuid 57b15ad5-341a-47f8-9e3e-5cec8a85098a {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:02:28 user nova-compute[71498]: DEBUG nova.network.neutron [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Successfully created port: 18eed24e-8acb-457c-95b8-64c141faa4aa {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 02:02:28 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 02:02:28 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Ensure instance console log exists: /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 02:02:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:02:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:02:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:02:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG nova.network.neutron [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Successfully updated port: 18eed24e-8acb-457c-95b8-64c141faa4aa {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "refresh_cache-57b15ad5-341a-47f8-9e3e-5cec8a85098a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquired lock "refresh_cache-57b15ad5-341a-47f8-9e3e-5cec8a85098a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG nova.network.neutron [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG nova.compute.manager [req-d1cf86df-315c-49a5-9e77-61dc02964864 req-0c21bbf1-7433-4cb9-8a57-6c9a0330a978 service nova] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Received event network-changed-18eed24e-8acb-457c-95b8-64c141faa4aa {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG nova.compute.manager [req-d1cf86df-315c-49a5-9e77-61dc02964864 req-0c21bbf1-7433-4cb9-8a57-6c9a0330a978 service nova] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Refreshing instance network info cache due to event network-changed-18eed24e-8acb-457c-95b8-64c141faa4aa. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d1cf86df-315c-49a5-9e77-61dc02964864 req-0c21bbf1-7433-4cb9-8a57-6c9a0330a978 service nova] Acquiring lock "refresh_cache-57b15ad5-341a-47f8-9e3e-5cec8a85098a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG nova.network.neutron [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG nova.network.neutron [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Updating instance_info_cache with network_info: [{"id": "18eed24e-8acb-457c-95b8-64c141faa4aa", "address": "fa:16:3e:8a:75:08", "network": {"id": "d099696f-2c31-4ce1-89d8-680d87d17b9b", "bridge": "br-int", "label": "tempest-TestStampPattern-665967680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27dc405e16434633956ed2cd7e1791cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18eed24e-8a", "ovs_interfaceid": "18eed24e-8acb-457c-95b8-64c141faa4aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Releasing lock "refresh_cache-57b15ad5-341a-47f8-9e3e-5cec8a85098a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG nova.compute.manager [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Instance network_info: |[{"id": "18eed24e-8acb-457c-95b8-64c141faa4aa", "address": "fa:16:3e:8a:75:08", "network": {"id": "d099696f-2c31-4ce1-89d8-680d87d17b9b", "bridge": "br-int", "label": "tempest-TestStampPattern-665967680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27dc405e16434633956ed2cd7e1791cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18eed24e-8a", "ovs_interfaceid": "18eed24e-8acb-457c-95b8-64c141faa4aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d1cf86df-315c-49a5-9e77-61dc02964864 req-0c21bbf1-7433-4cb9-8a57-6c9a0330a978 service nova] Acquired lock "refresh_cache-57b15ad5-341a-47f8-9e3e-5cec8a85098a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG nova.network.neutron [req-d1cf86df-315c-49a5-9e77-61dc02964864 req-0c21bbf1-7433-4cb9-8a57-6c9a0330a978 service nova] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Refreshing network info cache for port 18eed24e-8acb-457c-95b8-64c141faa4aa {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Start _get_guest_xml network_info=[{"id": "18eed24e-8acb-457c-95b8-64c141faa4aa", "address": "fa:16:3e:8a:75:08", "network": {"id": "d099696f-2c31-4ce1-89d8-680d87d17b9b", "bridge": "br-int", "label": "tempest-TestStampPattern-665967680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27dc405e16434633956ed2cd7e1791cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18eed24e-8a", "ovs_interfaceid": "18eed24e-8acb-457c-95b8-64c141faa4aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 02:02:29 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:02:29 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:02:29 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:02:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-237482406',display_name='tempest-TestStampPattern-server-237482406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-237482406',id=37,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN71XmYAhugQNhgl+EJR/4+t7AjKtKkpcGBG8gx2VPAwa0I3bKysgOFGLrmgG1OeFgwpiuJDroargohcSM2hH/0cqZkFOvlkmK46/6QQTJRBUwCSuTngzFe2HQ0i1G666A==',key_name='tempest-TestStampPattern-610075453',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27dc405e16434633956ed2cd7e1791cd',ramdisk_id='',reservation_id='r-0y7kuukr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-190654074',owner_user_name='tempest-TestStampPattern-190654074-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T02:02:27Z,user_data=None,user_id='7ae5170969344b9fa5294231f8ffbe72',uuid=57b15ad5-341a-47f8-9e3e-5cec8a85098a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18eed24e-8acb-457c-95b8-64c141faa4aa", "address": "fa:16:3e:8a:75:08", "network": {"id": "d099696f-2c31-4ce1-89d8-680d87d17b9b", "bridge": "br-int", "label": "tempest-TestStampPattern-665967680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27dc405e16434633956ed2cd7e1791cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18eed24e-8a", "ovs_interfaceid": "18eed24e-8acb-457c-95b8-64c141faa4aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Converting VIF {"id": "18eed24e-8acb-457c-95b8-64c141faa4aa", "address": "fa:16:3e:8a:75:08", "network": {"id": "d099696f-2c31-4ce1-89d8-680d87d17b9b", "bridge": "br-int", "label": "tempest-TestStampPattern-665967680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27dc405e16434633956ed2cd7e1791cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18eed24e-8a", "ovs_interfaceid": "18eed24e-8acb-457c-95b8-64c141faa4aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:75:08,bridge_name='br-int',has_traffic_filtering=True,id=18eed24e-8acb-457c-95b8-64c141faa4aa,network=Network(d099696f-2c31-4ce1-89d8-680d87d17b9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18eed24e-8a') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG nova.objects.instance [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lazy-loading 'pci_devices' on Instance uuid 57b15ad5-341a-47f8-9e3e-5cec8a85098a {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] End _get_guest_xml xml=<domain type="kvm">
Apr 14 02:02:29 user nova-compute[71498]:   <uuid>57b15ad5-341a-47f8-9e3e-5cec8a85098a</uuid>
Apr 14 02:02:29 user nova-compute[71498]:   <name>instance-00000025</name>
Apr 14 02:02:29 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 02:02:29 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 02:02:29 user nova-compute[71498]:   <metadata>
Apr 14 02:02:29 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 02:02:29 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 02:02:29 user nova-compute[71498]:       <nova:name>tempest-TestStampPattern-server-237482406</nova:name>
Apr 14 02:02:29 user nova-compute[71498]:       <nova:creationTime>2023-04-14 02:02:29</nova:creationTime>
Apr 14 02:02:29 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 02:02:29 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 02:02:29 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 02:02:29 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 02:02:29 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 02:02:29 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 02:02:29 user nova-compute[71498]:       </nova:flavor>
Apr 14 02:02:29 user nova-compute[71498]:       <nova:owner>
Apr 14 02:02:29 user nova-compute[71498]:         <nova:user uuid="7ae5170969344b9fa5294231f8ffbe72">tempest-TestStampPattern-190654074-project-member</nova:user>
Apr 14 02:02:29 user nova-compute[71498]:         <nova:project uuid="27dc405e16434633956ed2cd7e1791cd">tempest-TestStampPattern-190654074</nova:project>
Apr 14 02:02:29 user nova-compute[71498]:       </nova:owner>
Apr 14 02:02:29 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 02:02:29 user nova-compute[71498]:       <nova:ports>
Apr 14 02:02:29 user nova-compute[71498]:         <nova:port uuid="18eed24e-8acb-457c-95b8-64c141faa4aa">
Apr 14 02:02:29 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 02:02:29 user nova-compute[71498]:         </nova:port>
Apr 14 02:02:29 user nova-compute[71498]:       </nova:ports>
Apr 14 02:02:29 user nova-compute[71498]:     </nova:instance>
Apr 14 02:02:29 user nova-compute[71498]:   </metadata>
Apr 14 02:02:29 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 02:02:29 user nova-compute[71498]:     <system>
Apr 14 02:02:29 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 02:02:29 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 02:02:29 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 02:02:29 user nova-compute[71498]:       <entry name="serial">57b15ad5-341a-47f8-9e3e-5cec8a85098a</entry>
Apr 14 02:02:29 user nova-compute[71498]:       <entry name="uuid">57b15ad5-341a-47f8-9e3e-5cec8a85098a</entry>
Apr 14 02:02:29 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 02:02:29 user nova-compute[71498]:     </system>
Apr 14 02:02:29 user nova-compute[71498]:   </sysinfo>
Apr 14 02:02:29 user nova-compute[71498]:   <os>
Apr 14 02:02:29 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 02:02:29 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 02:02:29 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 02:02:29 user nova-compute[71498]:   </os>
Apr 14 02:02:29 user nova-compute[71498]:   <features>
Apr 14 02:02:29 user nova-compute[71498]:     <acpi/>
Apr 14 02:02:29 user nova-compute[71498]:     <apic/>
Apr 14 02:02:29 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 02:02:29 user nova-compute[71498]:   </features>
Apr 14 02:02:29 user nova-compute[71498]:   <clock offset="utc">
Apr 14 02:02:29 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 02:02:29 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 02:02:29 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 02:02:29 user nova-compute[71498]:   </clock>
Apr 14 02:02:29 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 02:02:29 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 02:02:29 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 02:02:29 user nova-compute[71498]:   </cpu>
Apr 14 02:02:29 user nova-compute[71498]:   <devices>
Apr 14 02:02:29 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 02:02:29 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 02:02:29 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk"/>
Apr 14 02:02:29 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 02:02:29 user nova-compute[71498]:     </disk>
Apr 14 02:02:29 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 02:02:29 user nova-compute[71498]:       <mac address="fa:16:3e:8a:75:08"/>
Apr 14 02:02:29 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 02:02:29 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 02:02:29 user nova-compute[71498]:       <target dev="tap18eed24e-8a"/>
Apr 14 02:02:29 user nova-compute[71498]:     </interface>
Apr 14 02:02:29 user nova-compute[71498]:     <serial type="pty">
Apr 14 02:02:29 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/console.log" append="off"/>
Apr 14 02:02:29 user nova-compute[71498]:     </serial>
Apr 14 02:02:29 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 02:02:29 user nova-compute[71498]:     <video>
Apr 14 02:02:29 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 02:02:29 user nova-compute[71498]:     </video>
Apr 14 02:02:29 user nova-compute[71498]:     <rng model="virtio">
Apr 14 02:02:29 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 02:02:29 user nova-compute[71498]:     </rng>
Apr 14 02:02:29 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 02:02:29 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 02:02:29 user nova-compute[71498]:       <stats period="10"/>
Apr 14 02:02:29 user nova-compute[71498]:     </memballoon>
Apr 14 02:02:29 user nova-compute[71498]:   </devices>
Apr 14 02:02:29 user nova-compute[71498]: </domain>
Apr 14 02:02:29 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:02:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-237482406',display_name='tempest-TestStampPattern-server-237482406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-237482406',id=37,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN71XmYAhugQNhgl+EJR/4+t7AjKtKkpcGBG8gx2VPAwa0I3bKysgOFGLrmgG1OeFgwpiuJDroargohcSM2hH/0cqZkFOvlkmK46/6QQTJRBUwCSuTngzFe2HQ0i1G666A==',key_name='tempest-TestStampPattern-610075453',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27dc405e16434633956ed2cd7e1791cd',ramdisk_id='',reservation_id='r-0y7kuukr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-190654074',owner_user_name='tempest-TestStampPattern-190654074-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T02:02:27Z,user_data=None,user_id='7ae5170969344b9fa5294231f8ffbe72',uuid=57b15ad5-341a-47f8-9e3e-5cec8a85098a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18eed24e-8acb-457c-95b8-64c141faa4aa", "address": "fa:16:3e:8a:75:08", "network": {"id": "d099696f-2c31-4ce1-89d8-680d87d17b9b", "bridge": "br-int", "label": "tempest-TestStampPattern-665967680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27dc405e16434633956ed2cd7e1791cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18eed24e-8a", "ovs_interfaceid": "18eed24e-8acb-457c-95b8-64c141faa4aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Converting VIF {"id": "18eed24e-8acb-457c-95b8-64c141faa4aa", "address": "fa:16:3e:8a:75:08", "network": {"id": "d099696f-2c31-4ce1-89d8-680d87d17b9b", "bridge": "br-int", "label": "tempest-TestStampPattern-665967680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27dc405e16434633956ed2cd7e1791cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18eed24e-8a", "ovs_interfaceid": "18eed24e-8acb-457c-95b8-64c141faa4aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:75:08,bridge_name='br-int',has_traffic_filtering=True,id=18eed24e-8acb-457c-95b8-64c141faa4aa,network=Network(d099696f-2c31-4ce1-89d8-680d87d17b9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18eed24e-8a') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG os_vif [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:75:08,bridge_name='br-int',has_traffic_filtering=True,id=18eed24e-8acb-457c-95b8-64c141faa4aa,network=Network(d099696f-2c31-4ce1-89d8-680d87d17b9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18eed24e-8a') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18eed24e-8a, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap18eed24e-8a, col_values=(('external_ids', {'iface-id': '18eed24e-8acb-457c-95b8-64c141faa4aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:75:08', 'vm-uuid': '57b15ad5-341a-47f8-9e3e-5cec8a85098a'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:29 user nova-compute[71498]: INFO os_vif [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:75:08,bridge_name='br-int',has_traffic_filtering=True,id=18eed24e-8acb-457c-95b8-64c141faa4aa,network=Network(d099696f-2c31-4ce1-89d8-680d87d17b9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18eed24e-8a')
Apr 14 02:02:29 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:02:29 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] No VIF found with MAC fa:16:3e:8a:75:08, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 02:02:30 user nova-compute[71498]: DEBUG nova.network.neutron [req-d1cf86df-315c-49a5-9e77-61dc02964864 req-0c21bbf1-7433-4cb9-8a57-6c9a0330a978 service nova] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Updated VIF entry in instance network info cache for port 18eed24e-8acb-457c-95b8-64c141faa4aa. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 02:02:30 user nova-compute[71498]: DEBUG nova.network.neutron [req-d1cf86df-315c-49a5-9e77-61dc02964864 req-0c21bbf1-7433-4cb9-8a57-6c9a0330a978 service nova] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Updating instance_info_cache with network_info: [{"id": "18eed24e-8acb-457c-95b8-64c141faa4aa", "address": "fa:16:3e:8a:75:08", "network": {"id": "d099696f-2c31-4ce1-89d8-680d87d17b9b", "bridge": "br-int", "label": "tempest-TestStampPattern-665967680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27dc405e16434633956ed2cd7e1791cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18eed24e-8a", "ovs_interfaceid": "18eed24e-8acb-457c-95b8-64c141faa4aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:02:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d1cf86df-315c-49a5-9e77-61dc02964864 req-0c21bbf1-7433-4cb9-8a57-6c9a0330a978 service nova] Releasing lock "refresh_cache-57b15ad5-341a-47f8-9e3e-5cec8a85098a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:02:31 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:31 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:31 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:31 user nova-compute[71498]: DEBUG nova.compute.manager [req-6a1d3eda-94e2-4999-9fa9-4f672605d9ca req-0fcca780-ee6f-46a1-b5d3-508f834e2af6 service nova] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Received event network-vif-plugged-18eed24e-8acb-457c-95b8-64c141faa4aa {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:02:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6a1d3eda-94e2-4999-9fa9-4f672605d9ca req-0fcca780-ee6f-46a1-b5d3-508f834e2af6 service nova] Acquiring lock "57b15ad5-341a-47f8-9e3e-5cec8a85098a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:02:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6a1d3eda-94e2-4999-9fa9-4f672605d9ca req-0fcca780-ee6f-46a1-b5d3-508f834e2af6 service nova] Lock "57b15ad5-341a-47f8-9e3e-5cec8a85098a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:02:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6a1d3eda-94e2-4999-9fa9-4f672605d9ca req-0fcca780-ee6f-46a1-b5d3-508f834e2af6 service nova] Lock "57b15ad5-341a-47f8-9e3e-5cec8a85098a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:02:31 user nova-compute[71498]: DEBUG nova.compute.manager [req-6a1d3eda-94e2-4999-9fa9-4f672605d9ca req-0fcca780-ee6f-46a1-b5d3-508f834e2af6 service nova] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] No waiting events found dispatching network-vif-plugged-18eed24e-8acb-457c-95b8-64c141faa4aa {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:02:31 user nova-compute[71498]: WARNING nova.compute.manager [req-6a1d3eda-94e2-4999-9fa9-4f672605d9ca req-0fcca780-ee6f-46a1-b5d3-508f834e2af6 service nova] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Received unexpected event network-vif-plugged-18eed24e-8acb-457c-95b8-64c141faa4aa for instance with vm_state building and task_state spawning.
Apr 14 02:02:31 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:31 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:31 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:31 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:31 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:33 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437753.5515606, 57b15ad5-341a-47f8-9e3e-5cec8a85098a => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:02:33 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] VM Resumed (Lifecycle Event)
Apr 14 02:02:33 user nova-compute[71498]: DEBUG nova.compute.manager [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 02:02:33 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 02:02:33 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Instance spawned successfully.
Apr 14 02:02:33 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 02:02:33 user nova-compute[71498]: DEBUG nova.compute.manager [req-e3c0a35b-5db7-4782-b1ab-3c44026c5a78 req-25639497-9af0-4152-a563-8cfa024ae7fd service nova] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Received event network-vif-plugged-18eed24e-8acb-457c-95b8-64c141faa4aa {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:02:33 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e3c0a35b-5db7-4782-b1ab-3c44026c5a78 req-25639497-9af0-4152-a563-8cfa024ae7fd service nova] Acquiring lock "57b15ad5-341a-47f8-9e3e-5cec8a85098a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:02:33 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e3c0a35b-5db7-4782-b1ab-3c44026c5a78 req-25639497-9af0-4152-a563-8cfa024ae7fd service nova] Lock "57b15ad5-341a-47f8-9e3e-5cec8a85098a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:02:33 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e3c0a35b-5db7-4782-b1ab-3c44026c5a78 req-25639497-9af0-4152-a563-8cfa024ae7fd service nova] Lock "57b15ad5-341a-47f8-9e3e-5cec8a85098a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:02:33 user nova-compute[71498]: DEBUG nova.compute.manager [req-e3c0a35b-5db7-4782-b1ab-3c44026c5a78 req-25639497-9af0-4152-a563-8cfa024ae7fd service nova] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] No waiting events found dispatching network-vif-plugged-18eed24e-8acb-457c-95b8-64c141faa4aa {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:02:33 user nova-compute[71498]: WARNING nova.compute.manager [req-e3c0a35b-5db7-4782-b1ab-3c44026c5a78 req-25639497-9af0-4152-a563-8cfa024ae7fd service nova] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Received unexpected event network-vif-plugged-18eed24e-8acb-457c-95b8-64c141faa4aa for instance with vm_state building and task_state spawning.
Apr 14 02:02:33 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:02:33 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 02:02:33 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:02:33 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:02:33 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:02:33 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:02:33 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:02:33 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:02:33 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 02:02:33 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437753.5534215, 57b15ad5-341a-47f8-9e3e-5cec8a85098a => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:02:33 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] VM Started (Lifecycle Event)
Apr 14 02:02:33 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:02:33 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 02:02:33 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 02:02:33 user nova-compute[71498]: INFO nova.compute.manager [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Took 6.17 seconds to spawn the instance on the hypervisor.
Apr 14 02:02:33 user nova-compute[71498]: DEBUG nova.compute.manager [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:02:33 user nova-compute[71498]: INFO nova.compute.manager [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Took 6.80 seconds to build instance.
Apr 14 02:02:33 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-49ee5889-ffd0-4718-8a8e-45b2a2aa7dee tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "57b15ad5-341a-47f8-9e3e-5cec8a85098a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.899s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:02:34 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:44 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:02:44 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 02:02:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-5ba29111-1e9b-4947-b046-6bbe888eca06" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:02:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-5ba29111-1e9b-4947-b046-6bbe888eca06" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:02:44 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 02:02:44 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:02:44 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:44 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:02:44 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:02:44 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:02:44 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:44 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Updating instance_info_cache with network_info: [{"id": "5b8a0a31-9ecf-4b31-a458-778005d846f4", "address": "fa:16:3e:90:92:14", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8a0a31-9e", "ovs_interfaceid": "5b8a0a31-9ecf-4b31-a458-778005d846f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:02:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-5ba29111-1e9b-4947-b046-6bbe888eca06" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:02:45 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 02:02:45 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:02:45 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:02:46 user nova-compute[71498]: DEBUG nova.compute.manager [req-6a073616-1062-43da-960d-d56f7c0ab260 req-54e046c6-8b10-473a-be0f-ad99879780cd service nova] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Received event network-changed-617da89e-c0c3-455c-992f-893a43fa7d3e {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:02:46 user nova-compute[71498]: DEBUG nova.compute.manager [req-6a073616-1062-43da-960d-d56f7c0ab260 req-54e046c6-8b10-473a-be0f-ad99879780cd service nova] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Refreshing instance network info cache due to event network-changed-617da89e-c0c3-455c-992f-893a43fa7d3e. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 02:02:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6a073616-1062-43da-960d-d56f7c0ab260 req-54e046c6-8b10-473a-be0f-ad99879780cd service nova] Acquiring lock "refresh_cache-b7c5d54a-48a6-4600-b87b-e1318e35c1fe" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:02:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6a073616-1062-43da-960d-d56f7c0ab260 req-54e046c6-8b10-473a-be0f-ad99879780cd service nova] Acquired lock "refresh_cache-b7c5d54a-48a6-4600-b87b-e1318e35c1fe" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:02:46 user nova-compute[71498]: DEBUG nova.network.neutron [req-6a073616-1062-43da-960d-d56f7c0ab260 req-54e046c6-8b10-473a-be0f-ad99879780cd service nova] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Refreshing network info cache for port 617da89e-c0c3-455c-992f-893a43fa7d3e {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 02:02:47 user nova-compute[71498]: DEBUG nova.network.neutron [req-6a073616-1062-43da-960d-d56f7c0ab260 req-54e046c6-8b10-473a-be0f-ad99879780cd service nova] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Updated VIF entry in instance network info cache for port 617da89e-c0c3-455c-992f-893a43fa7d3e. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 02:02:47 user nova-compute[71498]: DEBUG nova.network.neutron [req-6a073616-1062-43da-960d-d56f7c0ab260 req-54e046c6-8b10-473a-be0f-ad99879780cd service nova] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Updating instance_info_cache with network_info: [{"id": "617da89e-c0c3-455c-992f-893a43fa7d3e", "address": "fa:16:3e:e8:54:11", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617da89e-c0", "ovs_interfaceid": "617da89e-c0c3-455c-992f-893a43fa7d3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:02:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6a073616-1062-43da-960d-d56f7c0ab260 req-54e046c6-8b10-473a-be0f-ad99879780cd service nova] Releasing lock "refresh_cache-b7c5d54a-48a6-4600-b87b-e1318e35c1fe" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:02:47 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:02:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:02:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:02:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:02:47 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 02:02:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:02:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:02:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:02:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7c5d54a-48a6-4600-b87b-e1318e35c1fe/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:02:47 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 02:02:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:02:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:02:47 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:02:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:02:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:02:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:02:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:02:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:02:48 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:02:48 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:02:48 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=8431MB free_disk=26.301128387451172GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 02:02:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:02:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 5ba29111-1e9b-4947-b046-6bbe888eca06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 57b15ad5-341a-47f8-9e3e-5cec8a85098a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Refreshing inventories for resource provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Updating ProviderTree inventory for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Updating inventory in ProviderTree for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Refreshing aggregate associations for resource provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4, aggregates: None {{(pid=71498) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Refreshing trait associations for resource provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,HW_CPU_X86_SSE2 {{(pid=71498) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG nova.objects.instance [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'flavor' on Instance uuid b7c5d54a-48a6-4600-b87b-e1318e35c1fe {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.522s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:02:49 user nova-compute[71498]: INFO nova.compute.manager [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Attaching volume 97ad20ea-9d0f-482a-944e-c43cdf18b5aa to /dev/vdb
Apr 14 02:02:49 user nova-compute[71498]: DEBUG os_brick.utils [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94b9b7b-ca54-4e99-8eab-4ea93ccc4c2d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddf1659-7772-4fe5-a947-61b7b87161d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52d2778-4974-41a9-967b-eb556a103a00]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbceff2-d432-4a3f-a5cd-d364528f1306]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 02:02:49 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 02:02:49 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9fa382-fb2f-42f3-a902-9bab918fee9f]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG os_brick.utils [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Updating existing volume attachment record: 2aedc539-d08e-4ecc-b897-3c995a8c3a04 {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 02:02:49 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:53 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:02:53 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:02:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:53 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:02:53 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hlmbKWiI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:02:54 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:02:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:02:54 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:02:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:02:54 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 02:02:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a4fcba-7427-48cf-bfff-a7a9402dcd23]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 02:02:54 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d79ebf-450e-4ff4-8e50-fec15992ee6f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa] added
Apr 14 02:02:54 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1040d8fd-9b21-4512-8dba-e45cfd0311b5]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[14aafdcb-e38c-45fc-af3d-79e170a27a8f]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hlmbKWiI {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hlmbKWiI" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f6e799-5970-42a0-8f1a-6bd8a0f19aed]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hlmbKWiI'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3be74e0-f9d1-4dc3-9fdd-d7adb956f26a]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[768cd83e-967a-4f26-8227-629e0687d796]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:02:54 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:02:54 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c45fb9e-5cc4-45f8-8ca3-9a420491335e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa, portal: 172.16.0.220,3260]
Apr 14 02:02:54 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa, portal: 172.16.0.220,3260] successful.
Apr 14 02:02:54 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[099baa99-b509-46dd-bcec-901bfec7d08c]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a6cef3-24b8-46e8-892a-aa02cce7d8f0]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:02:54 user nova-compute[71498]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa (non-flash)
Apr 14 02:02:54 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:02:54 user nova-compute[71498]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa (non-flash)
Apr 14 02:02:54 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa8cf1a-e6c5-49c1-a7d5-e134c449141e]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: None {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 02:02:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:55 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:02:55 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:02:55 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 02:02:55 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 02:02:55 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hlmbKWiI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 02:02:55 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:02:55 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26263356330363038', 'path': '/dev/sdc'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:02:55 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263356330363038', 'path': '/dev/sdc'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 02:02:55 user nova-compute[71498]: DEBUG nova.objects.instance [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'flavor' on Instance uuid b7c5d54a-48a6-4600-b87b-e1318e35c1fe {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:02:55 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 02:02:55 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:02:55 user nova-compute[71498]:   <source dev="/dev/sdc"/>
Apr 14 02:02:55 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 02:02:55 user nova-compute[71498]:   <serial>97ad20ea-9d0f-482a-944e-c43cdf18b5aa</serial>
Apr 14 02:02:55 user nova-compute[71498]: </disk>
Apr 14 02:02:55 user nova-compute[71498]:  {{(pid=71498) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 02:02:55 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:02:55 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:02:55 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] No VIF found with MAC fa:16:3e:e8:54:11, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 02:02:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-acd8a0e3-6c2c-4ffb-b40f-311948fee134 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.604s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:02:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:02:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:02:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:02:59 user nova-compute[71498]: DEBUG nova.objects.instance [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'flavor' on Instance uuid b7c5d54a-48a6-4600-b87b-e1318e35c1fe {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:02:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:02:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:02:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:02:59 user nova-compute[71498]: INFO nova.compute.manager [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Attaching volume 41242a52-99d3-435b-aef0-48d05e966fc0 to /dev/vdc
Apr 14 02:03:00 user nova-compute[71498]: DEBUG os_brick.utils [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:03:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:00 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d678f5be-5eea-4c2c-b780-ec0b3d3e93bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:00 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c059cca-1687-450f-b216-ea6c68b0faa4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:00 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0a2af8-13c4-452e-ab5d-b1a55d22ef42]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:00 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2470845f-327b-4e68-a8b5-d48256a66946]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 02:03:00 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 02:03:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:00 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 02:03:00 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 02:03:00 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[090c7001-7af8-4c66-8f6c-81e48f04d35b]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:00 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 02:03:00 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 02:03:00 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 02:03:00 user nova-compute[71498]: DEBUG os_brick.utils [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:03:00 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Updating existing volume attachment record: 520c6b3f-c68d-4ee4-adea-f0b619e84d62 {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 02:03:01 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YyfdkZNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:03:04 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:03:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:03:04 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:03:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:03:04 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 02:03:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[79af77f1-18b3-43cb-9e4a-9710fd2410af]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 02:03:04 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[01902a03-5892-4e19-947d-e168a19d9993]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0] added
Apr 14 02:03:04 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb575b4-833e-4112-aed6-2c2b74fb9f29]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[48032b67-f52b-4a5a-962d-315f31789b5b]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YyfdkZNQ {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YyfdkZNQ" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ff30cf-2a59-4e76-abd3-c0dfb53ec000]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YyfdkZNQ'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b64b841-3ba1-40c2-b599-108fb59f03ce]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b530ff-21c6-49cc-b190-e65d88fedc86]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:03:04 user nova-compute[71498]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa (non-flash)
Apr 14 02:03:04 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:03:04 user nova-compute[71498]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa (non-flash)
Apr 14 02:03:04 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb03b2a9-051a-430e-ac60-7f507cd70336]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0, portal: 172.16.0.220,3260]
Apr 14 02:03:04 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0, portal: 172.16.0.220,3260] successful.
Apr 14 02:03:04 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[15171a08-55e1-468d-8a0e-a04aba090849]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c86d2f-0cec-491d-b1ca-ca06cba0096b]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:03:04 user nova-compute[71498]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa (non-flash)
Apr 14 02:03:04 user nova-compute[71498]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 (non-flash)
Apr 14 02:03:04 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:03:04 user nova-compute[71498]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa (non-flash)
Apr 14 02:03:04 user nova-compute[71498]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 (non-flash)
Apr 14 02:03:04 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f254ca-b33a-44fe-a48d-354587c06040]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 02:03:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YyfdkZNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 02:03:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:03:05 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23366313266373261', 'path': '/dev/sdd'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:03:05 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366313266373261', 'path': '/dev/sdd'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 02:03:05 user nova-compute[71498]: DEBUG nova.objects.instance [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'flavor' on Instance uuid b7c5d54a-48a6-4600-b87b-e1318e35c1fe {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:03:05 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 02:03:05 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:03:05 user nova-compute[71498]:   <source dev="/dev/sdd"/>
Apr 14 02:03:05 user nova-compute[71498]:   <target dev="vdc" bus="virtio"/>
Apr 14 02:03:05 user nova-compute[71498]:   <serial>41242a52-99d3-435b-aef0-48d05e966fc0</serial>
Apr 14 02:03:05 user nova-compute[71498]: </disk>
Apr 14 02:03:05 user nova-compute[71498]:  {{(pid=71498) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 02:03:06 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:06 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:03:06 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:03:06 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:03:06 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] No VIF found with MAC fa:16:3e:e8:54:11, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 02:03:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fe9be2d0-e9a6-42ee-a554-7816bdbfa377 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.536s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:03:08 user nova-compute[71498]: INFO nova.compute.manager [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Detaching volume 97ad20ea-9d0f-482a-944e-c43cdf18b5aa
Apr 14 02:03:08 user nova-compute[71498]: INFO nova.virt.block_device [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Attempting to driver detach volume 97ad20ea-9d0f-482a-944e-c43cdf18b5aa from mountpoint /dev/vdb
Apr 14 02:03:08 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Attempting to detach device vdb from instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe from the persistent domain config. {{(pid=71498) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 02:03:08 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:03:08 user nova-compute[71498]:   <source dev="/dev/sdc"/>
Apr 14 02:03:08 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 02:03:08 user nova-compute[71498]:   <serial>97ad20ea-9d0f-482a-944e-c43cdf18b5aa</serial>
Apr 14 02:03:08 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 02:03:08 user nova-compute[71498]: </disk>
Apr 14 02:03:08 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 02:03:08 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Successfully detached device vdb from instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe from the persistent domain config.
Apr 14 02:03:08 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe from the live domain config. {{(pid=71498) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 02:03:08 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:03:08 user nova-compute[71498]:   <source dev="/dev/sdc"/>
Apr 14 02:03:08 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 02:03:08 user nova-compute[71498]:   <serial>97ad20ea-9d0f-482a-944e-c43cdf18b5aa</serial>
Apr 14 02:03:08 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 02:03:08 user nova-compute[71498]: </disk>
Apr 14 02:03:08 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Received event <DeviceRemovedEvent: 1681437788.5363023, b7c5d54a-48a6-4600-b87b-e1318e35c1fe => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71498) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe {{(pid=71498) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 02:03:08 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Successfully detached device vdb from instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe from the live domain config.
Apr 14 02:03:08 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hlmbKWiI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:03:08 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:03:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b572b8c7-07bb-4c2e-aa17-0565199ef689]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 02:03:08 user nova-compute[71498]: No targets found.
Apr 14 02:03:08 user nova-compute[71498]: iSNS:
Apr 14 02:03:08 user nova-compute[71498]: No targets found.
Apr 14 02:03:08 user nova-compute[71498]: STATIC:
Apr 14 02:03:08 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa
Apr 14 02:03:08 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 02:03:08 user nova-compute[71498]:                 Iface Name: default
Apr 14 02:03:08 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238
Apr 14 02:03:08 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 02:03:08 user nova-compute[71498]:                 Iface Name: default
Apr 14 02:03:08 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0
Apr 14 02:03:08 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 02:03:08 user nova-compute[71498]:                 Iface Name: default
Apr 14 02:03:08 user nova-compute[71498]: FIRMWARE:
Apr 14 02:03:08 user nova-compute[71498]: No targets found.
Apr 14 02:03:08 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 02:03:08 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 02:03:08 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab805c2-dae1-40f2-b77d-2570e8e2049d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[50acc038-ef02-4131-a8bb-276aac613dab]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:03:08 user nova-compute[71498]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa (non-flash)
Apr 14 02:03:08 user nova-compute[71498]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 (non-flash)
Apr 14 02:03:08 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:03:08 user nova-compute[71498]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa (non-flash)
Apr 14 02:03:08 user nova-compute[71498]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 (non-flash)
Apr 14 02:03:08 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51f46b04c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa'): ({'sdc'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Removing single pathed devices sdc {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[19021526-ff33-427a-8823-2a473bf69e91]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acaf3cc-ff43-4c2b-baea-7ea431f8d79f]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Flushing IO for device /dev/sdc {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be83c7c-aecb-44ab-a7df-1e3fd49170e4]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[facb1f6c-c4dd-43e1-b9ee-00ecec392cd7]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] SCSI volumes sdc have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e44cd0c-8c4b-4b31-b878-3aa2ee670123]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5126fa-f117-4e65-a7ef-2017ef9061e0]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa, portal: 172.16.0.220,3260]
Apr 14 02:03:08 user nova-compute[71498]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa, portal: 172.16.0.220,3260] successful.
Apr 14 02:03:08 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ad20ea-9d0f-482a-944e-c43cdf18b5aa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[88849059-fa6b-4720-a613-a08910e6340b]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] <== disconnect_volume: return (300ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:03:08 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 02:03:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:10 user nova-compute[71498]: DEBUG nova.objects.instance [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'flavor' on Instance uuid b7c5d54a-48a6-4600-b87b-e1318e35c1fe {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:03:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a4f414a9-73eb-4b97-a5a3-cf72e9b0b656 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.268s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:03:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:03:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:03:11 user nova-compute[71498]: INFO nova.compute.manager [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Detaching volume 41242a52-99d3-435b-aef0-48d05e966fc0
Apr 14 02:03:11 user nova-compute[71498]: INFO nova.virt.block_device [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Attempting to driver detach volume 41242a52-99d3-435b-aef0-48d05e966fc0 from mountpoint /dev/vdc
Apr 14 02:03:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Attempting to detach device vdc from instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe from the persistent domain config. {{(pid=71498) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 02:03:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 02:03:11 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:03:11 user nova-compute[71498]:   <source dev="/dev/sdd"/>
Apr 14 02:03:11 user nova-compute[71498]:   <target dev="vdc" bus="virtio"/>
Apr 14 02:03:11 user nova-compute[71498]:   <serial>41242a52-99d3-435b-aef0-48d05e966fc0</serial>
Apr 14 02:03:11 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 02:03:11 user nova-compute[71498]: </disk>
Apr 14 02:03:11 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 02:03:11 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Successfully detached device vdc from instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe from the persistent domain config.
Apr 14 02:03:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe from the live domain config. {{(pid=71498) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 02:03:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 02:03:11 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:03:11 user nova-compute[71498]:   <source dev="/dev/sdd"/>
Apr 14 02:03:11 user nova-compute[71498]:   <target dev="vdc" bus="virtio"/>
Apr 14 02:03:11 user nova-compute[71498]:   <serial>41242a52-99d3-435b-aef0-48d05e966fc0</serial>
Apr 14 02:03:11 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 02:03:11 user nova-compute[71498]: </disk>
Apr 14 02:03:11 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Received event <DeviceRemovedEvent: 1681437792.0426452, b7c5d54a-48a6-4600-b87b-e1318e35c1fe => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71498) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe {{(pid=71498) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 02:03:12 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Successfully detached device vdc from instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe from the live domain config.
Apr 14 02:03:12 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YyfdkZNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:03:12 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:03:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[04074b7b-33a9-4409-8919-1eb4d2aa117e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 02:03:12 user nova-compute[71498]: No targets found.
Apr 14 02:03:12 user nova-compute[71498]: iSNS:
Apr 14 02:03:12 user nova-compute[71498]: No targets found.
Apr 14 02:03:12 user nova-compute[71498]: STATIC:
Apr 14 02:03:12 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238
Apr 14 02:03:12 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 02:03:12 user nova-compute[71498]:                 Iface Name: default
Apr 14 02:03:12 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0
Apr 14 02:03:12 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 02:03:12 user nova-compute[71498]:                 Iface Name: default
Apr 14 02:03:12 user nova-compute[71498]: FIRMWARE:
Apr 14 02:03:12 user nova-compute[71498]: No targets found.
Apr 14 02:03:12 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 02:03:12 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 02:03:12 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da8a95f-122c-4da2-b14a-92d7dc06d34c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ee2c83-0830-42a8-b8ee-57d689943806]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:03:12 user nova-compute[71498]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 (non-flash)
Apr 14 02:03:12 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:03:12 user nova-compute[71498]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 (non-flash)
Apr 14 02:03:12 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51c469e950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0'): ({'sdd'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Removing single pathed devices sdd {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a596a2-d244-48a7-9466-e54a38fa7811]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4990196-40e2-4ec6-9ae3-635dd8252db4]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Flushing IO for device /dev/sdd {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fa9dbb-d669-4374-8ef0-ae62646d2d52]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9b6bf7-0f7b-487c-bc92-522725f46c41]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] SCSI volumes sdd have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8146e63d-f9ca-4fdb-a281-b8c025a467af]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[962ba3ab-2ed6-4319-bdcd-ea69f6ff26ff]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0, portal: 172.16.0.220,3260]
Apr 14 02:03:12 user nova-compute[71498]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0, portal: 172.16.0.220,3260] successful.
Apr 14 02:03:12 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41242a52-99d3-435b-aef0-48d05e966fc0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6e333b-17dd-4a62-8297-da0e2abe9673]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] <== disconnect_volume: return (309ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:03:12 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 02:03:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:13 user nova-compute[71498]: DEBUG nova.objects.instance [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'flavor' on Instance uuid b7c5d54a-48a6-4600-b87b-e1318e35c1fe {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:03:13 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9835208f-6917-4b67-b940-723b5c62d9fe tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.878s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:03:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8b0894fc-35ec-413f-a85a-ee68cc208a06 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:03:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8b0894fc-35ec-413f-a85a-ee68cc208a06 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:03:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8b0894fc-35ec-413f-a85a-ee68cc208a06 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:03:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8b0894fc-35ec-413f-a85a-ee68cc208a06 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:03:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8b0894fc-35ec-413f-a85a-ee68cc208a06 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:03:14 user nova-compute[71498]: INFO nova.compute.manager [None req-8b0894fc-35ec-413f-a85a-ee68cc208a06 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Terminating instance
Apr 14 02:03:14 user nova-compute[71498]: DEBUG nova.compute.manager [None req-8b0894fc-35ec-413f-a85a-ee68cc208a06 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 02:03:14 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:14 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:14 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:14 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "a231fc48-a73e-4967-90c1-a31793235267" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:03:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "a231fc48-a73e-4967-90c1-a31793235267" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:03:14 user nova-compute[71498]: DEBUG nova.compute.manager [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG nova.compute.manager [req-ed3f94f7-b8d1-4b8d-bde5-d8e3967a1df2 req-05ab2ff9-9265-4663-b058-c08a2e5654a4 service nova] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Received event network-vif-unplugged-617da89e-c0c3-455c-992f-893a43fa7d3e {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ed3f94f7-b8d1-4b8d-bde5-d8e3967a1df2 req-05ab2ff9-9265-4663-b058-c08a2e5654a4 service nova] Acquiring lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ed3f94f7-b8d1-4b8d-bde5-d8e3967a1df2 req-05ab2ff9-9265-4663-b058-c08a2e5654a4 service nova] Lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ed3f94f7-b8d1-4b8d-bde5-d8e3967a1df2 req-05ab2ff9-9265-4663-b058-c08a2e5654a4 service nova] Lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG nova.compute.manager [req-ed3f94f7-b8d1-4b8d-bde5-d8e3967a1df2 req-05ab2ff9-9265-4663-b058-c08a2e5654a4 service nova] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] No waiting events found dispatching network-vif-unplugged-617da89e-c0c3-455c-992f-893a43fa7d3e {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG nova.compute.manager [req-ed3f94f7-b8d1-4b8d-bde5-d8e3967a1df2 req-05ab2ff9-9265-4663-b058-c08a2e5654a4 service nova] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Received event network-vif-unplugged-617da89e-c0c3-455c-992f-893a43fa7d3e for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 02:03:15 user nova-compute[71498]: INFO nova.compute.claims [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Claim successful on node user
Apr 14 02:03:15 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.360s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG nova.compute.manager [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG nova.compute.manager [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG nova.network.neutron [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 02:03:15 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 02:03:15 user nova-compute[71498]: DEBUG nova.compute.manager [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 02:03:15 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Instance destroyed successfully.
Apr 14 02:03:15 user nova-compute[71498]: DEBUG nova.objects.instance [None req-8b0894fc-35ec-413f-a85a-ee68cc208a06 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lazy-loading 'resources' on Instance uuid b7c5d54a-48a6-4600-b87b-e1318e35c1fe {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-8b0894fc-35ec-413f-a85a-ee68cc208a06 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:00:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-894252915',display_name='tempest-AttachVolumeTestJSON-server-894252915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-894252915',id=35,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDYgxLG6u+CLZO6ez2euu9C5tc+/T2XOCpUbIazierEJc6wvMtj8tQF3K8twfznW6n+gHEfT2+fHG3IrWuhzSDZudXAmAV0UsgnPo1pT6EO7QTUJ4jJt7CdfqhPDSKhung==',key_name='tempest-keypair-1642286085',keypairs=<?>,launch_index=0,launched_at=2023-04-14T02:01:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f650e04d2c947498b9e7a8d002862ad',ramdisk_id='',reservation_id='r-fc6checp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-296004410',owner_user_name='tempest-AttachVolumeTestJSON-296004410-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T02:01:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba0894753a074f99ab226fde0565dd28',uuid=b7c5d54a-48a6-4600-b87b-e1318e35c1fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "617da89e-c0c3-455c-992f-893a43fa7d3e", "address": "fa:16:3e:e8:54:11", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617da89e-c0", "ovs_interfaceid": "617da89e-c0c3-455c-992f-893a43fa7d3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8b0894fc-35ec-413f-a85a-ee68cc208a06 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Converting VIF {"id": "617da89e-c0c3-455c-992f-893a43fa7d3e", "address": "fa:16:3e:e8:54:11", "network": {"id": "fe9d57b9-96e8-424e-8dc9-0c95f1aff03a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1924726552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f650e04d2c947498b9e7a8d002862ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617da89e-c0", "ovs_interfaceid": "617da89e-c0c3-455c-992f-893a43fa7d3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8b0894fc-35ec-413f-a85a-ee68cc208a06 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:54:11,bridge_name='br-int',has_traffic_filtering=True,id=617da89e-c0c3-455c-992f-893a43fa7d3e,network=Network(fe9d57b9-96e8-424e-8dc9-0c95f1aff03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617da89e-c0') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG os_vif [None req-8b0894fc-35ec-413f-a85a-ee68cc208a06 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:54:11,bridge_name='br-int',has_traffic_filtering=True,id=617da89e-c0c3-455c-992f-893a43fa7d3e,network=Network(fe9d57b9-96e8-424e-8dc9-0c95f1aff03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617da89e-c0') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap617da89e-c0, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:03:15 user nova-compute[71498]: INFO os_vif [None req-8b0894fc-35ec-413f-a85a-ee68cc208a06 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:54:11,bridge_name='br-int',has_traffic_filtering=True,id=617da89e-c0c3-455c-992f-893a43fa7d3e,network=Network(fe9d57b9-96e8-424e-8dc9-0c95f1aff03a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617da89e-c0')
Apr 14 02:03:15 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-8b0894fc-35ec-413f-a85a-ee68cc208a06 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Deleting instance files /opt/stack/data/nova/instances/b7c5d54a-48a6-4600-b87b-e1318e35c1fe_del
Apr 14 02:03:15 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-8b0894fc-35ec-413f-a85a-ee68cc208a06 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Deletion of /opt/stack/data/nova/instances/b7c5d54a-48a6-4600-b87b-e1318e35c1fe_del complete
Apr 14 02:03:15 user nova-compute[71498]: DEBUG nova.policy [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fbb0e166c1f448cbba774b835f9798c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba8f38142a41928f0d2e8ead3aab96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG nova.compute.manager [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 02:03:15 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Creating image(s)
Apr 14 02:03:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "/opt/stack/data/nova/instances/a231fc48-a73e-4967-90c1-a31793235267/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "/opt/stack/data/nova/instances/a231fc48-a73e-4967-90c1-a31793235267/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "/opt/stack/data/nova/instances/a231fc48-a73e-4967-90c1-a31793235267/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:15 user nova-compute[71498]: INFO nova.compute.manager [None req-8b0894fc-35ec-413f-a85a-ee68cc208a06 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Took 0.93 seconds to destroy the instance on the hypervisor.
Apr 14 02:03:15 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-8b0894fc-35ec-413f-a85a-ee68cc208a06 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.173s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.139s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/a231fc48-a73e-4967-90c1-a31793235267/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/a231fc48-a73e-4967-90c1-a31793235267/disk 1073741824" returned: 0 in 0.046s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:03:15 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.138s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:16 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a231fc48-a73e-4967-90c1-a31793235267/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 02:03:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a231fc48-a73e-4967-90c1-a31793235267/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a231fc48-a73e-4967-90c1-a31793235267/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:16 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Cannot resize image /opt/stack/data/nova/instances/a231fc48-a73e-4967-90c1-a31793235267/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 02:03:16 user nova-compute[71498]: DEBUG nova.objects.instance [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lazy-loading 'migration_context' on Instance uuid a231fc48-a73e-4967-90c1-a31793235267 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:03:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 02:03:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Ensure instance console log exists: /opt/stack/data/nova/instances/a231fc48-a73e-4967-90c1-a31793235267/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 02:03:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:03:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:03:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:03:16 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:03:16 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Took 0.88 seconds to deallocate network for instance.
Apr 14 02:03:16 user nova-compute[71498]: DEBUG nova.network.neutron [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Successfully created port: abd5445b-2a67-4861-9840-b88f47390eb7 {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 02:03:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8b0894fc-35ec-413f-a85a-ee68cc208a06 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:03:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8b0894fc-35ec-413f-a85a-ee68cc208a06 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:03:16 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-8b0894fc-35ec-413f-a85a-ee68cc208a06 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:03:16 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-8b0894fc-35ec-413f-a85a-ee68cc208a06 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:03:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8b0894fc-35ec-413f-a85a-ee68cc208a06 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.201s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:03:16 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-8b0894fc-35ec-413f-a85a-ee68cc208a06 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Deleted allocations for instance b7c5d54a-48a6-4600-b87b-e1318e35c1fe
Apr 14 02:03:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8b0894fc-35ec-413f-a85a-ee68cc208a06 tempest-AttachVolumeTestJSON-296004410 tempest-AttachVolumeTestJSON-296004410-project-member] Lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.201s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG nova.compute.manager [req-78a6bc4d-b142-4af8-a2b5-a7bd2903aa59 req-1b389fd9-6666-4a32-a1d4-9af7527a0142 service nova] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Received event network-vif-plugged-617da89e-c0c3-455c-992f-893a43fa7d3e {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-78a6bc4d-b142-4af8-a2b5-a7bd2903aa59 req-1b389fd9-6666-4a32-a1d4-9af7527a0142 service nova] Acquiring lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-78a6bc4d-b142-4af8-a2b5-a7bd2903aa59 req-1b389fd9-6666-4a32-a1d4-9af7527a0142 service nova] Lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-78a6bc4d-b142-4af8-a2b5-a7bd2903aa59 req-1b389fd9-6666-4a32-a1d4-9af7527a0142 service nova] Lock "b7c5d54a-48a6-4600-b87b-e1318e35c1fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG nova.compute.manager [req-78a6bc4d-b142-4af8-a2b5-a7bd2903aa59 req-1b389fd9-6666-4a32-a1d4-9af7527a0142 service nova] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] No waiting events found dispatching network-vif-plugged-617da89e-c0c3-455c-992f-893a43fa7d3e {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:03:17 user nova-compute[71498]: WARNING nova.compute.manager [req-78a6bc4d-b142-4af8-a2b5-a7bd2903aa59 req-1b389fd9-6666-4a32-a1d4-9af7527a0142 service nova] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Received unexpected event network-vif-plugged-617da89e-c0c3-455c-992f-893a43fa7d3e for instance with vm_state deleted and task_state None.
Apr 14 02:03:17 user nova-compute[71498]: DEBUG nova.compute.manager [req-78a6bc4d-b142-4af8-a2b5-a7bd2903aa59 req-1b389fd9-6666-4a32-a1d4-9af7527a0142 service nova] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Received event network-vif-deleted-617da89e-c0c3-455c-992f-893a43fa7d3e {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG nova.network.neutron [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Successfully updated port: abd5445b-2a67-4861-9840-b88f47390eb7 {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "refresh_cache-a231fc48-a73e-4967-90c1-a31793235267" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquired lock "refresh_cache-a231fc48-a73e-4967-90c1-a31793235267" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG nova.network.neutron [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG nova.compute.manager [req-4c0e8dfe-d46f-4681-9b3e-0d3cd52e91fb req-a5ea8999-6963-454e-b1e6-43cd7a9d4600 service nova] [instance: a231fc48-a73e-4967-90c1-a31793235267] Received event network-changed-abd5445b-2a67-4861-9840-b88f47390eb7 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG nova.compute.manager [req-4c0e8dfe-d46f-4681-9b3e-0d3cd52e91fb req-a5ea8999-6963-454e-b1e6-43cd7a9d4600 service nova] [instance: a231fc48-a73e-4967-90c1-a31793235267] Refreshing instance network info cache due to event network-changed-abd5445b-2a67-4861-9840-b88f47390eb7. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4c0e8dfe-d46f-4681-9b3e-0d3cd52e91fb req-a5ea8999-6963-454e-b1e6-43cd7a9d4600 service nova] Acquiring lock "refresh_cache-a231fc48-a73e-4967-90c1-a31793235267" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG nova.network.neutron [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG nova.network.neutron [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Updating instance_info_cache with network_info: [{"id": "abd5445b-2a67-4861-9840-b88f47390eb7", "address": "fa:16:3e:f2:08:27", "network": {"id": "1cdc7ce4-e3ce-4e21-834b-712724a6c11d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-70541503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3fba8f38142a41928f0d2e8ead3aab96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabd5445b-2a", "ovs_interfaceid": "abd5445b-2a67-4861-9840-b88f47390eb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Releasing lock "refresh_cache-a231fc48-a73e-4967-90c1-a31793235267" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG nova.compute.manager [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Instance network_info: |[{"id": "abd5445b-2a67-4861-9840-b88f47390eb7", "address": "fa:16:3e:f2:08:27", "network": {"id": "1cdc7ce4-e3ce-4e21-834b-712724a6c11d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-70541503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3fba8f38142a41928f0d2e8ead3aab96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabd5445b-2a", "ovs_interfaceid": "abd5445b-2a67-4861-9840-b88f47390eb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4c0e8dfe-d46f-4681-9b3e-0d3cd52e91fb req-a5ea8999-6963-454e-b1e6-43cd7a9d4600 service nova] Acquired lock "refresh_cache-a231fc48-a73e-4967-90c1-a31793235267" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG nova.network.neutron [req-4c0e8dfe-d46f-4681-9b3e-0d3cd52e91fb req-a5ea8999-6963-454e-b1e6-43cd7a9d4600 service nova] [instance: a231fc48-a73e-4967-90c1-a31793235267] Refreshing network info cache for port abd5445b-2a67-4861-9840-b88f47390eb7 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Start _get_guest_xml network_info=[{"id": "abd5445b-2a67-4861-9840-b88f47390eb7", "address": "fa:16:3e:f2:08:27", "network": {"id": "1cdc7ce4-e3ce-4e21-834b-712724a6c11d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-70541503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3fba8f38142a41928f0d2e8ead3aab96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabd5445b-2a", "ovs_interfaceid": "abd5445b-2a67-4861-9840-b88f47390eb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 02:03:17 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:03:17 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:03:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:03:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1460124092',display_name='tempest-VolumesSnapshotTestJSON-instance-1460124092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1460124092',id=38,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fba8f38142a41928f0d2e8ead3aab96',ramdisk_id='',reservation_id='r-gem8vsaf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2121749885',owner_user_name='tempest-VolumesSnapshotTestJSON-2121749885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T02:03:16Z,user_data=None,user_id='fbb0e166c1f448cbba774b835f9798c9',uuid=a231fc48-a73e-4967-90c1-a31793235267,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abd5445b-2a67-4861-9840-b88f47390eb7", "address": "fa:16:3e:f2:08:27", "network": {"id": "1cdc7ce4-e3ce-4e21-834b-712724a6c11d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-70541503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3fba8f38142a41928f0d2e8ead3aab96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabd5445b-2a", "ovs_interfaceid": "abd5445b-2a67-4861-9840-b88f47390eb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Converting VIF {"id": "abd5445b-2a67-4861-9840-b88f47390eb7", "address": "fa:16:3e:f2:08:27", "network": {"id": "1cdc7ce4-e3ce-4e21-834b-712724a6c11d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-70541503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3fba8f38142a41928f0d2e8ead3aab96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabd5445b-2a", "ovs_interfaceid": "abd5445b-2a67-4861-9840-b88f47390eb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:08:27,bridge_name='br-int',has_traffic_filtering=True,id=abd5445b-2a67-4861-9840-b88f47390eb7,network=Network(1cdc7ce4-e3ce-4e21-834b-712724a6c11d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabd5445b-2a') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG nova.objects.instance [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lazy-loading 'pci_devices' on Instance uuid a231fc48-a73e-4967-90c1-a31793235267 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] End _get_guest_xml xml=<domain type="kvm">
Apr 14 02:03:17 user nova-compute[71498]:   <uuid>a231fc48-a73e-4967-90c1-a31793235267</uuid>
Apr 14 02:03:17 user nova-compute[71498]:   <name>instance-00000026</name>
Apr 14 02:03:17 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 02:03:17 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 02:03:17 user nova-compute[71498]:   <metadata>
Apr 14 02:03:17 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 02:03:17 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 02:03:17 user nova-compute[71498]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1460124092</nova:name>
Apr 14 02:03:17 user nova-compute[71498]:       <nova:creationTime>2023-04-14 02:03:17</nova:creationTime>
Apr 14 02:03:17 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 02:03:17 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 02:03:17 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 02:03:17 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 02:03:17 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 02:03:17 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 02:03:17 user nova-compute[71498]:       </nova:flavor>
Apr 14 02:03:17 user nova-compute[71498]:       <nova:owner>
Apr 14 02:03:17 user nova-compute[71498]:         <nova:user uuid="fbb0e166c1f448cbba774b835f9798c9">tempest-VolumesSnapshotTestJSON-2121749885-project-member</nova:user>
Apr 14 02:03:17 user nova-compute[71498]:         <nova:project uuid="3fba8f38142a41928f0d2e8ead3aab96">tempest-VolumesSnapshotTestJSON-2121749885</nova:project>
Apr 14 02:03:17 user nova-compute[71498]:       </nova:owner>
Apr 14 02:03:17 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 02:03:17 user nova-compute[71498]:       <nova:ports>
Apr 14 02:03:17 user nova-compute[71498]:         <nova:port uuid="abd5445b-2a67-4861-9840-b88f47390eb7">
Apr 14 02:03:17 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.2" ipVersion="4"/>
Apr 14 02:03:17 user nova-compute[71498]:         </nova:port>
Apr 14 02:03:17 user nova-compute[71498]:       </nova:ports>
Apr 14 02:03:17 user nova-compute[71498]:     </nova:instance>
Apr 14 02:03:17 user nova-compute[71498]:   </metadata>
Apr 14 02:03:17 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 02:03:17 user nova-compute[71498]:     <system>
Apr 14 02:03:17 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 02:03:17 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 02:03:17 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 02:03:17 user nova-compute[71498]:       <entry name="serial">a231fc48-a73e-4967-90c1-a31793235267</entry>
Apr 14 02:03:17 user nova-compute[71498]:       <entry name="uuid">a231fc48-a73e-4967-90c1-a31793235267</entry>
Apr 14 02:03:17 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 02:03:17 user nova-compute[71498]:     </system>
Apr 14 02:03:17 user nova-compute[71498]:   </sysinfo>
Apr 14 02:03:17 user nova-compute[71498]:   <os>
Apr 14 02:03:17 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 02:03:17 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 02:03:17 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 02:03:17 user nova-compute[71498]:   </os>
Apr 14 02:03:17 user nova-compute[71498]:   <features>
Apr 14 02:03:17 user nova-compute[71498]:     <acpi/>
Apr 14 02:03:17 user nova-compute[71498]:     <apic/>
Apr 14 02:03:17 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 02:03:17 user nova-compute[71498]:   </features>
Apr 14 02:03:17 user nova-compute[71498]:   <clock offset="utc">
Apr 14 02:03:17 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 02:03:17 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 02:03:17 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 02:03:17 user nova-compute[71498]:   </clock>
Apr 14 02:03:17 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 02:03:17 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 02:03:17 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 02:03:17 user nova-compute[71498]:   </cpu>
Apr 14 02:03:17 user nova-compute[71498]:   <devices>
Apr 14 02:03:17 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 02:03:17 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 02:03:17 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/a231fc48-a73e-4967-90c1-a31793235267/disk"/>
Apr 14 02:03:17 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 02:03:17 user nova-compute[71498]:     </disk>
Apr 14 02:03:17 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 02:03:17 user nova-compute[71498]:       <mac address="fa:16:3e:f2:08:27"/>
Apr 14 02:03:17 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 02:03:17 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 02:03:17 user nova-compute[71498]:       <target dev="tapabd5445b-2a"/>
Apr 14 02:03:17 user nova-compute[71498]:     </interface>
Apr 14 02:03:17 user nova-compute[71498]:     <serial type="pty">
Apr 14 02:03:17 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/a231fc48-a73e-4967-90c1-a31793235267/console.log" append="off"/>
Apr 14 02:03:17 user nova-compute[71498]:     </serial>
Apr 14 02:03:17 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 02:03:17 user nova-compute[71498]:     <video>
Apr 14 02:03:17 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 02:03:17 user nova-compute[71498]:     </video>
Apr 14 02:03:17 user nova-compute[71498]:     <rng model="virtio">
Apr 14 02:03:17 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 02:03:17 user nova-compute[71498]:     </rng>
Apr 14 02:03:17 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 02:03:17 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 02:03:17 user nova-compute[71498]:       <stats period="10"/>
Apr 14 02:03:17 user nova-compute[71498]:     </memballoon>
Apr 14 02:03:17 user nova-compute[71498]:   </devices>
Apr 14 02:03:17 user nova-compute[71498]: </domain>
Apr 14 02:03:17 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:03:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1460124092',display_name='tempest-VolumesSnapshotTestJSON-instance-1460124092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1460124092',id=38,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fba8f38142a41928f0d2e8ead3aab96',ramdisk_id='',reservation_id='r-gem8vsaf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2121749885',owner_user_name='tempest-VolumesSnapshotTestJSON-2121749885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T02:03:16Z,user_data=None,user_id='fbb0e166c1f448cbba774b835f9798c9',uuid=a231fc48-a73e-4967-90c1-a31793235267,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abd5445b-2a67-4861-9840-b88f47390eb7", "address": "fa:16:3e:f2:08:27", "network": {"id": "1cdc7ce4-e3ce-4e21-834b-712724a6c11d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-70541503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3fba8f38142a41928f0d2e8ead3aab96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabd5445b-2a", "ovs_interfaceid": "abd5445b-2a67-4861-9840-b88f47390eb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Converting VIF {"id": "abd5445b-2a67-4861-9840-b88f47390eb7", "address": "fa:16:3e:f2:08:27", "network": {"id": "1cdc7ce4-e3ce-4e21-834b-712724a6c11d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-70541503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3fba8f38142a41928f0d2e8ead3aab96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabd5445b-2a", "ovs_interfaceid": "abd5445b-2a67-4861-9840-b88f47390eb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:08:27,bridge_name='br-int',has_traffic_filtering=True,id=abd5445b-2a67-4861-9840-b88f47390eb7,network=Network(1cdc7ce4-e3ce-4e21-834b-712724a6c11d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabd5445b-2a') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG os_vif [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:08:27,bridge_name='br-int',has_traffic_filtering=True,id=abd5445b-2a67-4861-9840-b88f47390eb7,network=Network(1cdc7ce4-e3ce-4e21-834b-712724a6c11d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabd5445b-2a') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapabd5445b-2a, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapabd5445b-2a, col_values=(('external_ids', {'iface-id': 'abd5445b-2a67-4861-9840-b88f47390eb7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:08:27', 'vm-uuid': 'a231fc48-a73e-4967-90c1-a31793235267'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:17 user nova-compute[71498]: INFO os_vif [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:08:27,bridge_name='br-int',has_traffic_filtering=True,id=abd5445b-2a67-4861-9840-b88f47390eb7,network=Network(1cdc7ce4-e3ce-4e21-834b-712724a6c11d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabd5445b-2a')
Apr 14 02:03:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:03:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] No VIF found with MAC fa:16:3e:f2:08:27, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 02:03:18 user nova-compute[71498]: DEBUG nova.network.neutron [req-4c0e8dfe-d46f-4681-9b3e-0d3cd52e91fb req-a5ea8999-6963-454e-b1e6-43cd7a9d4600 service nova] [instance: a231fc48-a73e-4967-90c1-a31793235267] Updated VIF entry in instance network info cache for port abd5445b-2a67-4861-9840-b88f47390eb7. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 02:03:18 user nova-compute[71498]: DEBUG nova.network.neutron [req-4c0e8dfe-d46f-4681-9b3e-0d3cd52e91fb req-a5ea8999-6963-454e-b1e6-43cd7a9d4600 service nova] [instance: a231fc48-a73e-4967-90c1-a31793235267] Updating instance_info_cache with network_info: [{"id": "abd5445b-2a67-4861-9840-b88f47390eb7", "address": "fa:16:3e:f2:08:27", "network": {"id": "1cdc7ce4-e3ce-4e21-834b-712724a6c11d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-70541503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3fba8f38142a41928f0d2e8ead3aab96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabd5445b-2a", "ovs_interfaceid": "abd5445b-2a67-4861-9840-b88f47390eb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:03:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4c0e8dfe-d46f-4681-9b3e-0d3cd52e91fb req-a5ea8999-6963-454e-b1e6-43cd7a9d4600 service nova] Releasing lock "refresh_cache-a231fc48-a73e-4967-90c1-a31793235267" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:03:19 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:19 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:19 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:19 user nova-compute[71498]: DEBUG nova.compute.manager [req-0fe00eee-9c4e-4347-9044-95b51194b363 req-75479335-c4f8-40e5-be21-8d80beea532f service nova] [instance: a231fc48-a73e-4967-90c1-a31793235267] Received event network-vif-plugged-abd5445b-2a67-4861-9840-b88f47390eb7 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:03:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0fe00eee-9c4e-4347-9044-95b51194b363 req-75479335-c4f8-40e5-be21-8d80beea532f service nova] Acquiring lock "a231fc48-a73e-4967-90c1-a31793235267-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:03:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0fe00eee-9c4e-4347-9044-95b51194b363 req-75479335-c4f8-40e5-be21-8d80beea532f service nova] Lock "a231fc48-a73e-4967-90c1-a31793235267-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:03:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0fe00eee-9c4e-4347-9044-95b51194b363 req-75479335-c4f8-40e5-be21-8d80beea532f service nova] Lock "a231fc48-a73e-4967-90c1-a31793235267-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:03:19 user nova-compute[71498]: DEBUG nova.compute.manager [req-0fe00eee-9c4e-4347-9044-95b51194b363 req-75479335-c4f8-40e5-be21-8d80beea532f service nova] [instance: a231fc48-a73e-4967-90c1-a31793235267] No waiting events found dispatching network-vif-plugged-abd5445b-2a67-4861-9840-b88f47390eb7 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:03:19 user nova-compute[71498]: WARNING nova.compute.manager [req-0fe00eee-9c4e-4347-9044-95b51194b363 req-75479335-c4f8-40e5-be21-8d80beea532f service nova] [instance: a231fc48-a73e-4967-90c1-a31793235267] Received unexpected event network-vif-plugged-abd5445b-2a67-4861-9840-b88f47390eb7 for instance with vm_state building and task_state spawning.
Apr 14 02:03:21 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437801.321652, a231fc48-a73e-4967-90c1-a31793235267 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:03:21 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: a231fc48-a73e-4967-90c1-a31793235267] VM Resumed (Lifecycle Event)
Apr 14 02:03:21 user nova-compute[71498]: DEBUG nova.compute.manager [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 02:03:21 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 02:03:21 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: a231fc48-a73e-4967-90c1-a31793235267] Instance spawned successfully.
Apr 14 02:03:21 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 02:03:21 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: a231fc48-a73e-4967-90c1-a31793235267] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:03:21 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: a231fc48-a73e-4967-90c1-a31793235267] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 02:03:21 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:03:21 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:03:21 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:03:21 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:03:21 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:03:21 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:03:21 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: a231fc48-a73e-4967-90c1-a31793235267] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 02:03:21 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437801.3252027, a231fc48-a73e-4967-90c1-a31793235267 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:03:21 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: a231fc48-a73e-4967-90c1-a31793235267] VM Started (Lifecycle Event)
Apr 14 02:03:21 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: a231fc48-a73e-4967-90c1-a31793235267] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:03:21 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: a231fc48-a73e-4967-90c1-a31793235267] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 02:03:21 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: a231fc48-a73e-4967-90c1-a31793235267] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 02:03:21 user nova-compute[71498]: INFO nova.compute.manager [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Took 5.82 seconds to spawn the instance on the hypervisor.
Apr 14 02:03:21 user nova-compute[71498]: DEBUG nova.compute.manager [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:03:21 user nova-compute[71498]: INFO nova.compute.manager [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Took 6.50 seconds to build instance.
Apr 14 02:03:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adf8ad59-61b0-4438-be8c-a3504d911b6c tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "a231fc48-a73e-4967-90c1-a31793235267" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.591s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:03:21 user nova-compute[71498]: DEBUG nova.compute.manager [req-c6f54788-d1a4-46fd-9e43-8532ac4fc3cd req-cafbbac5-0d2e-454b-bea3-783b403bd2ca service nova] [instance: a231fc48-a73e-4967-90c1-a31793235267] Received event network-vif-plugged-abd5445b-2a67-4861-9840-b88f47390eb7 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:03:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c6f54788-d1a4-46fd-9e43-8532ac4fc3cd req-cafbbac5-0d2e-454b-bea3-783b403bd2ca service nova] Acquiring lock "a231fc48-a73e-4967-90c1-a31793235267-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:03:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c6f54788-d1a4-46fd-9e43-8532ac4fc3cd req-cafbbac5-0d2e-454b-bea3-783b403bd2ca service nova] Lock "a231fc48-a73e-4967-90c1-a31793235267-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:03:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c6f54788-d1a4-46fd-9e43-8532ac4fc3cd req-cafbbac5-0d2e-454b-bea3-783b403bd2ca service nova] Lock "a231fc48-a73e-4967-90c1-a31793235267-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:03:21 user nova-compute[71498]: DEBUG nova.compute.manager [req-c6f54788-d1a4-46fd-9e43-8532ac4fc3cd req-cafbbac5-0d2e-454b-bea3-783b403bd2ca service nova] [instance: a231fc48-a73e-4967-90c1-a31793235267] No waiting events found dispatching network-vif-plugged-abd5445b-2a67-4861-9840-b88f47390eb7 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:03:21 user nova-compute[71498]: WARNING nova.compute.manager [req-c6f54788-d1a4-46fd-9e43-8532ac4fc3cd req-cafbbac5-0d2e-454b-bea3-783b403bd2ca service nova] [instance: a231fc48-a73e-4967-90c1-a31793235267] Received unexpected event network-vif-plugged-abd5445b-2a67-4861-9840-b88f47390eb7 for instance with vm_state active and task_state None.
Apr 14 02:03:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:30 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681437795.5275512, b7c5d54a-48a6-4600-b87b-e1318e35c1fe => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:03:30 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] VM Stopped (Lifecycle Event)
Apr 14 02:03:30 user nova-compute[71498]: DEBUG nova.compute.manager [None req-1f3bf588-2c8c-4bb6-bff1-2c5dfc4a8c57 None None] [instance: b7c5d54a-48a6-4600-b87b-e1318e35c1fe] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:03:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:03:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:35 user nova-compute[71498]: DEBUG nova.compute.manager [req-000ca6fb-cad9-4769-8391-0358d289d8ea req-43673afd-6d2e-4d60-964f-5ec530472a36 service nova] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Received event network-changed-5b8a0a31-9ecf-4b31-a458-778005d846f4 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:03:35 user nova-compute[71498]: DEBUG nova.compute.manager [req-000ca6fb-cad9-4769-8391-0358d289d8ea req-43673afd-6d2e-4d60-964f-5ec530472a36 service nova] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Refreshing instance network info cache due to event network-changed-5b8a0a31-9ecf-4b31-a458-778005d846f4. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 02:03:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-000ca6fb-cad9-4769-8391-0358d289d8ea req-43673afd-6d2e-4d60-964f-5ec530472a36 service nova] Acquiring lock "refresh_cache-5ba29111-1e9b-4947-b046-6bbe888eca06" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:03:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-000ca6fb-cad9-4769-8391-0358d289d8ea req-43673afd-6d2e-4d60-964f-5ec530472a36 service nova] Acquired lock "refresh_cache-5ba29111-1e9b-4947-b046-6bbe888eca06" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:03:35 user nova-compute[71498]: DEBUG nova.network.neutron [req-000ca6fb-cad9-4769-8391-0358d289d8ea req-43673afd-6d2e-4d60-964f-5ec530472a36 service nova] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Refreshing network info cache for port 5b8a0a31-9ecf-4b31-a458-778005d846f4 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 02:03:36 user nova-compute[71498]: DEBUG nova.network.neutron [req-000ca6fb-cad9-4769-8391-0358d289d8ea req-43673afd-6d2e-4d60-964f-5ec530472a36 service nova] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Updated VIF entry in instance network info cache for port 5b8a0a31-9ecf-4b31-a458-778005d846f4. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 02:03:36 user nova-compute[71498]: DEBUG nova.network.neutron [req-000ca6fb-cad9-4769-8391-0358d289d8ea req-43673afd-6d2e-4d60-964f-5ec530472a36 service nova] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Updating instance_info_cache with network_info: [{"id": "5b8a0a31-9ecf-4b31-a458-778005d846f4", "address": "fa:16:3e:90:92:14", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8a0a31-9e", "ovs_interfaceid": "5b8a0a31-9ecf-4b31-a458-778005d846f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:03:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-000ca6fb-cad9-4769-8391-0358d289d8ea req-43673afd-6d2e-4d60-964f-5ec530472a36 service nova] Releasing lock "refresh_cache-5ba29111-1e9b-4947-b046-6bbe888eca06" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:03:37 user nova-compute[71498]: DEBUG nova.compute.manager [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Stashing vm_state: active {{(pid=71498) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 14 02:03:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:03:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:03:37 user nova-compute[71498]: DEBUG nova.objects.instance [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lazy-loading 'pci_requests' on Instance uuid 24db983d-4ad5-45be-a8e5-8448b3e5e065 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:03:37 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 02:03:37 user nova-compute[71498]: INFO nova.compute.claims [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Claim successful on node user
Apr 14 02:03:37 user nova-compute[71498]: DEBUG nova.objects.instance [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lazy-loading 'resources' on Instance uuid 24db983d-4ad5-45be-a8e5-8448b3e5e065 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:03:37 user nova-compute[71498]: DEBUG nova.objects.instance [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lazy-loading 'pci_devices' on Instance uuid 24db983d-4ad5-45be-a8e5-8448b3e5e065 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:03:37 user nova-compute[71498]: INFO nova.compute.resource_tracker [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Updating resource usage from migration 43fc5db8-f6ab-4364-abad-bbb4a48452c1
Apr 14 02:03:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:37 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:03:37 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:03:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.349s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:03:37 user nova-compute[71498]: INFO nova.compute.manager [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Migrating
Apr 14 02:03:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "refresh_cache-24db983d-4ad5-45be-a8e5-8448b3e5e065" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:03:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquired lock "refresh_cache-24db983d-4ad5-45be-a8e5-8448b3e5e065" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:03:37 user nova-compute[71498]: DEBUG nova.network.neutron [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 02:03:38 user nova-compute[71498]: DEBUG nova.compute.manager [req-c0242cf2-f584-44ca-ab86-1aa795569799 req-9736c76f-0547-40b7-863c-1760b675ca83 service nova] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Received event network-changed-9f06d104-c24c-4287-817c-9f05b53fbb29 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:03:38 user nova-compute[71498]: DEBUG nova.compute.manager [req-c0242cf2-f584-44ca-ab86-1aa795569799 req-9736c76f-0547-40b7-863c-1760b675ca83 service nova] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Refreshing instance network info cache due to event network-changed-9f06d104-c24c-4287-817c-9f05b53fbb29. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 02:03:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c0242cf2-f584-44ca-ab86-1aa795569799 req-9736c76f-0547-40b7-863c-1760b675ca83 service nova] Acquiring lock "refresh_cache-24db983d-4ad5-45be-a8e5-8448b3e5e065" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:03:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:38 user nova-compute[71498]: DEBUG nova.network.neutron [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Updating instance_info_cache with network_info: [{"id": "9f06d104-c24c-4287-817c-9f05b53fbb29", "address": "fa:16:3e:7b:17:65", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f06d104-c2", "ovs_interfaceid": "9f06d104-c24c-4287-817c-9f05b53fbb29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:03:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Releasing lock "refresh_cache-24db983d-4ad5-45be-a8e5-8448b3e5e065" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:03:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c0242cf2-f584-44ca-ab86-1aa795569799 req-9736c76f-0547-40b7-863c-1760b675ca83 service nova] Acquired lock "refresh_cache-24db983d-4ad5-45be-a8e5-8448b3e5e065" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:03:38 user nova-compute[71498]: DEBUG nova.network.neutron [req-c0242cf2-f584-44ca-ab86-1aa795569799 req-9736c76f-0547-40b7-863c-1760b675ca83 service nova] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Refreshing network info cache for port 9f06d104-c24c-4287-817c-9f05b53fbb29 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 02:03:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Starting migrate_disk_and_power_off {{(pid=71498) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 14 02:03:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:38 user nova-compute[71498]: DEBUG nova.network.neutron [req-c0242cf2-f584-44ca-ab86-1aa795569799 req-9736c76f-0547-40b7-863c-1760b675ca83 service nova] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Updated VIF entry in instance network info cache for port 9f06d104-c24c-4287-817c-9f05b53fbb29. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 02:03:38 user nova-compute[71498]: DEBUG nova.network.neutron [req-c0242cf2-f584-44ca-ab86-1aa795569799 req-9736c76f-0547-40b7-863c-1760b675ca83 service nova] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Updating instance_info_cache with network_info: [{"id": "9f06d104-c24c-4287-817c-9f05b53fbb29", "address": "fa:16:3e:7b:17:65", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f06d104-c2", "ovs_interfaceid": "9f06d104-c24c-4287-817c-9f05b53fbb29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c0242cf2-f584-44ca-ab86-1aa795569799 req-9736c76f-0547-40b7-863c-1760b675ca83 service nova] Releasing lock "refresh_cache-24db983d-4ad5-45be-a8e5-8448b3e5e065" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:03:39 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Instance destroyed successfully.
Apr 14 02:03:39 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:01:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-240203784',display_name='tempest-ServerActionsTestJSON-server-240203784',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-240203784',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7iIvlhM+wCditCRaonOriLx8WWyehY8kYxTUZ36Z1Q4VGm2JnuefQ18D+1ncnGXJXgbpg/EWHmDPRQFx9TQ2PBQ5aNgSGRUcq/Ovi+zGjOYQDNVYkQyEvsulSNtijWoQ==',key_name='tempest-keypair-165395776',keypairs=<?>,launch_index=0,launched_at=2023-04-14T02:01:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2ed4ed4ab2fd4c14b3e2afe343fd7256',ramdisk_id='',reservation_id='r-wapff4we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2035821517',owner_user_name='tempest-ServerActionsTestJSON-2035821517-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T02:03:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78ccd1a1ec1b486981d850881734fe02',uuid=24db983d-4ad5-45be-a8e5-8448b3e5e065,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f06d104-c24c-4287-817c-9f05b53fbb29", "address": "fa:16:3e:7b:17:65", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1797376284-network", "vif_mac": "fa:16:3e:7b:17:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f06d104-c2", "ovs_interfaceid": "9f06d104-c24c-4287-817c-9f05b53fbb29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converting VIF {"id": "9f06d104-c24c-4287-817c-9f05b53fbb29", "address": "fa:16:3e:7b:17:65", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1797376284-network", "vif_mac": "fa:16:3e:7b:17:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f06d104-c2", "ovs_interfaceid": "9f06d104-c24c-4287-817c-9f05b53fbb29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:17:65,bridge_name='br-int',has_traffic_filtering=True,id=9f06d104-c24c-4287-817c-9f05b53fbb29,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f06d104-c2') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG os_vif [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:17:65,bridge_name='br-int',has_traffic_filtering=True,id=9f06d104-c24c-4287-817c-9f05b53fbb29,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f06d104-c2') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f06d104-c2, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:03:39 user nova-compute[71498]: INFO os_vif [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:17:65,bridge_name='br-int',has_traffic_filtering=True,id=9f06d104-c24c-4287-817c-9f05b53fbb29,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f06d104-c2')
Apr 14 02:03:39 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBVCXlJa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:03:39 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:03:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[62943e70-015e-453f-8ddf-a354ec2111df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 02:03:39 user nova-compute[71498]: No targets found.
Apr 14 02:03:39 user nova-compute[71498]: iSNS:
Apr 14 02:03:39 user nova-compute[71498]: No targets found.
Apr 14 02:03:39 user nova-compute[71498]: STATIC:
Apr 14 02:03:39 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238
Apr 14 02:03:39 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 02:03:39 user nova-compute[71498]:                 Iface Name: default
Apr 14 02:03:39 user nova-compute[71498]: FIRMWARE:
Apr 14 02:03:39 user nova-compute[71498]: No targets found.
Apr 14 02:03:39 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 02:03:39 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 02:03:39 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdac675-2add-4798-9cd0-3e16158bb152]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f892a3b-8e0d-4710-9a8d-860a129e5e58]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:03:39 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:03:39 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52013fb250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238'): ({'sdb'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Removing single pathed devices sdb {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2be5ba1-0ea2-452b-8171-d1616c5648c7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31168e9-1e62-4a3e-b939-879c5638b309]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Flushing IO for device /dev/sdb {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eff98c6-92ec-4436-803c-38172a3546d5]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22dd2d5-5577-4b5d-89ae-85c51a731336]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] SCSI volumes sdb have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23466306261366663', '/dev/disk/by-id/scsi-1SCST_BIOf6529d39-4f0ba6fcc48ee1f6', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f6529d39') {{(pid=81721) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b0068b-4af9-4e7a-a3bd-c507b2cdb602]: (4, None) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff07214-7f97-4c04-8b81-00ace11aa3c7]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d815f067-b2ad-48a3-9a8d-8f7e8418fef4]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238, portal: 172.16.0.220,3260]
Apr 14 02:03:39 user nova-compute[71498]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238, portal: 172.16.0.220,3260] successful.
Apr 14 02:03:39 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[755d39f0-afd2-4687-afeb-026f66871588]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] <== disconnect_volume: return (293ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 02:03:39 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 02:03:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-8ff93b31-360f-4428-bcfa-b09a67e56a3f req-b19460f2-abde-4e8d-9545-f96810699fe3 service nova] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Received event network-vif-unplugged-9f06d104-c24c-4287-817c-9f05b53fbb29 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:03:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8ff93b31-360f-4428-bcfa-b09a67e56a3f req-b19460f2-abde-4e8d-9545-f96810699fe3 service nova] Acquiring lock "24db983d-4ad5-45be-a8e5-8448b3e5e065-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:03:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8ff93b31-360f-4428-bcfa-b09a67e56a3f req-b19460f2-abde-4e8d-9545-f96810699fe3 service nova] Lock "24db983d-4ad5-45be-a8e5-8448b3e5e065-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:03:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8ff93b31-360f-4428-bcfa-b09a67e56a3f req-b19460f2-abde-4e8d-9545-f96810699fe3 service nova] Lock "24db983d-4ad5-45be-a8e5-8448b3e5e065-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:03:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-8ff93b31-360f-4428-bcfa-b09a67e56a3f req-b19460f2-abde-4e8d-9545-f96810699fe3 service nova] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] No waiting events found dispatching network-vif-unplugged-9f06d104-c24c-4287-817c-9f05b53fbb29 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:03:40 user nova-compute[71498]: WARNING nova.compute.manager [req-8ff93b31-360f-4428-bcfa-b09a67e56a3f req-b19460f2-abde-4e8d-9545-f96810699fe3 service nova] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Received unexpected event network-vif-unplugged-9f06d104-c24c-4287-817c-9f05b53fbb29 for instance with vm_state active and task_state resize_migrating.
Apr 14 02:03:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-8ff93b31-360f-4428-bcfa-b09a67e56a3f req-b19460f2-abde-4e8d-9545-f96810699fe3 service nova] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Received event network-vif-plugged-9f06d104-c24c-4287-817c-9f05b53fbb29 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:03:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8ff93b31-360f-4428-bcfa-b09a67e56a3f req-b19460f2-abde-4e8d-9545-f96810699fe3 service nova] Acquiring lock "24db983d-4ad5-45be-a8e5-8448b3e5e065-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:03:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8ff93b31-360f-4428-bcfa-b09a67e56a3f req-b19460f2-abde-4e8d-9545-f96810699fe3 service nova] Lock "24db983d-4ad5-45be-a8e5-8448b3e5e065-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:03:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8ff93b31-360f-4428-bcfa-b09a67e56a3f req-b19460f2-abde-4e8d-9545-f96810699fe3 service nova] Lock "24db983d-4ad5-45be-a8e5-8448b3e5e065-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:03:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-8ff93b31-360f-4428-bcfa-b09a67e56a3f req-b19460f2-abde-4e8d-9545-f96810699fe3 service nova] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] No waiting events found dispatching network-vif-plugged-9f06d104-c24c-4287-817c-9f05b53fbb29 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:03:40 user nova-compute[71498]: WARNING nova.compute.manager [req-8ff93b31-360f-4428-bcfa-b09a67e56a3f req-b19460f2-abde-4e8d-9545-f96810699fe3 service nova] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Received unexpected event network-vif-plugged-9f06d104-c24c-4287-817c-9f05b53fbb29 for instance with vm_state active and task_state resize_migrating.
Apr 14 02:03:40 user nova-compute[71498]: DEBUG nova.network.neutron [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Port 9f06d104-c24c-4287-817c-9f05b53fbb29 binding to destination host user is already ACTIVE {{(pid=71498) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 14 02:03:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "24db983d-4ad5-45be-a8e5-8448b3e5e065-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:03:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "24db983d-4ad5-45be-a8e5-8448b3e5e065-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:03:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "24db983d-4ad5-45be-a8e5-8448b3e5e065-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:03:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "refresh_cache-24db983d-4ad5-45be-a8e5-8448b3e5e065" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:03:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquired lock "refresh_cache-24db983d-4ad5-45be-a8e5-8448b3e5e065" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:03:40 user nova-compute[71498]: DEBUG nova.network.neutron [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 02:03:41 user nova-compute[71498]: DEBUG nova.network.neutron [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Updating instance_info_cache with network_info: [{"id": "9f06d104-c24c-4287-817c-9f05b53fbb29", "address": "fa:16:3e:7b:17:65", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f06d104-c2", "ovs_interfaceid": "9f06d104-c24c-4287-817c-9f05b53fbb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:03:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Releasing lock "refresh_cache-24db983d-4ad5-45be-a8e5-8448b3e5e065" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:03:41 user nova-compute[71498]: DEBUG os_brick.utils [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:03:41 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:41 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:41 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6014d9-1dcf-4112-9702-a7e57831fc75]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:41 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:41 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:41 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d648b5a6-5b9a-40d6-8300-f79303636c32]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:41 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:41 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:41 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f29f7a-707c-4ebb-b21e-6c1409c9a2c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:41 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8fcb99-bb46-4904-8310-cb07ea761542]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:41 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:41 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 02:03:41 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 02:03:41 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:41 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 02:03:41 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 02:03:41 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a543f9e-94e1-4e57-ae4c-d096735eb623]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:41 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 02:03:41 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 02:03:41 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 02:03:41 user nova-compute[71498]: DEBUG os_brick.utils [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:03:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:44 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:44 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Starting finish_migration {{(pid=71498) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Instance directory exists: not creating {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 02:03:46 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Creating image(s)
Apr 14 02:03:46 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Did not create local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Ensure instance console log exists: /opt/stack/data/nova/instances/24db983d-4ad5-45be-a8e5-8448b3e5e065/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Start _get_guest_xml network_info=[{"id": "9f06d104-c24c-4287-817c-9f05b53fbb29", "address": "fa:16:3e:7b:17:65", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1797376284-network", "vif_mac": "fa:16:3e:7b:17:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f06d104-c2", "ovs_interfaceid": "9f06d104-c24c-4287-817c-9f05b53fbb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '16d86764-c060-45f1-9c4a-8cc75f65ca31', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBVCXlJa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '24db983d-4ad5-45be-a8e5-8448b3e5e065', 'attached_at': '2023-04-14T02:03:46.000000', 'detached_at': '', 'volume_id': '06b73a5e-5178-4561-af91-11e1028d2238', 'serial': '06b73a5e-5178-4561-af91-11e1028d2238'}, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 02:03:46 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:03:46 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:03:46 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:05Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG nova.objects.instance [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lazy-loading 'vcpu_model' on Instance uuid 24db983d-4ad5-45be-a8e5-8448b3e5e065 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBVCXlJa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:03:46 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:03:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:03:46 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:03:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:03:46 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca28a31e-677d-4cd0-9c34-2b8c9c154cf8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 02:03:46 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc57558-8c00-4fe4-a2f0-af7b85fac5ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238] added
Apr 14 02:03:46 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Rebuilding the list of instances to heal {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6320f1e-de4e-4280-9de2-fbc2bbdd5fac]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2c3bf0-4067-4ec9-b6db-381381227098]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HBVCXlJa {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HBVCXlJa" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e92ec40-79e4-44fa-b56d-6dafec5a2340]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HBVCXlJa'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-5ba29111-1e9b-4947-b046-6bbe888eca06" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-5ba29111-1e9b-4947-b046-6bbe888eca06" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG nova.objects.instance [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lazy-loading 'info_cache' on Instance uuid 5ba29111-1e9b-4947-b046-6bbe888eca06 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d66dfbb-0a7c-43a6-aebb-241fc116df45]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4242812c-efbb-454d-ac59-2a147df3ca1f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 02:03:46 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 02:03:46 user nova-compute[71498]:  {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:03:46 user nova-compute[71498]: WARNING os_brick.initiator.connectors.iscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 02:03:46 user nova-compute[71498]: 
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c61a498-3dfd-4c39-a802-7ae6e26fb647]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238, portal: 172.16.0.220,3260]
Apr 14 02:03:46 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238, portal: 172.16.0.220,3260] successful.
Apr 14 02:03:46 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c308e400-c44b-4d6c-9dd3-687ec2df61ba]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cf8bfd-c39e-4edd-ad91-ded8abb17b3f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:03:46 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:03:46 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebaf732b-7839-443e-9b87-1ca409edeeb5]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Updating instance_info_cache with network_info: [{"id": "5b8a0a31-9ecf-4b31-a458-778005d846f4", "address": "fa:16:3e:90:92:14", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8a0a31-9e", "ovs_interfaceid": "5b8a0a31-9ecf-4b31-a458-778005d846f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-5ba29111-1e9b-4947-b046-6bbe888eca06" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 02:03:46 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:03:47 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 02:03:47 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBVCXlJa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 02:03:47 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:03:47 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23466306261366663', 'path': '/dev/sdb'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:03:47 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466306261366663', 'path': '/dev/sdb'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 02:03:47 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:01:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-240203784',display_name='tempest-ServerActionsTestJSON-server-240203784',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-240203784',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7iIvlhM+wCditCRaonOriLx8WWyehY8kYxTUZ36Z1Q4VGm2JnuefQ18D+1ncnGXJXgbpg/EWHmDPRQFx9TQ2PBQ5aNgSGRUcq/Ovi+zGjOYQDNVYkQyEvsulSNtijWoQ==',key_name='tempest-keypair-165395776',keypairs=<?>,launch_index=0,launched_at=2023-04-14T02:01:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2ed4ed4ab2fd4c14b3e2afe343fd7256',ramdisk_id='',reservation_id='r-wapff4we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2035821517',owner_user_name='tempest-ServerActionsTestJSON-2035821517-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T02:03:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78ccd1a1ec1b486981d850881734fe02',uuid=24db983d-4ad5-45be-a8e5-8448b3e5e065,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f06d104-c24c-4287-817c-9f05b53fbb29", "address": "fa:16:3e:7b:17:65", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1797376284-network", "vif_mac": "fa:16:3e:7b:17:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f06d104-c2", "ovs_interfaceid": "9f06d104-c24c-4287-817c-9f05b53fbb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 02:03:47 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converting VIF {"id": "9f06d104-c24c-4287-817c-9f05b53fbb29", "address": "fa:16:3e:7b:17:65", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1797376284-network", "vif_mac": "fa:16:3e:7b:17:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f06d104-c2", "ovs_interfaceid": "9f06d104-c24c-4287-817c-9f05b53fbb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:03:47 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:17:65,bridge_name='br-int',has_traffic_filtering=True,id=9f06d104-c24c-4287-817c-9f05b53fbb29,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f06d104-c2') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:03:47 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] End _get_guest_xml xml=<domain type="kvm">
Apr 14 02:03:47 user nova-compute[71498]:   <uuid>24db983d-4ad5-45be-a8e5-8448b3e5e065</uuid>
Apr 14 02:03:47 user nova-compute[71498]:   <name>instance-00000024</name>
Apr 14 02:03:47 user nova-compute[71498]:   <memory>196608</memory>
Apr 14 02:03:47 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 02:03:47 user nova-compute[71498]:   <metadata>
Apr 14 02:03:47 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 02:03:47 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 02:03:47 user nova-compute[71498]:       <nova:name>tempest-ServerActionsTestJSON-server-240203784</nova:name>
Apr 14 02:03:47 user nova-compute[71498]:       <nova:creationTime>2023-04-14 02:03:46</nova:creationTime>
Apr 14 02:03:47 user nova-compute[71498]:       <nova:flavor name="m1.micro">
Apr 14 02:03:47 user nova-compute[71498]:         <nova:memory>192</nova:memory>
Apr 14 02:03:47 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 02:03:47 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 02:03:47 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 02:03:47 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 02:03:47 user nova-compute[71498]:       </nova:flavor>
Apr 14 02:03:47 user nova-compute[71498]:       <nova:owner>
Apr 14 02:03:47 user nova-compute[71498]:         <nova:user uuid="78ccd1a1ec1b486981d850881734fe02">tempest-ServerActionsTestJSON-2035821517-project-member</nova:user>
Apr 14 02:03:47 user nova-compute[71498]:         <nova:project uuid="2ed4ed4ab2fd4c14b3e2afe343fd7256">tempest-ServerActionsTestJSON-2035821517</nova:project>
Apr 14 02:03:47 user nova-compute[71498]:       </nova:owner>
Apr 14 02:03:47 user nova-compute[71498]:       <nova:ports>
Apr 14 02:03:47 user nova-compute[71498]:         <nova:port uuid="9f06d104-c24c-4287-817c-9f05b53fbb29">
Apr 14 02:03:47 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 02:03:47 user nova-compute[71498]:         </nova:port>
Apr 14 02:03:47 user nova-compute[71498]:       </nova:ports>
Apr 14 02:03:47 user nova-compute[71498]:     </nova:instance>
Apr 14 02:03:47 user nova-compute[71498]:   </metadata>
Apr 14 02:03:47 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 02:03:47 user nova-compute[71498]:     <system>
Apr 14 02:03:47 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 02:03:47 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 02:03:47 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 02:03:47 user nova-compute[71498]:       <entry name="serial">24db983d-4ad5-45be-a8e5-8448b3e5e065</entry>
Apr 14 02:03:47 user nova-compute[71498]:       <entry name="uuid">24db983d-4ad5-45be-a8e5-8448b3e5e065</entry>
Apr 14 02:03:47 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 02:03:47 user nova-compute[71498]:     </system>
Apr 14 02:03:47 user nova-compute[71498]:   </sysinfo>
Apr 14 02:03:47 user nova-compute[71498]:   <os>
Apr 14 02:03:47 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 02:03:47 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 02:03:47 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 02:03:47 user nova-compute[71498]:   </os>
Apr 14 02:03:47 user nova-compute[71498]:   <features>
Apr 14 02:03:47 user nova-compute[71498]:     <acpi/>
Apr 14 02:03:47 user nova-compute[71498]:     <apic/>
Apr 14 02:03:47 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 02:03:47 user nova-compute[71498]:   </features>
Apr 14 02:03:47 user nova-compute[71498]:   <clock offset="utc">
Apr 14 02:03:47 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 02:03:47 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 02:03:47 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 02:03:47 user nova-compute[71498]:   </clock>
Apr 14 02:03:47 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 02:03:47 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 02:03:47 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 02:03:47 user nova-compute[71498]:   </cpu>
Apr 14 02:03:47 user nova-compute[71498]:   <devices>
Apr 14 02:03:47 user nova-compute[71498]:     <disk type="block" device="disk">
Apr 14 02:03:47 user nova-compute[71498]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:03:47 user nova-compute[71498]:       <source dev="/dev/sdb"/>
Apr 14 02:03:47 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 02:03:47 user nova-compute[71498]:       <serial>06b73a5e-5178-4561-af91-11e1028d2238</serial>
Apr 14 02:03:47 user nova-compute[71498]:     </disk>
Apr 14 02:03:47 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 02:03:47 user nova-compute[71498]:       <mac address="fa:16:3e:7b:17:65"/>
Apr 14 02:03:47 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 02:03:47 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 02:03:47 user nova-compute[71498]:       <target dev="tap9f06d104-c2"/>
Apr 14 02:03:47 user nova-compute[71498]:     </interface>
Apr 14 02:03:47 user nova-compute[71498]:     <serial type="pty">
Apr 14 02:03:47 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/24db983d-4ad5-45be-a8e5-8448b3e5e065/console.log" append="off"/>
Apr 14 02:03:47 user nova-compute[71498]:     </serial>
Apr 14 02:03:47 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 02:03:47 user nova-compute[71498]:     <video>
Apr 14 02:03:47 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 02:03:47 user nova-compute[71498]:     </video>
Apr 14 02:03:47 user nova-compute[71498]:     <rng model="virtio">
Apr 14 02:03:47 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 02:03:47 user nova-compute[71498]:     </rng>
Apr 14 02:03:47 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 02:03:47 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 02:03:47 user nova-compute[71498]:       <stats period="10"/>
Apr 14 02:03:47 user nova-compute[71498]:     </memballoon>
Apr 14 02:03:47 user nova-compute[71498]:   </devices>
Apr 14 02:03:47 user nova-compute[71498]: </domain>
Apr 14 02:03:47 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 02:03:47 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:01:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-240203784',display_name='tempest-ServerActionsTestJSON-server-240203784',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-240203784',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7iIvlhM+wCditCRaonOriLx8WWyehY8kYxTUZ36Z1Q4VGm2JnuefQ18D+1ncnGXJXgbpg/EWHmDPRQFx9TQ2PBQ5aNgSGRUcq/Ovi+zGjOYQDNVYkQyEvsulSNtijWoQ==',key_name='tempest-keypair-165395776',keypairs=<?>,launch_index=0,launched_at=2023-04-14T02:01:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2ed4ed4ab2fd4c14b3e2afe343fd7256',ramdisk_id='',reservation_id='r-wapff4we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2035821517',owner_user_name='tempest-ServerActionsTestJSON-2035821517-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T02:03:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78ccd1a1ec1b486981d850881734fe02',uuid=24db983d-4ad5-45be-a8e5-8448b3e5e065,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f06d104-c24c-4287-817c-9f05b53fbb29", "address": "fa:16:3e:7b:17:65", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1797376284-network", "vif_mac": "fa:16:3e:7b:17:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f06d104-c2", "ovs_interfaceid": "9f06d104-c24c-4287-817c-9f05b53fbb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 02:03:47 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converting VIF {"id": "9f06d104-c24c-4287-817c-9f05b53fbb29", "address": "fa:16:3e:7b:17:65", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1797376284-network", "vif_mac": "fa:16:3e:7b:17:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f06d104-c2", "ovs_interfaceid": "9f06d104-c24c-4287-817c-9f05b53fbb29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:03:47 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:17:65,bridge_name='br-int',has_traffic_filtering=True,id=9f06d104-c24c-4287-817c-9f05b53fbb29,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f06d104-c2') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:03:47 user nova-compute[71498]: DEBUG os_vif [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:17:65,bridge_name='br-int',has_traffic_filtering=True,id=9f06d104-c24c-4287-817c-9f05b53fbb29,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f06d104-c2') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 02:03:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:03:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 02:03:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f06d104-c2, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:03:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9f06d104-c2, col_values=(('external_ids', {'iface-id': '9f06d104-c24c-4287-817c-9f05b53fbb29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:17:65', 'vm-uuid': '24db983d-4ad5-45be-a8e5-8448b3e5e065'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:03:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:03:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:47 user nova-compute[71498]: INFO os_vif [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:17:65,bridge_name='br-int',has_traffic_filtering=True,id=9f06d104-c24c-4287-817c-9f05b53fbb29,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f06d104-c2')
Apr 14 02:03:47 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:03:47 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] No VIF found with MAC fa:16:3e:7b:17:65, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 02:03:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:48 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:03:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:03:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:03:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:03:48 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 02:03:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:49 user nova-compute[71498]: DEBUG nova.compute.manager [req-562d9b2d-67c8-434c-92e0-d34765a8a053 req-555f9d7d-575b-4d2c-8492-df5d42d7b9c6 service nova] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Received event network-vif-plugged-9f06d104-c24c-4287-817c-9f05b53fbb29 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:03:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-562d9b2d-67c8-434c-92e0-d34765a8a053 req-555f9d7d-575b-4d2c-8492-df5d42d7b9c6 service nova] Acquiring lock "24db983d-4ad5-45be-a8e5-8448b3e5e065-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:03:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-562d9b2d-67c8-434c-92e0-d34765a8a053 req-555f9d7d-575b-4d2c-8492-df5d42d7b9c6 service nova] Lock "24db983d-4ad5-45be-a8e5-8448b3e5e065-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:03:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-562d9b2d-67c8-434c-92e0-d34765a8a053 req-555f9d7d-575b-4d2c-8492-df5d42d7b9c6 service nova] Lock "24db983d-4ad5-45be-a8e5-8448b3e5e065-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:03:49 user nova-compute[71498]: DEBUG nova.compute.manager [req-562d9b2d-67c8-434c-92e0-d34765a8a053 req-555f9d7d-575b-4d2c-8492-df5d42d7b9c6 service nova] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] No waiting events found dispatching network-vif-plugged-9f06d104-c24c-4287-817c-9f05b53fbb29 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:03:49 user nova-compute[71498]: WARNING nova.compute.manager [req-562d9b2d-67c8-434c-92e0-d34765a8a053 req-555f9d7d-575b-4d2c-8492-df5d42d7b9c6 service nova] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Received unexpected event network-vif-plugged-9f06d104-c24c-4287-817c-9f05b53fbb29 for instance with vm_state active and task_state resize_finish.
Apr 14 02:03:49 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:49 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:49 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 02:03:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a231fc48-a73e-4967-90c1-a31793235267/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a231fc48-a73e-4967-90c1-a31793235267/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a231fc48-a73e-4967-90c1-a31793235267/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:03:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a231fc48-a73e-4967-90c1-a31793235267/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:03:51 user nova-compute[71498]: DEBUG nova.compute.manager [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 02:03:51 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Removed pending event for 24db983d-4ad5-45be-a8e5-8448b3e5e065 due to event {{(pid=71498) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 02:03:51 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437831.0696561, 24db983d-4ad5-45be-a8e5-8448b3e5e065 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:03:51 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] VM Resumed (Lifecycle Event)
Apr 14 02:03:51 user nova-compute[71498]: DEBUG nova.compute.manager [req-b84db11b-633e-4ce7-b351-2f2e09308f73 req-f46d4f9c-6ea1-405d-bb13-0242c7f262c3 service nova] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Received event network-vif-plugged-9f06d104-c24c-4287-817c-9f05b53fbb29 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:03:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b84db11b-633e-4ce7-b351-2f2e09308f73 req-f46d4f9c-6ea1-405d-bb13-0242c7f262c3 service nova] Acquiring lock "24db983d-4ad5-45be-a8e5-8448b3e5e065-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:03:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b84db11b-633e-4ce7-b351-2f2e09308f73 req-f46d4f9c-6ea1-405d-bb13-0242c7f262c3 service nova] Lock "24db983d-4ad5-45be-a8e5-8448b3e5e065-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:03:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b84db11b-633e-4ce7-b351-2f2e09308f73 req-f46d4f9c-6ea1-405d-bb13-0242c7f262c3 service nova] Lock "24db983d-4ad5-45be-a8e5-8448b3e5e065-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:03:51 user nova-compute[71498]: DEBUG nova.compute.manager [req-b84db11b-633e-4ce7-b351-2f2e09308f73 req-f46d4f9c-6ea1-405d-bb13-0242c7f262c3 service nova] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] No waiting events found dispatching network-vif-plugged-9f06d104-c24c-4287-817c-9f05b53fbb29 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:03:51 user nova-compute[71498]: WARNING nova.compute.manager [req-b84db11b-633e-4ce7-b351-2f2e09308f73 req-f46d4f9c-6ea1-405d-bb13-0242c7f262c3 service nova] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Received unexpected event network-vif-plugged-9f06d104-c24c-4287-817c-9f05b53fbb29 for instance with vm_state active and task_state resize_finish.
Apr 14 02:03:51 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:03:51 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:03:51 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:03:51 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=8467MB free_disk=26.280128479003906GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 02:03:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:03:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:03:51 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Instance running successfully.
Apr 14 02:03:51 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Failed to set time: agent not configured {{(pid=71498) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 14 02:03:51 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-1d8e00c6-f9f9-4fdb-9a9f-a421af9d02ef tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] finish_migration finished successfully. {{(pid=71498) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 14 02:03:51 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 02:03:51 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 02:03:51 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437831.07182, 24db983d-4ad5-45be-a8e5-8448b3e5e065 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:03:51 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] VM Started (Lifecycle Event)
Apr 14 02:03:51 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:03:51 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 02:03:51 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 02:03:51 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Applying migration context for instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 as it has an incoming, in-progress migration 43fc5db8-f6ab-4364-abad-bbb4a48452c1. Migration status is post-migrating {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 02:03:51 user nova-compute[71498]: INFO nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Updating resource usage from migration 43fc5db8-f6ab-4364-abad-bbb4a48452c1
Apr 14 02:03:51 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 5ba29111-1e9b-4947-b046-6bbe888eca06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:03:51 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 57b15ad5-341a-47f8-9e3e-5cec8a85098a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:03:51 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance a231fc48-a73e-4967-90c1-a31793235267 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:03:51 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Migration 43fc5db8-f6ab-4364-abad-bbb4a48452c1 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 02:03:51 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:03:51 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 02:03:51 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=1216MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 02:03:51 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:03:51 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:03:51 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 02:03:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.378s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:03:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:03:56 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:03:56 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:03:56 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:03:56 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:03:57 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:03:57 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 02:03:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:04:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:04:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:04:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:04:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:04:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:04:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:04:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:04:05 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:04:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:04:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:04:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:04:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:04:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:04:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:04:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:04:19 user nova-compute[71498]: DEBUG nova.compute.manager [req-07e590f6-8872-47a4-af73-2f5ba937991f req-537161c6-8c77-480b-920b-76feed47c0a8 service nova] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Received event network-changed-18eed24e-8acb-457c-95b8-64c141faa4aa {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:04:19 user nova-compute[71498]: DEBUG nova.compute.manager [req-07e590f6-8872-47a4-af73-2f5ba937991f req-537161c6-8c77-480b-920b-76feed47c0a8 service nova] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Refreshing instance network info cache due to event network-changed-18eed24e-8acb-457c-95b8-64c141faa4aa. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 02:04:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-07e590f6-8872-47a4-af73-2f5ba937991f req-537161c6-8c77-480b-920b-76feed47c0a8 service nova] Acquiring lock "refresh_cache-57b15ad5-341a-47f8-9e3e-5cec8a85098a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:04:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-07e590f6-8872-47a4-af73-2f5ba937991f req-537161c6-8c77-480b-920b-76feed47c0a8 service nova] Acquired lock "refresh_cache-57b15ad5-341a-47f8-9e3e-5cec8a85098a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:04:19 user nova-compute[71498]: DEBUG nova.network.neutron [req-07e590f6-8872-47a4-af73-2f5ba937991f req-537161c6-8c77-480b-920b-76feed47c0a8 service nova] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Refreshing network info cache for port 18eed24e-8acb-457c-95b8-64c141faa4aa {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 02:04:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "57b15ad5-341a-47f8-9e3e-5cec8a85098a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:04:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "57b15ad5-341a-47f8-9e3e-5cec8a85098a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:04:19 user nova-compute[71498]: DEBUG nova.objects.instance [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lazy-loading 'flavor' on Instance uuid 57b15ad5-341a-47f8-9e3e-5cec8a85098a {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:04:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "57b15ad5-341a-47f8-9e3e-5cec8a85098a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:04:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "57b15ad5-341a-47f8-9e3e-5cec8a85098a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:04:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "57b15ad5-341a-47f8-9e3e-5cec8a85098a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:04:19 user nova-compute[71498]: INFO nova.compute.manager [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Attaching volume d6e664bf-00ef-4bb1-835c-e96535d4bb32 to /dev/vdb
Apr 14 02:04:19 user nova-compute[71498]: DEBUG os_brick.utils [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:04:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:04:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:04:19 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d501d911-a394-4d99-a290-49d8957b8207]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:04:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:04:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:04:19 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[854818e3-015e-497d-8c7b-2b22dd6bfcdd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:04:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:04:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:04:19 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[138e8862-c547-4aa0-bbf3-27e08894c3cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:04:19 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a80ef1c-a0f2-4028-8b5f-117ed4f247fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:04:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:04:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 02:04:19 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 02:04:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:04:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 02:04:19 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 02:04:19 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c99c10c-49f5-49d1-b28f-250ce35300ce]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:04:19 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 02:04:19 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 02:04:19 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 02:04:19 user nova-compute[71498]: DEBUG os_brick.utils [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:04:19 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Updating existing volume attachment record: 52065cbd-7ce3-4464-b6e9-9a35eb4e396e {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 02:04:19 user nova-compute[71498]: DEBUG nova.network.neutron [req-07e590f6-8872-47a4-af73-2f5ba937991f req-537161c6-8c77-480b-920b-76feed47c0a8 service nova] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Updated VIF entry in instance network info cache for port 18eed24e-8acb-457c-95b8-64c141faa4aa. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 02:04:19 user nova-compute[71498]: DEBUG nova.network.neutron [req-07e590f6-8872-47a4-af73-2f5ba937991f req-537161c6-8c77-480b-920b-76feed47c0a8 service nova] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Updating instance_info_cache with network_info: [{"id": "18eed24e-8acb-457c-95b8-64c141faa4aa", "address": "fa:16:3e:8a:75:08", "network": {"id": "d099696f-2c31-4ce1-89d8-680d87d17b9b", "bridge": "br-int", "label": "tempest-TestStampPattern-665967680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27dc405e16434633956ed2cd7e1791cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18eed24e-8a", "ovs_interfaceid": "18eed24e-8acb-457c-95b8-64c141faa4aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:04:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-07e590f6-8872-47a4-af73-2f5ba937991f req-537161c6-8c77-480b-920b-76feed47c0a8 service nova] Releasing lock "refresh_cache-57b15ad5-341a-47f8-9e3e-5cec8a85098a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:04:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:04:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kUVxZKGQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:04:24 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:04:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:04:24 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:04:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:04:24 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 02:04:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e36f5ff-17d0-4e91-8ecc-41389737afe0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 02:04:24 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e7614e-8b27-4663-b090-14f6cc51a9b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32] added
Apr 14 02:04:24 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56732fd-e2e3-4f53-b66f-dd657df3187d]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcbed87-1595-46a9-b86b-c91beefabc8f]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kUVxZKGQ {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kUVxZKGQ" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[540cae3e-dfea-429d-90bd-d92c9d74b522]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kUVxZKGQ'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae858eb-5625-4546-95ea-128896a57c51]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf63993-ce88-4110-b49b-05b5544943b1]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:04:24 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:04:24 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a2439a-f2fa-4fa0-9375-2aed4abd48b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32, portal: 172.16.0.220,3260]
Apr 14 02:04:24 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32, portal: 172.16.0.220,3260] successful.
Apr 14 02:04:24 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fd9bfc-ace0-4d46-99fc-41cebb4177a4]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab823a43-b6ba-4dd2-9160-a3a0f5c6ec14]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:04:24 user nova-compute[71498]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 (non-flash)
Apr 14 02:04:24 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:04:24 user nova-compute[71498]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 (non-flash)
Apr 14 02:04:24 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7b7a06-628e-4676-9239-9b576ddd1c2f]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:04:24 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: None {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 02:04:25 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 02:04:25 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kUVxZKGQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 02:04:25 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:04:25 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '26331396262623731', 'path': '/dev/sdc'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:04:25 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331396262623731', 'path': '/dev/sdc'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 02:04:25 user nova-compute[71498]: DEBUG nova.objects.instance [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lazy-loading 'flavor' on Instance uuid 57b15ad5-341a-47f8-9e3e-5cec8a85098a {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:04:25 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 02:04:25 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:04:25 user nova-compute[71498]:   <source dev="/dev/sdc"/>
Apr 14 02:04:25 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 02:04:25 user nova-compute[71498]:   <serial>d6e664bf-00ef-4bb1-835c-e96535d4bb32</serial>
Apr 14 02:04:25 user nova-compute[71498]: </disk>
Apr 14 02:04:25 user nova-compute[71498]:  {{(pid=71498) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 02:04:25 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:04:25 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:04:25 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] No VIF found with MAC fa:16:3e:8a:75:08, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 02:04:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-bc07acdf-d04d-4aa3-828e-7ee5dd583ba1 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "57b15ad5-341a-47f8-9e3e-5cec8a85098a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.501s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:04:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:04:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "57b15ad5-341a-47f8-9e3e-5cec8a85098a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:04:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "57b15ad5-341a-47f8-9e3e-5cec8a85098a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:04:28 user nova-compute[71498]: INFO nova.compute.manager [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Detaching volume d6e664bf-00ef-4bb1-835c-e96535d4bb32
Apr 14 02:04:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:04:28 user nova-compute[71498]: INFO nova.virt.block_device [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Attempting to driver detach volume d6e664bf-00ef-4bb1-835c-e96535d4bb32 from mountpoint /dev/vdb
Apr 14 02:04:28 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Attempting to detach device vdb from instance 57b15ad5-341a-47f8-9e3e-5cec8a85098a from the persistent domain config. {{(pid=71498) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 02:04:28 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 02:04:28 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:04:28 user nova-compute[71498]:   <source dev="/dev/sdc"/>
Apr 14 02:04:28 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 02:04:28 user nova-compute[71498]:   <serial>d6e664bf-00ef-4bb1-835c-e96535d4bb32</serial>
Apr 14 02:04:28 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 02:04:28 user nova-compute[71498]: </disk>
Apr 14 02:04:28 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 02:04:28 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Successfully detached device vdb from instance 57b15ad5-341a-47f8-9e3e-5cec8a85098a from the persistent domain config.
Apr 14 02:04:28 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 57b15ad5-341a-47f8-9e3e-5cec8a85098a from the live domain config. {{(pid=71498) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 02:04:28 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 02:04:28 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:04:28 user nova-compute[71498]:   <source dev="/dev/sdc"/>
Apr 14 02:04:28 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 02:04:28 user nova-compute[71498]:   <serial>d6e664bf-00ef-4bb1-835c-e96535d4bb32</serial>
Apr 14 02:04:28 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 02:04:28 user nova-compute[71498]: </disk>
Apr 14 02:04:28 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 02:04:28 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Received event <DeviceRemovedEvent: 1681437868.8999484, 57b15ad5-341a-47f8-9e3e-5cec8a85098a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71498) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 02:04:28 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 57b15ad5-341a-47f8-9e3e-5cec8a85098a {{(pid=71498) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 02:04:28 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Successfully detached device vdb from instance 57b15ad5-341a-47f8-9e3e-5cec8a85098a from the live domain config.
Apr 14 02:04:28 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 02:04:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kUVxZKGQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:04:28 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:04:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:04:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:04:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:04:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:04:28 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[640e3df2-5766-47f5-97a3-c4a075cf8c3a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:04:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 02:04:28 user nova-compute[71498]: No targets found.
Apr 14 02:04:28 user nova-compute[71498]: iSNS:
Apr 14 02:04:28 user nova-compute[71498]: No targets found.
Apr 14 02:04:28 user nova-compute[71498]: STATIC:
Apr 14 02:04:28 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238
Apr 14 02:04:28 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 02:04:28 user nova-compute[71498]:                 Iface Name: default
Apr 14 02:04:28 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32
Apr 14 02:04:28 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 02:04:28 user nova-compute[71498]:                 Iface Name: default
Apr 14 02:04:28 user nova-compute[71498]: FIRMWARE:
Apr 14 02:04:28 user nova-compute[71498]: No targets found.
Apr 14 02:04:28 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:04:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 02:04:28 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 02:04:28 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 02:04:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 02:04:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:04:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:04:28 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba089e2-884b-4e19-854b-5ad16a64c11a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:04:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:04:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:04:28 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0359695-cf47-4f48-b9ec-4afaec702a99]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:04:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:04:28 user nova-compute[71498]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 (non-flash)
Apr 14 02:04:28 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:04:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:04:28 user nova-compute[71498]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 (non-flash)
Apr 14 02:04:28 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:04:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51f46b1510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32'): ({'sdc'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 02:04:28 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Removing single pathed devices sdc {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 02:04:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:04:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:04:29 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c10d19a-1b7b-4f21-a6c0-cf42c18792e4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:04:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:04:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:04:29 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[64549a93-e280-4cee-90ad-b202a6697806]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:04:29 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Flushing IO for device /dev/sdc {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 02:04:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:04:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:04:29 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[057aa4c3-a205-46ba-a315-f04cb3a23d77]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:04:29 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 02:04:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:04:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.032s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:04:29 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a071893d-279b-43f0-a0f4-7b14b9371493]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:04:29 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 02:04:29 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] SCSI volumes sdc have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 02:04:29 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 02:04:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:04:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:04:29 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f6fe15-0744-47a2-b2d6-0f59b6124149]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:04:29 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:04:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:04:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:04:29 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf6ed79-9ddb-4230-99a1-926f5deb58c0]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:04:29 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32, portal: 172.16.0.220,3260]
Apr 14 02:04:29 user nova-compute[71498]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32, portal: 172.16.0.220,3260] successful.
Apr 14 02:04:29 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:04:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:04:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6e664bf-00ef-4bb1-835c-e96535d4bb32 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:04:29 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33c99f0-c26f-40f1-9175-3434c26ed8dc]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:04:29 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:04:29 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:04:29 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] <== disconnect_volume: return (272ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:04:29 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 02:04:30 user nova-compute[71498]: DEBUG nova.objects.instance [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lazy-loading 'flavor' on Instance uuid 57b15ad5-341a-47f8-9e3e-5cec8a85098a {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:04:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d2b6b9f3-f6af-45ba-aaa5-3a0904c54410 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "57b15ad5-341a-47f8-9e3e-5cec8a85098a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.724s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:04:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:04:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:04:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:04:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:04:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:04:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:04:45 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:04:46 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:04:46 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 02:04:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-24db983d-4ad5-45be-a8e5-8448b3e5e065" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:04:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-24db983d-4ad5-45be-a8e5-8448b3e5e065" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:04:46 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 02:04:46 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Updating instance_info_cache with network_info: [{"id": "9f06d104-c24c-4287-817c-9f05b53fbb29", "address": "fa:16:3e:7b:17:65", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f06d104-c2", "ovs_interfaceid": "9f06d104-c24c-4287-817c-9f05b53fbb29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:04:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-24db983d-4ad5-45be-a8e5-8448b3e5e065" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:04:46 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 02:04:46 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:04:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:04:48 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:04:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:04:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:04:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:04:48 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 02:04:48 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 02:04:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:04:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:04:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:04:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:04:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:04:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:04:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:04:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:04:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a231fc48-a73e-4967-90c1-a31793235267/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:04:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a231fc48-a73e-4967-90c1-a31793235267/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:04:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a231fc48-a73e-4967-90c1-a31793235267/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:04:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a231fc48-a73e-4967-90c1-a31793235267/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:04:49 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:04:49 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:04:49 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=8451MB free_disk=26.276660919189453GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 02:04:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:04:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:04:49 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Applying migration context for instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 as it has an incoming, in-progress migration 43fc5db8-f6ab-4364-abad-bbb4a48452c1. Migration status is finished {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 02:04:49 user nova-compute[71498]: INFO nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Updating resource usage from migration 43fc5db8-f6ab-4364-abad-bbb4a48452c1
Apr 14 02:04:49 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 5ba29111-1e9b-4947-b046-6bbe888eca06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:04:49 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 57b15ad5-341a-47f8-9e3e-5cec8a85098a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:04:49 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance a231fc48-a73e-4967-90c1-a31793235267 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:04:49 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Migration 43fc5db8-f6ab-4364-abad-bbb4a48452c1 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 02:04:49 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:04:49 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 02:04:49 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=1216MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 02:04:50 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:04:50 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:04:50 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 02:04:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.317s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:04:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:04:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:04:57 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:04:57 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:04:57 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:04:57 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:04:57 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:04:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:04:59 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:04:59 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 02:05:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:05:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:05:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "a231fc48-a73e-4967-90c1-a31793235267" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:05:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "a231fc48-a73e-4967-90c1-a31793235267" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:05:04 user nova-compute[71498]: DEBUG nova.objects.instance [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lazy-loading 'flavor' on Instance uuid a231fc48-a73e-4967-90c1-a31793235267 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:05:04 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Ignoring supplied device name: /dev/vdb
Apr 14 02:05:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "a231fc48-a73e-4967-90c1-a31793235267" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:05:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "a231fc48-a73e-4967-90c1-a31793235267" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:05:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "a231fc48-a73e-4967-90c1-a31793235267" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:05:04 user nova-compute[71498]: INFO nova.compute.manager [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Attaching volume 8e30d5da-2923-47a9-9cb1-98605d191299 to /dev/vdb
Apr 14 02:05:04 user nova-compute[71498]: DEBUG os_brick.utils [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:05:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:04 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b049862-4b62-47fb-af41-5e956d346c38]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:05:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:04 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[177fc750-8b8e-4a7b-8c70-e2a5175168ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:05:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:04 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f14e1a5-ad1c-43bf-8a09-402401bc9595]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:05:04 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b0fb4a-7dd6-4868-b42b-e12f66fedd80]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:05:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 02:05:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 02:05:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 02:05:04 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 02:05:04 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b08de4e-cb01-4478-ba88-b1a1be8226c3]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:05:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 02:05:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 02:05:04 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 02:05:04 user nova-compute[71498]: DEBUG os_brick.utils [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:05:04 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Updating existing volume attachment record: cf83d7bc-4cd0-4862-96b5-4861b127ce25 {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 02:05:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXYiqSgT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:05:09 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:05:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:05:09 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:05:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:05:09 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 02:05:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4838b88c-011b-4fe2-a9da-c517e075f2a8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 02:05:09 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa8427b-06af-4077-b9cf-f4c2955a717b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299] added
Apr 14 02:05:09 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[de772ab8-6203-4301-a5a0-5266249132de]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba183e3-53ee-4b07-aa84-bf9961169cc1]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DXYiqSgT {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DXYiqSgT" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e8a3ee-ce3c-4d19-ae30-6d8fe7e575e5]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DXYiqSgT'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c17938-9bb4-4661-8600-c2fdd01b90aa]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6524710d-9a81-4cb4-8def-24791b37a5b4]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:05:09 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:05:09 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[db22e609-a31a-487b-8dfd-1dbb764580a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299, portal: 172.16.0.220,3260]
Apr 14 02:05:09 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299, portal: 172.16.0.220,3260] successful.
Apr 14 02:05:09 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83a2892-cc10-4d1a-a847-866fc336195c]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b658670-b8a0-4818-8df2-7b5d09a837df]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:05:09 user nova-compute[71498]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 (non-flash)
Apr 14 02:05:09 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:05:09 user nova-compute[71498]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 (non-flash)
Apr 14 02:05:09 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6180ea4b-ac5e-4392-9cdb-fccad734fc4f]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 02:05:09 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXYiqSgT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 02:05:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:05:10 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23633343431653232', 'path': '/dev/sdc'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:05:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633343431653232', 'path': '/dev/sdc'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 02:05:10 user nova-compute[71498]: DEBUG nova.objects.instance [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lazy-loading 'flavor' on Instance uuid a231fc48-a73e-4967-90c1-a31793235267 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:05:10 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 02:05:10 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:05:10 user nova-compute[71498]:   <source dev="/dev/sdc"/>
Apr 14 02:05:10 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 02:05:10 user nova-compute[71498]:   <serial>8e30d5da-2923-47a9-9cb1-98605d191299</serial>
Apr 14 02:05:10 user nova-compute[71498]: </disk>
Apr 14 02:05:10 user nova-compute[71498]:  {{(pid=71498) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 02:05:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:05:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:05:11 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] No VIF found with MAC fa:16:3e:f2:08:27, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 02:05:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f7280b13-cb00-4c79-b8f9-3bb95c21e32f tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "a231fc48-a73e-4967-90c1-a31793235267" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.454s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:05:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:05:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:05:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:05:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:05:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:05:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:05:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:05:21 user nova-compute[71498]: DEBUG nova.compute.manager [None req-900d5b21-b085-48d6-b3dd-58b93a5bba99 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:05:21 user nova-compute[71498]: INFO nova.compute.manager [None req-900d5b21-b085-48d6-b3dd-58b93a5bba99 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] instance snapshotting
Apr 14 02:05:21 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-900d5b21-b085-48d6-b3dd-58b93a5bba99 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Beginning live snapshot process
Apr 14 02:05:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-900d5b21-b085-48d6-b3dd-58b93a5bba99 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk --force-share --output=json -f qcow2 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-900d5b21-b085-48d6-b3dd-58b93a5bba99 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk --force-share --output=json -f qcow2" returned: 0 in 0.140s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-900d5b21-b085-48d6-b3dd-58b93a5bba99 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk --force-share --output=json -f qcow2 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-900d5b21-b085-48d6-b3dd-58b93a5bba99 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk --force-share --output=json -f qcow2" returned: 0 in 0.140s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-900d5b21-b085-48d6-b3dd-58b93a5bba99 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-900d5b21-b085-48d6-b3dd-58b93a5bba99 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.154s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-900d5b21-b085-48d6-b3dd-58b93a5bba99 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgj7yr1lo/069a214c35284111beb951b7e3a4c880.delta 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-900d5b21-b085-48d6-b3dd-58b93a5bba99 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgj7yr1lo/069a214c35284111beb951b7e3a4c880.delta 1073741824" returned: 0 in 0.050s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:22 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-900d5b21-b085-48d6-b3dd-58b93a5bba99 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 02:05:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:05:23 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-900d5b21-b085-48d6-b3dd-58b93a5bba99 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] COPY block job progress, current cursor: 0 final cursor: 43843584 {{(pid=71498) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 02:05:23 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-900d5b21-b085-48d6-b3dd-58b93a5bba99 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] COPY block job progress, current cursor: 43843584 final cursor: 43843584 {{(pid=71498) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 02:05:23 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-900d5b21-b085-48d6-b3dd-58b93a5bba99 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 02:05:23 user nova-compute[71498]: DEBUG nova.privsep.utils [None req-900d5b21-b085-48d6-b3dd-58b93a5bba99 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71498) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 02:05:23 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-900d5b21-b085-48d6-b3dd-58b93a5bba99 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgj7yr1lo/069a214c35284111beb951b7e3a4c880.delta /opt/stack/data/nova/instances/snapshots/tmpgj7yr1lo/069a214c35284111beb951b7e3a4c880 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-900d5b21-b085-48d6-b3dd-58b93a5bba99 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgj7yr1lo/069a214c35284111beb951b7e3a4c880.delta /opt/stack/data/nova/instances/snapshots/tmpgj7yr1lo/069a214c35284111beb951b7e3a4c880" returned: 0 in 0.378s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:24 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-900d5b21-b085-48d6-b3dd-58b93a5bba99 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Snapshot extracted, beginning image upload
Apr 14 02:05:26 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-900d5b21-b085-48d6-b3dd-58b93a5bba99 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Snapshot image upload complete
Apr 14 02:05:26 user nova-compute[71498]: INFO nova.compute.manager [None req-900d5b21-b085-48d6-b3dd-58b93a5bba99 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Took 4.94 seconds to snapshot the instance on the hypervisor.
Apr 14 02:05:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ec2886d6-bd53-4ff4-b1d1-225098844d25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "24db983d-4ad5-45be-a8e5-8448b3e5e065" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:05:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ec2886d6-bd53-4ff4-b1d1-225098844d25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "24db983d-4ad5-45be-a8e5-8448b3e5e065" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:05:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-ec2886d6-bd53-4ff4-b1d1-225098844d25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Going to confirm migration 2 {{(pid=71498) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4663}}
Apr 14 02:05:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ec2886d6-bd53-4ff4-b1d1-225098844d25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "refresh_cache-24db983d-4ad5-45be-a8e5-8448b3e5e065" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:05:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ec2886d6-bd53-4ff4-b1d1-225098844d25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquired lock "refresh_cache-24db983d-4ad5-45be-a8e5-8448b3e5e065" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:05:27 user nova-compute[71498]: DEBUG nova.network.neutron [None req-ec2886d6-bd53-4ff4-b1d1-225098844d25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 02:05:27 user nova-compute[71498]: DEBUG nova.objects.instance [None req-ec2886d6-bd53-4ff4-b1d1-225098844d25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lazy-loading 'info_cache' on Instance uuid 24db983d-4ad5-45be-a8e5-8448b3e5e065 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:05:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:05:27 user nova-compute[71498]: DEBUG nova.network.neutron [None req-ec2886d6-bd53-4ff4-b1d1-225098844d25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Updating instance_info_cache with network_info: [{"id": "9f06d104-c24c-4287-817c-9f05b53fbb29", "address": "fa:16:3e:7b:17:65", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f06d104-c2", "ovs_interfaceid": "9f06d104-c24c-4287-817c-9f05b53fbb29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:05:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ec2886d6-bd53-4ff4-b1d1-225098844d25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Releasing lock "refresh_cache-24db983d-4ad5-45be-a8e5-8448b3e5e065" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:05:27 user nova-compute[71498]: DEBUG nova.objects.instance [None req-ec2886d6-bd53-4ff4-b1d1-225098844d25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lazy-loading 'migration_context' on Instance uuid 24db983d-4ad5-45be-a8e5-8448b3e5e065 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:05:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ec2886d6-bd53-4ff4-b1d1-225098844d25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:05:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ec2886d6-bd53-4ff4-b1d1-225098844d25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:05:27 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-ec2886d6-bd53-4ff4-b1d1-225098844d25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:05:27 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-ec2886d6-bd53-4ff4-b1d1-225098844d25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:05:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ec2886d6-bd53-4ff4-b1d1-225098844d25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.278s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:05:28 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-ec2886d6-bd53-4ff4-b1d1-225098844d25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Deleted allocation for migration 43fc5db8-f6ab-4364-abad-bbb4a48452c1
Apr 14 02:05:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-ec2886d6-bd53-4ff4-b1d1-225098844d25 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "24db983d-4ad5-45be-a8e5-8448b3e5e065" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.349s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:05:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "a231fc48-a73e-4967-90c1-a31793235267" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:05:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "a231fc48-a73e-4967-90c1-a31793235267" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:05:30 user nova-compute[71498]: INFO nova.compute.manager [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Detaching volume 8e30d5da-2923-47a9-9cb1-98605d191299
Apr 14 02:05:30 user nova-compute[71498]: INFO nova.virt.block_device [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Attempting to driver detach volume 8e30d5da-2923-47a9-9cb1-98605d191299 from mountpoint /dev/vdb
Apr 14 02:05:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Attempting to detach device vdb from instance a231fc48-a73e-4967-90c1-a31793235267 from the persistent domain config. {{(pid=71498) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 02:05:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 02:05:30 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:05:30 user nova-compute[71498]:   <source dev="/dev/sdc"/>
Apr 14 02:05:30 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 02:05:30 user nova-compute[71498]:   <serial>8e30d5da-2923-47a9-9cb1-98605d191299</serial>
Apr 14 02:05:30 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 02:05:30 user nova-compute[71498]: </disk>
Apr 14 02:05:30 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 02:05:30 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Successfully detached device vdb from instance a231fc48-a73e-4967-90c1-a31793235267 from the persistent domain config.
Apr 14 02:05:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a231fc48-a73e-4967-90c1-a31793235267 from the live domain config. {{(pid=71498) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 02:05:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 02:05:30 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:05:30 user nova-compute[71498]:   <source dev="/dev/sdc"/>
Apr 14 02:05:30 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 02:05:30 user nova-compute[71498]:   <serial>8e30d5da-2923-47a9-9cb1-98605d191299</serial>
Apr 14 02:05:30 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 02:05:30 user nova-compute[71498]: </disk>
Apr 14 02:05:30 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 02:05:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "a231fc48-a73e-4967-90c1-a31793235267" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:05:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Received event <DeviceRemovedEvent: 1681437930.8937807, a231fc48-a73e-4967-90c1-a31793235267 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71498) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 02:05:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a231fc48-a73e-4967-90c1-a31793235267 {{(pid=71498) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 02:05:30 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Successfully detached device vdb from instance a231fc48-a73e-4967-90c1-a31793235267 from the live domain config.
Apr 14 02:05:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 02:05:30 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXYiqSgT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:05:30 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:05:30 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:05:30 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:05:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:30 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa2211f-c28d-46c3-868d-977b9a75f83b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:05:30 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 02:05:30 user nova-compute[71498]: No targets found.
Apr 14 02:05:30 user nova-compute[71498]: iSNS:
Apr 14 02:05:30 user nova-compute[71498]: No targets found.
Apr 14 02:05:30 user nova-compute[71498]: STATIC:
Apr 14 02:05:30 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299
Apr 14 02:05:30 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 02:05:30 user nova-compute[71498]:                 Iface Name: default
Apr 14 02:05:30 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238
Apr 14 02:05:30 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 02:05:30 user nova-compute[71498]:                 Iface Name: default
Apr 14 02:05:30 user nova-compute[71498]: FIRMWARE:
Apr 14 02:05:30 user nova-compute[71498]: No targets found.
Apr 14 02:05:30 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:05:30 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 02:05:30 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 02:05:30 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 02:05:30 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 02:05:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:30 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae0d2bf-d6bc-4826-8865-7694ec8b311d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:05:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:30 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[976e7a48-a987-4042-bb6e-5a5b9cdd098b]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:05:30 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:05:30 user nova-compute[71498]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 (non-flash)
Apr 14 02:05:30 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:05:30 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:05:30 user nova-compute[71498]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 (non-flash)
Apr 14 02:05:30 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:05:30 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51c468ea70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299'): ({'sdc'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 02:05:30 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Removing single pathed devices sdc {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 02:05:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e6dcb3-63df-4f11-86c4-fae56223a373]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:05:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8921fc-a8a8-4350-92b3-10e14ce98cd1]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:05:31 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Flushing IO for device /dev/sdc {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 02:05:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f49bf9-bb43-47c3-96c0-e604b407efb5]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:05:31 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 02:05:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad85461d-d275-4fec-b0ad-6fd962f6aee2]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:05:31 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 02:05:31 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] SCSI volumes sdc have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 02:05:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 02:05:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70d0cf8-d121-47ac-aa39-2fa7c27378a4]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:05:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:05:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42c4e50-9b53-4c99-a09c-b6986f1e9cfb]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:05:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299, portal: 172.16.0.220,3260]
Apr 14 02:05:31 user nova-compute[71498]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299, portal: 172.16.0.220,3260] successful.
Apr 14 02:05:31 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:05:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e138663a-82f3-4c55-a9e0-e0da8bff789a]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:05:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:05:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:05:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] <== disconnect_volume: return (335ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:05:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 02:05:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:05:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:05:31 user nova-compute[71498]: DEBUG nova.compute.manager [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 02:05:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:05:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:05:32 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 02:05:32 user nova-compute[71498]: INFO nova.compute.claims [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Claim successful on node user
Apr 14 02:05:32 user nova-compute[71498]: DEBUG nova.objects.instance [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lazy-loading 'flavor' on Instance uuid a231fc48-a73e-4967-90c1-a31793235267 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:05:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-0c7853d3-ba88-4ff9-b8c0-9d5469671593 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "a231fc48-a73e-4967-90c1-a31793235267" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.065s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:05:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "a231fc48-a73e-4967-90c1-a31793235267" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.962s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:05:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "a231fc48-a73e-4967-90c1-a31793235267-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:05:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "a231fc48-a73e-4967-90c1-a31793235267-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:05:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "a231fc48-a73e-4967-90c1-a31793235267-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:05:32 user nova-compute[71498]: INFO nova.compute.manager [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Terminating instance
Apr 14 02:05:32 user nova-compute[71498]: DEBUG nova.compute.manager [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 02:05:32 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:05:32 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:05:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:05:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:05:32 user nova-compute[71498]: DEBUG nova.compute.manager [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 02:05:32 user nova-compute[71498]: DEBUG nova.compute.manager [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 02:05:32 user nova-compute[71498]: DEBUG nova.network.neutron [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 02:05:32 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 02:05:32 user nova-compute[71498]: DEBUG nova.compute.manager [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 02:05:32 user nova-compute[71498]: DEBUG nova.compute.manager [req-2b22a5f6-bcf6-49a2-9616-eeaae727d073 req-0d4acf92-dd85-48d1-8139-5c3764d0f951 service nova] [instance: a231fc48-a73e-4967-90c1-a31793235267] Received event network-vif-unplugged-abd5445b-2a67-4861-9840-b88f47390eb7 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:05:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-2b22a5f6-bcf6-49a2-9616-eeaae727d073 req-0d4acf92-dd85-48d1-8139-5c3764d0f951 service nova] Acquiring lock "a231fc48-a73e-4967-90c1-a31793235267-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:05:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-2b22a5f6-bcf6-49a2-9616-eeaae727d073 req-0d4acf92-dd85-48d1-8139-5c3764d0f951 service nova] Lock "a231fc48-a73e-4967-90c1-a31793235267-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:05:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-2b22a5f6-bcf6-49a2-9616-eeaae727d073 req-0d4acf92-dd85-48d1-8139-5c3764d0f951 service nova] Lock "a231fc48-a73e-4967-90c1-a31793235267-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:05:32 user nova-compute[71498]: DEBUG nova.compute.manager [req-2b22a5f6-bcf6-49a2-9616-eeaae727d073 req-0d4acf92-dd85-48d1-8139-5c3764d0f951 service nova] [instance: a231fc48-a73e-4967-90c1-a31793235267] No waiting events found dispatching network-vif-unplugged-abd5445b-2a67-4861-9840-b88f47390eb7 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:05:32 user nova-compute[71498]: DEBUG nova.compute.manager [req-2b22a5f6-bcf6-49a2-9616-eeaae727d073 req-0d4acf92-dd85-48d1-8139-5c3764d0f951 service nova] [instance: a231fc48-a73e-4967-90c1-a31793235267] Received event network-vif-unplugged-abd5445b-2a67-4861-9840-b88f47390eb7 for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 02:05:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:05:32 user nova-compute[71498]: DEBUG nova.policy [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ae5170969344b9fa5294231f8ffbe72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27dc405e16434633956ed2cd7e1791cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 02:05:32 user nova-compute[71498]: DEBUG nova.compute.manager [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 02:05:32 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 02:05:32 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Creating image(s)
Apr 14 02:05:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "/opt/stack/data/nova/instances/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:05:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "/opt/stack/data/nova/instances/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:05:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "/opt/stack/data/nova/instances/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:05:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "f55ebe4b754373f46f480f3d9fb54b297d881114" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:05:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "f55ebe4b754373f46f480f3d9fb54b297d881114" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:05:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f55ebe4b754373f46f480f3d9fb54b297d881114.part --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:33 user nova-compute[71498]: DEBUG nova.network.neutron [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Successfully created port: 735565d4-21ba-4824-9dcb-d464456080fc {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 02:05:33 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: a231fc48-a73e-4967-90c1-a31793235267] Instance destroyed successfully.
Apr 14 02:05:33 user nova-compute[71498]: DEBUG nova.objects.instance [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lazy-loading 'resources' on Instance uuid a231fc48-a73e-4967-90c1-a31793235267 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:05:33 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:03:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1460124092',display_name='tempest-VolumesSnapshotTestJSON-instance-1460124092',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1460124092',id=38,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T02:03:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3fba8f38142a41928f0d2e8ead3aab96',ramdisk_id='',reservation_id='r-gem8vsaf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2121749885',owner_user_name='tempest-VolumesSnapshotTestJSON-2121749885-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T02:03:21Z,user_data=None,user_id='fbb0e166c1f448cbba774b835f9798c9',uuid=a231fc48-a73e-4967-90c1-a31793235267,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abd5445b-2a67-4861-9840-b88f47390eb7", "address": "fa:16:3e:f2:08:27", "network": {"id": "1cdc7ce4-e3ce-4e21-834b-712724a6c11d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-70541503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3fba8f38142a41928f0d2e8ead3aab96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabd5445b-2a", "ovs_interfaceid": "abd5445b-2a67-4861-9840-b88f47390eb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 02:05:33 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Converting VIF {"id": "abd5445b-2a67-4861-9840-b88f47390eb7", "address": "fa:16:3e:f2:08:27", "network": {"id": "1cdc7ce4-e3ce-4e21-834b-712724a6c11d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-70541503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3fba8f38142a41928f0d2e8ead3aab96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabd5445b-2a", "ovs_interfaceid": "abd5445b-2a67-4861-9840-b88f47390eb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:05:33 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:08:27,bridge_name='br-int',has_traffic_filtering=True,id=abd5445b-2a67-4861-9840-b88f47390eb7,network=Network(1cdc7ce4-e3ce-4e21-834b-712724a6c11d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabd5445b-2a') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:05:33 user nova-compute[71498]: DEBUG os_vif [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:08:27,bridge_name='br-int',has_traffic_filtering=True,id=abd5445b-2a67-4861-9840-b88f47390eb7,network=Network(1cdc7ce4-e3ce-4e21-834b-712724a6c11d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabd5445b-2a') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 02:05:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:05:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapabd5445b-2a, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:05:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:05:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:05:33 user nova-compute[71498]: INFO os_vif [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:08:27,bridge_name='br-int',has_traffic_filtering=True,id=abd5445b-2a67-4861-9840-b88f47390eb7,network=Network(1cdc7ce4-e3ce-4e21-834b-712724a6c11d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabd5445b-2a')
Apr 14 02:05:33 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 02:05:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXYiqSgT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:05:34 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:05:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f55ebe4b754373f46f480f3d9fb54b297d881114.part --force-share --output=json" returned: 0 in 0.177s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG nova.virt.images [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] 04ce4b97-8518-4303-b06d-8307b1cb09b8 was qcow2, converting to raw {{(pid=71498) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG nova.privsep.utils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71498) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f55ebe4b754373f46f480f3d9fb54b297d881114.part /opt/stack/data/nova/instances/_base/f55ebe4b754373f46f480f3d9fb54b297d881114.converted {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0c50e8-175f-4d52-b87d-e2c8da5674b2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 02:05:34 user nova-compute[71498]: No targets found.
Apr 14 02:05:34 user nova-compute[71498]: iSNS:
Apr 14 02:05:34 user nova-compute[71498]: No targets found.
Apr 14 02:05:34 user nova-compute[71498]: STATIC:
Apr 14 02:05:34 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238
Apr 14 02:05:34 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 02:05:34 user nova-compute[71498]:                 Iface Name: default
Apr 14 02:05:34 user nova-compute[71498]: FIRMWARE:
Apr 14 02:05:34 user nova-compute[71498]: No targets found.
Apr 14 02:05:34 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 02:05:34 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 02:05:34 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e30d5da-2923-47a9-9cb1-98605d191299', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6c8e38-e1f0-406f-913b-3ca29069ac82]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b877c97-c03c-46cc-98c5-023c4ce381a4]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:05:34 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:05:34 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51f42ad3f0>, {}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Disconnecting from: [] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.117s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] <== disconnect_volume: return (119ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 02:05:34 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Deleting instance files /opt/stack/data/nova/instances/a231fc48-a73e-4967-90c1-a31793235267_del
Apr 14 02:05:34 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Deletion of /opt/stack/data/nova/instances/a231fc48-a73e-4967-90c1-a31793235267_del complete
Apr 14 02:05:34 user nova-compute[71498]: INFO nova.compute.manager [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Took 1.89 seconds to destroy the instance on the hypervisor.
Apr 14 02:05:34 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: a231fc48-a73e-4967-90c1-a31793235267] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: a231fc48-a73e-4967-90c1-a31793235267] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f55ebe4b754373f46f480f3d9fb54b297d881114.part /opt/stack/data/nova/instances/_base/f55ebe4b754373f46f480f3d9fb54b297d881114.converted" returned: 0 in 0.342s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f55ebe4b754373f46f480f3d9fb54b297d881114.converted --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f55ebe4b754373f46f480f3d9fb54b297d881114.converted --force-share --output=json" returned: 0 in 0.166s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "f55ebe4b754373f46f480f3d9fb54b297d881114" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.735s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f55ebe4b754373f46f480f3d9fb54b297d881114 --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f55ebe4b754373f46f480f3d9fb54b297d881114 --force-share --output=json" returned: 0 in 0.153s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "f55ebe4b754373f46f480f3d9fb54b297d881114" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "f55ebe4b754373f46f480f3d9fb54b297d881114" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f55ebe4b754373f46f480f3d9fb54b297d881114 --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG nova.compute.manager [req-93e086bc-e5b4-4fae-ab88-0889d3f0a0c1 req-19366a2c-f5fa-4443-987d-31f1a225c5d4 service nova] [instance: a231fc48-a73e-4967-90c1-a31793235267] Received event network-vif-plugged-abd5445b-2a67-4861-9840-b88f47390eb7 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-93e086bc-e5b4-4fae-ab88-0889d3f0a0c1 req-19366a2c-f5fa-4443-987d-31f1a225c5d4 service nova] Acquiring lock "a231fc48-a73e-4967-90c1-a31793235267-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-93e086bc-e5b4-4fae-ab88-0889d3f0a0c1 req-19366a2c-f5fa-4443-987d-31f1a225c5d4 service nova] Lock "a231fc48-a73e-4967-90c1-a31793235267-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-93e086bc-e5b4-4fae-ab88-0889d3f0a0c1 req-19366a2c-f5fa-4443-987d-31f1a225c5d4 service nova] Lock "a231fc48-a73e-4967-90c1-a31793235267-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG nova.compute.manager [req-93e086bc-e5b4-4fae-ab88-0889d3f0a0c1 req-19366a2c-f5fa-4443-987d-31f1a225c5d4 service nova] [instance: a231fc48-a73e-4967-90c1-a31793235267] No waiting events found dispatching network-vif-plugged-abd5445b-2a67-4861-9840-b88f47390eb7 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:05:34 user nova-compute[71498]: WARNING nova.compute.manager [req-93e086bc-e5b4-4fae-ab88-0889d3f0a0c1 req-19366a2c-f5fa-4443-987d-31f1a225c5d4 service nova] [instance: a231fc48-a73e-4967-90c1-a31793235267] Received unexpected event network-vif-plugged-abd5445b-2a67-4861-9840-b88f47390eb7 for instance with vm_state active and task_state deleting.
Apr 14 02:05:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f55ebe4b754373f46f480f3d9fb54b297d881114 --force-share --output=json" returned: 0 in 0.174s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f55ebe4b754373f46f480f3d9fb54b297d881114,backing_fmt=raw /opt/stack/data/nova/instances/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f55ebe4b754373f46f480f3d9fb54b297d881114,backing_fmt=raw /opt/stack/data/nova/instances/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570/disk 1073741824" returned: 0 in 0.056s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "f55ebe4b754373f46f480f3d9fb54b297d881114" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:05:34 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f55ebe4b754373f46f480f3d9fb54b297d881114 --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: a231fc48-a73e-4967-90c1-a31793235267] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:05:35 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: a231fc48-a73e-4967-90c1-a31793235267] Took 0.75 seconds to deallocate network for instance.
Apr 14 02:05:35 user nova-compute[71498]: WARNING nova.volume.cinder [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Attachment cf83d7bc-4cd0-4862-96b5-4861b127ce25 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = cf83d7bc-4cd0-4862-96b5-4861b127ce25. (HTTP 404) (Request-ID: req-453e74e8-5252-4ca3-865a-263d0fbaade5)
Apr 14 02:05:35 user nova-compute[71498]: INFO nova.compute.manager [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: a231fc48-a73e-4967-90c1-a31793235267] Took 0.03 seconds to detach 1 volumes for instance.
Apr 14 02:05:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f55ebe4b754373f46f480f3d9fb54b297d881114 --force-share --output=json" returned: 0 in 0.146s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG nova.objects.instance [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lazy-loading 'migration_context' on Instance uuid 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Ensure instance console log exists: /opt/stack/data/nova/instances/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG nova.network.neutron [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Successfully updated port: 735565d4-21ba-4824-9dcb-d464456080fc {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "refresh_cache-2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquired lock "refresh_cache-2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG nova.network.neutron [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.213s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG nova.compute.manager [req-a8782a12-885a-4c8e-8b63-1f139024f509 req-4aa83cf5-bde0-4967-9df0-ad3e45f6605a service nova] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Received event network-changed-735565d4-21ba-4824-9dcb-d464456080fc {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG nova.compute.manager [req-a8782a12-885a-4c8e-8b63-1f139024f509 req-4aa83cf5-bde0-4967-9df0-ad3e45f6605a service nova] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Refreshing instance network info cache due to event network-changed-735565d4-21ba-4824-9dcb-d464456080fc. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a8782a12-885a-4c8e-8b63-1f139024f509 req-4aa83cf5-bde0-4967-9df0-ad3e45f6605a service nova] Acquiring lock "refresh_cache-2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:05:35 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Deleted allocations for instance a231fc48-a73e-4967-90c1-a31793235267
Apr 14 02:05:35 user nova-compute[71498]: DEBUG nova.network.neutron [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-dfb1ad65-1aad-43ee-a949-26f1f3bb4b21 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "a231fc48-a73e-4967-90c1-a31793235267" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.119s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG nova.network.neutron [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Updating instance_info_cache with network_info: [{"id": "735565d4-21ba-4824-9dcb-d464456080fc", "address": "fa:16:3e:3a:68:0a", "network": {"id": "d099696f-2c31-4ce1-89d8-680d87d17b9b", "bridge": "br-int", "label": "tempest-TestStampPattern-665967680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27dc405e16434633956ed2cd7e1791cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735565d4-21", "ovs_interfaceid": "735565d4-21ba-4824-9dcb-d464456080fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Releasing lock "refresh_cache-2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Instance network_info: |[{"id": "735565d4-21ba-4824-9dcb-d464456080fc", "address": "fa:16:3e:3a:68:0a", "network": {"id": "d099696f-2c31-4ce1-89d8-680d87d17b9b", "bridge": "br-int", "label": "tempest-TestStampPattern-665967680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27dc405e16434633956ed2cd7e1791cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735565d4-21", "ovs_interfaceid": "735565d4-21ba-4824-9dcb-d464456080fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a8782a12-885a-4c8e-8b63-1f139024f509 req-4aa83cf5-bde0-4967-9df0-ad3e45f6605a service nova] Acquired lock "refresh_cache-2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG nova.network.neutron [req-a8782a12-885a-4c8e-8b63-1f139024f509 req-4aa83cf5-bde0-4967-9df0-ad3e45f6605a service nova] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Refreshing network info cache for port 735565d4-21ba-4824-9dcb-d464456080fc {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Start _get_guest_xml network_info=[{"id": "735565d4-21ba-4824-9dcb-d464456080fc", "address": "fa:16:3e:3a:68:0a", "network": {"id": "d099696f-2c31-4ce1-89d8-680d87d17b9b", "bridge": "br-int", "label": "tempest-TestStampPattern-665967680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27dc405e16434633956ed2cd7e1791cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735565d4-21", "ovs_interfaceid": "735565d4-21ba-4824-9dcb-d464456080fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b645f44eeb98df3e93841e41094867cf',container_format='bare',created_at=2023-04-14T02:05:22Z,direct_url=<?>,disk_format='qcow2',id=04ce4b97-8518-4303-b06d-8307b1cb09b8,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-656805884',owner='27dc405e16434633956ed2cd7e1791cd',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-14T02:05:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': '04ce4b97-8518-4303-b06d-8307b1cb09b8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 02:05:35 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:05:35 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:05:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b645f44eeb98df3e93841e41094867cf',container_format='bare',created_at=2023-04-14T02:05:22Z,direct_url=<?>,disk_format='qcow2',id=04ce4b97-8518-4303-b06d-8307b1cb09b8,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-656805884',owner='27dc405e16434633956ed2cd7e1791cd',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-14T02:05:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:05:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-835223747',display_name='tempest-TestStampPattern-server-835223747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-835223747',id=39,image_ref='04ce4b97-8518-4303-b06d-8307b1cb09b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN71XmYAhugQNhgl+EJR/4+t7AjKtKkpcGBG8gx2VPAwa0I3bKysgOFGLrmgG1OeFgwpiuJDroargohcSM2hH/0cqZkFOvlkmK46/6QQTJRBUwCSuTngzFe2HQ0i1G666A==',key_name='tempest-TestStampPattern-610075453',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27dc405e16434633956ed2cd7e1791cd',ramdisk_id='',reservation_id='r-mndxqxw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='57b15ad5-341a-47f8-9e3e-5cec8a85098a',image_min_disk='1',image_min_ram='0',image_owner_id='27dc405e16434633956ed2cd7e1791cd',image_owner_project_name='tempest-TestStampPattern-190654074',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-190654074-project-member',image_user_id='7ae5170969344b9fa5294231f8ffbe72',network_allocated='True',owner_project_name='tempest-TestStampPattern-190654074',owner_user_name='tempest-TestStampPattern-190654074-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T02:05:33Z,user_data=None,user_id='7ae5170969344b9fa5294231f8ffbe72',uuid=2bf92b68-9cc4-4e22-b7b8-30eb6b69c570,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "735565d4-21ba-4824-9dcb-d464456080fc", "address": "fa:16:3e:3a:68:0a", "network": {"id": "d099696f-2c31-4ce1-89d8-680d87d17b9b", "bridge": "br-int", "label": "tempest-TestStampPattern-665967680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27dc405e16434633956ed2cd7e1791cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735565d4-21", "ovs_interfaceid": "735565d4-21ba-4824-9dcb-d464456080fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Converting VIF {"id": "735565d4-21ba-4824-9dcb-d464456080fc", "address": "fa:16:3e:3a:68:0a", "network": {"id": "d099696f-2c31-4ce1-89d8-680d87d17b9b", "bridge": "br-int", "label": "tempest-TestStampPattern-665967680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27dc405e16434633956ed2cd7e1791cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735565d4-21", "ovs_interfaceid": "735565d4-21ba-4824-9dcb-d464456080fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:68:0a,bridge_name='br-int',has_traffic_filtering=True,id=735565d4-21ba-4824-9dcb-d464456080fc,network=Network(d099696f-2c31-4ce1-89d8-680d87d17b9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap735565d4-21') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG nova.objects.instance [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] End _get_guest_xml xml=<domain type="kvm">
Apr 14 02:05:35 user nova-compute[71498]:   <uuid>2bf92b68-9cc4-4e22-b7b8-30eb6b69c570</uuid>
Apr 14 02:05:35 user nova-compute[71498]:   <name>instance-00000027</name>
Apr 14 02:05:35 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 02:05:35 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 02:05:35 user nova-compute[71498]:   <metadata>
Apr 14 02:05:35 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 02:05:35 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 02:05:35 user nova-compute[71498]:       <nova:name>tempest-TestStampPattern-server-835223747</nova:name>
Apr 14 02:05:35 user nova-compute[71498]:       <nova:creationTime>2023-04-14 02:05:35</nova:creationTime>
Apr 14 02:05:35 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 02:05:35 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 02:05:35 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 02:05:35 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 02:05:35 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 02:05:35 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 02:05:35 user nova-compute[71498]:       </nova:flavor>
Apr 14 02:05:35 user nova-compute[71498]:       <nova:owner>
Apr 14 02:05:35 user nova-compute[71498]:         <nova:user uuid="7ae5170969344b9fa5294231f8ffbe72">tempest-TestStampPattern-190654074-project-member</nova:user>
Apr 14 02:05:35 user nova-compute[71498]:         <nova:project uuid="27dc405e16434633956ed2cd7e1791cd">tempest-TestStampPattern-190654074</nova:project>
Apr 14 02:05:35 user nova-compute[71498]:       </nova:owner>
Apr 14 02:05:35 user nova-compute[71498]:       <nova:root type="image" uuid="04ce4b97-8518-4303-b06d-8307b1cb09b8"/>
Apr 14 02:05:35 user nova-compute[71498]:       <nova:ports>
Apr 14 02:05:35 user nova-compute[71498]:         <nova:port uuid="735565d4-21ba-4824-9dcb-d464456080fc">
Apr 14 02:05:35 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 02:05:35 user nova-compute[71498]:         </nova:port>
Apr 14 02:05:35 user nova-compute[71498]:       </nova:ports>
Apr 14 02:05:35 user nova-compute[71498]:     </nova:instance>
Apr 14 02:05:35 user nova-compute[71498]:   </metadata>
Apr 14 02:05:35 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 02:05:35 user nova-compute[71498]:     <system>
Apr 14 02:05:35 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 02:05:35 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 02:05:35 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 02:05:35 user nova-compute[71498]:       <entry name="serial">2bf92b68-9cc4-4e22-b7b8-30eb6b69c570</entry>
Apr 14 02:05:35 user nova-compute[71498]:       <entry name="uuid">2bf92b68-9cc4-4e22-b7b8-30eb6b69c570</entry>
Apr 14 02:05:35 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 02:05:35 user nova-compute[71498]:     </system>
Apr 14 02:05:35 user nova-compute[71498]:   </sysinfo>
Apr 14 02:05:35 user nova-compute[71498]:   <os>
Apr 14 02:05:35 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 02:05:35 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 02:05:35 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 02:05:35 user nova-compute[71498]:   </os>
Apr 14 02:05:35 user nova-compute[71498]:   <features>
Apr 14 02:05:35 user nova-compute[71498]:     <acpi/>
Apr 14 02:05:35 user nova-compute[71498]:     <apic/>
Apr 14 02:05:35 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 02:05:35 user nova-compute[71498]:   </features>
Apr 14 02:05:35 user nova-compute[71498]:   <clock offset="utc">
Apr 14 02:05:35 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 02:05:35 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 02:05:35 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 02:05:35 user nova-compute[71498]:   </clock>
Apr 14 02:05:35 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 02:05:35 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 02:05:35 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 02:05:35 user nova-compute[71498]:   </cpu>
Apr 14 02:05:35 user nova-compute[71498]:   <devices>
Apr 14 02:05:35 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 02:05:35 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 02:05:35 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570/disk"/>
Apr 14 02:05:35 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 02:05:35 user nova-compute[71498]:     </disk>
Apr 14 02:05:35 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 02:05:35 user nova-compute[71498]:       <mac address="fa:16:3e:3a:68:0a"/>
Apr 14 02:05:35 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 02:05:35 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 02:05:35 user nova-compute[71498]:       <target dev="tap735565d4-21"/>
Apr 14 02:05:35 user nova-compute[71498]:     </interface>
Apr 14 02:05:35 user nova-compute[71498]:     <serial type="pty">
Apr 14 02:05:35 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570/console.log" append="off"/>
Apr 14 02:05:35 user nova-compute[71498]:     </serial>
Apr 14 02:05:35 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 02:05:35 user nova-compute[71498]:     <video>
Apr 14 02:05:35 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 02:05:35 user nova-compute[71498]:     </video>
Apr 14 02:05:35 user nova-compute[71498]:     <rng model="virtio">
Apr 14 02:05:35 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 02:05:35 user nova-compute[71498]:     </rng>
Apr 14 02:05:35 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 02:05:35 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 02:05:35 user nova-compute[71498]:       <stats period="10"/>
Apr 14 02:05:35 user nova-compute[71498]:     </memballoon>
Apr 14 02:05:35 user nova-compute[71498]:   </devices>
Apr 14 02:05:35 user nova-compute[71498]: </domain>
Apr 14 02:05:35 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:05:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-835223747',display_name='tempest-TestStampPattern-server-835223747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-835223747',id=39,image_ref='04ce4b97-8518-4303-b06d-8307b1cb09b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN71XmYAhugQNhgl+EJR/4+t7AjKtKkpcGBG8gx2VPAwa0I3bKysgOFGLrmgG1OeFgwpiuJDroargohcSM2hH/0cqZkFOvlkmK46/6QQTJRBUwCSuTngzFe2HQ0i1G666A==',key_name='tempest-TestStampPattern-610075453',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27dc405e16434633956ed2cd7e1791cd',ramdisk_id='',reservation_id='r-mndxqxw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='57b15ad5-341a-47f8-9e3e-5cec8a85098a',image_min_disk='1',image_min_ram='0',image_owner_id='27dc405e16434633956ed2cd7e1791cd',image_owner_project_name='tempest-TestStampPattern-190654074',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-190654074-project-member',image_user_id='7ae5170969344b9fa5294231f8ffbe72',network_allocated='True',owner_project_name='tempest-TestStampPattern-190654074',owner_user_name='tempest-TestStampPattern-190654074-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T02:05:33Z,user_data=None,user_id='7ae5170969344b9fa5294231f8ffbe72',uuid=2bf92b68-9cc4-4e22-b7b8-30eb6b69c570,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "735565d4-21ba-4824-9dcb-d464456080fc", "address": "fa:16:3e:3a:68:0a", "network": {"id": "d099696f-2c31-4ce1-89d8-680d87d17b9b", "bridge": "br-int", "label": "tempest-TestStampPattern-665967680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27dc405e16434633956ed2cd7e1791cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735565d4-21", "ovs_interfaceid": "735565d4-21ba-4824-9dcb-d464456080fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Converting VIF {"id": "735565d4-21ba-4824-9dcb-d464456080fc", "address": "fa:16:3e:3a:68:0a", "network": {"id": "d099696f-2c31-4ce1-89d8-680d87d17b9b", "bridge": "br-int", "label": "tempest-TestStampPattern-665967680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27dc405e16434633956ed2cd7e1791cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735565d4-21", "ovs_interfaceid": "735565d4-21ba-4824-9dcb-d464456080fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:68:0a,bridge_name='br-int',has_traffic_filtering=True,id=735565d4-21ba-4824-9dcb-d464456080fc,network=Network(d099696f-2c31-4ce1-89d8-680d87d17b9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap735565d4-21') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG os_vif [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:68:0a,bridge_name='br-int',has_traffic_filtering=True,id=735565d4-21ba-4824-9dcb-d464456080fc,network=Network(d099696f-2c31-4ce1-89d8-680d87d17b9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap735565d4-21') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap735565d4-21, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap735565d4-21, col_values=(('external_ids', {'iface-id': '735565d4-21ba-4824-9dcb-d464456080fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:68:0a', 'vm-uuid': '2bf92b68-9cc4-4e22-b7b8-30eb6b69c570'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:05:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:05:35 user nova-compute[71498]: INFO os_vif [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:68:0a,bridge_name='br-int',has_traffic_filtering=True,id=735565d4-21ba-4824-9dcb-d464456080fc,network=Network(d099696f-2c31-4ce1-89d8-680d87d17b9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap735565d4-21')
Apr 14 02:05:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:05:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] No VIF found with MAC fa:16:3e:3a:68:0a, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 02:05:36 user nova-compute[71498]: DEBUG nova.network.neutron [req-a8782a12-885a-4c8e-8b63-1f139024f509 req-4aa83cf5-bde0-4967-9df0-ad3e45f6605a service nova] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Updated VIF entry in instance network info cache for port 735565d4-21ba-4824-9dcb-d464456080fc. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 02:05:36 user nova-compute[71498]: DEBUG nova.network.neutron [req-a8782a12-885a-4c8e-8b63-1f139024f509 req-4aa83cf5-bde0-4967-9df0-ad3e45f6605a service nova] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Updating instance_info_cache with network_info: [{"id": "735565d4-21ba-4824-9dcb-d464456080fc", "address": "fa:16:3e:3a:68:0a", "network": {"id": "d099696f-2c31-4ce1-89d8-680d87d17b9b", "bridge": "br-int", "label": "tempest-TestStampPattern-665967680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27dc405e16434633956ed2cd7e1791cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735565d4-21", "ovs_interfaceid": "735565d4-21ba-4824-9dcb-d464456080fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:05:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a8782a12-885a-4c8e-8b63-1f139024f509 req-4aa83cf5-bde0-4967-9df0-ad3e45f6605a service nova] Releasing lock "refresh_cache-2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:05:36 user nova-compute[71498]: DEBUG nova.compute.manager [req-11a0943d-e94f-45f8-997d-f04cfd83b0e9 req-4526c8a7-0fdc-440f-8896-76278fd11846 service nova] [instance: a231fc48-a73e-4967-90c1-a31793235267] Received event network-vif-deleted-abd5445b-2a67-4861-9840-b88f47390eb7 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:05:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:05:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:05:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:05:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:05:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:05:38 user nova-compute[71498]: DEBUG nova.compute.manager [req-4ccd15c6-be60-4a03-b739-4b71efe460d3 req-b93668a1-8c42-45e1-aa13-5aa7e954d7d7 service nova] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Received event network-vif-plugged-735565d4-21ba-4824-9dcb-d464456080fc {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:05:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4ccd15c6-be60-4a03-b739-4b71efe460d3 req-b93668a1-8c42-45e1-aa13-5aa7e954d7d7 service nova] Acquiring lock "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:05:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4ccd15c6-be60-4a03-b739-4b71efe460d3 req-b93668a1-8c42-45e1-aa13-5aa7e954d7d7 service nova] Lock "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:05:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4ccd15c6-be60-4a03-b739-4b71efe460d3 req-b93668a1-8c42-45e1-aa13-5aa7e954d7d7 service nova] Lock "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:05:38 user nova-compute[71498]: DEBUG nova.compute.manager [req-4ccd15c6-be60-4a03-b739-4b71efe460d3 req-b93668a1-8c42-45e1-aa13-5aa7e954d7d7 service nova] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] No waiting events found dispatching network-vif-plugged-735565d4-21ba-4824-9dcb-d464456080fc {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:05:38 user nova-compute[71498]: WARNING nova.compute.manager [req-4ccd15c6-be60-4a03-b739-4b71efe460d3 req-b93668a1-8c42-45e1-aa13-5aa7e954d7d7 service nova] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Received unexpected event network-vif-plugged-735565d4-21ba-4824-9dcb-d464456080fc for instance with vm_state building and task_state spawning.
Apr 14 02:05:38 user nova-compute[71498]: DEBUG nova.compute.manager [req-4ccd15c6-be60-4a03-b739-4b71efe460d3 req-b93668a1-8c42-45e1-aa13-5aa7e954d7d7 service nova] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Received event network-vif-plugged-735565d4-21ba-4824-9dcb-d464456080fc {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:05:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4ccd15c6-be60-4a03-b739-4b71efe460d3 req-b93668a1-8c42-45e1-aa13-5aa7e954d7d7 service nova] Acquiring lock "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:05:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4ccd15c6-be60-4a03-b739-4b71efe460d3 req-b93668a1-8c42-45e1-aa13-5aa7e954d7d7 service nova] Lock "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:05:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-4ccd15c6-be60-4a03-b739-4b71efe460d3 req-b93668a1-8c42-45e1-aa13-5aa7e954d7d7 service nova] Lock "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:05:38 user nova-compute[71498]: DEBUG nova.compute.manager [req-4ccd15c6-be60-4a03-b739-4b71efe460d3 req-b93668a1-8c42-45e1-aa13-5aa7e954d7d7 service nova] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] No waiting events found dispatching network-vif-plugged-735565d4-21ba-4824-9dcb-d464456080fc {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:05:38 user nova-compute[71498]: WARNING nova.compute.manager [req-4ccd15c6-be60-4a03-b739-4b71efe460d3 req-b93668a1-8c42-45e1-aa13-5aa7e954d7d7 service nova] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Received unexpected event network-vif-plugged-735565d4-21ba-4824-9dcb-d464456080fc for instance with vm_state building and task_state spawning.
Apr 14 02:05:39 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437939.8062818, 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:05:39 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] VM Resumed (Lifecycle Event)
Apr 14 02:05:39 user nova-compute[71498]: DEBUG nova.compute.manager [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 02:05:39 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 02:05:39 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Instance spawned successfully.
Apr 14 02:05:39 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 02:05:39 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:05:39 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:05:39 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:05:39 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 02:05:39 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 02:05:39 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437939.8100247, 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:05:39 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] VM Started (Lifecycle Event)
Apr 14 02:05:39 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:05:39 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 02:05:39 user nova-compute[71498]: INFO nova.compute.manager [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Took 7.10 seconds to spawn the instance on the hypervisor.
Apr 14 02:05:39 user nova-compute[71498]: DEBUG nova.compute.manager [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:05:39 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 02:05:39 user nova-compute[71498]: INFO nova.compute.manager [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Took 8.00 seconds to build instance.
Apr 14 02:05:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-752586fc-9f59-47cb-9e91-1cf32779b314 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.130s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:05:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:05:45 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:05:45 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:05:45 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:05:45 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:05:45 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:05:45 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:05:46 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:05:46 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 02:05:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-57b15ad5-341a-47f8-9e3e-5cec8a85098a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:05:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-57b15ad5-341a-47f8-9e3e-5cec8a85098a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:05:46 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 02:05:46 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Updating instance_info_cache with network_info: [{"id": "18eed24e-8acb-457c-95b8-64c141faa4aa", "address": "fa:16:3e:8a:75:08", "network": {"id": "d099696f-2c31-4ce1-89d8-680d87d17b9b", "bridge": "br-int", "label": "tempest-TestStampPattern-665967680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27dc405e16434633956ed2cd7e1791cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18eed24e-8a", "ovs_interfaceid": "18eed24e-8acb-457c-95b8-64c141faa4aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:05:46 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-57b15ad5-341a-47f8-9e3e-5cec8a85098a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:05:46 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 02:05:47 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:05:47 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:05:48 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681437933.2075174, a231fc48-a73e-4967-90c1-a31793235267 => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:05:48 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: a231fc48-a73e-4967-90c1-a31793235267] VM Stopped (Lifecycle Event)
Apr 14 02:05:48 user nova-compute[71498]: DEBUG nova.compute.manager [None req-25aedfe0-cdbb-4a36-9e9a-8630d6ba62c7 None None] [instance: a231fc48-a73e-4967-90c1-a31793235267] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:05:49 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:05:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:05:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:05:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:05:49 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 02:05:49 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 02:05:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:50 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:05:50 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:05:50 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=8510MB free_disk=26.17706298828125GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 02:05:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:05:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:05:50 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 5ba29111-1e9b-4947-b046-6bbe888eca06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:05:50 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 57b15ad5-341a-47f8-9e3e-5cec8a85098a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:05:50 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:05:50 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:05:50 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 02:05:50 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=1088MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 02:05:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:05:51 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:05:51 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:05:51 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 02:05:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.286s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:05:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Acquiring lock "bd1bf0f2-5c22-4c42-9e19-b22343997d21" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:05:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "bd1bf0f2-5c22-4c42-9e19-b22343997d21" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:05:51 user nova-compute[71498]: DEBUG nova.compute.manager [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 02:05:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:05:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:05:51 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 02:05:51 user nova-compute[71498]: INFO nova.compute.claims [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Claim successful on node user
Apr 14 02:05:51 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:05:51 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:05:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.275s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:05:51 user nova-compute[71498]: DEBUG nova.compute.manager [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 02:05:51 user nova-compute[71498]: DEBUG nova.compute.manager [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 02:05:51 user nova-compute[71498]: DEBUG nova.network.neutron [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 02:05:51 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 02:05:51 user nova-compute[71498]: DEBUG nova.compute.manager [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 02:05:51 user nova-compute[71498]: DEBUG nova.policy [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '97dc26d9782b4960af1ae5056a85616e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d826f5f9504efe95f0736f538951b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 02:05:51 user nova-compute[71498]: DEBUG nova.compute.manager [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 02:05:51 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 02:05:51 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Creating image(s)
Apr 14 02:05:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd1bf0f2-5c22-4c42-9e19-b22343997d21/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:05:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "/opt/stack/data/nova/instances/bd1bf0f2-5c22-4c42-9e19-b22343997d21/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:05:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "/opt/stack/data/nova/instances/bd1bf0f2-5c22-4c42-9e19-b22343997d21/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.049s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:05:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.157s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:05:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:05:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.166s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/bd1bf0f2-5c22-4c42-9e19-b22343997d21/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/bd1bf0f2-5c22-4c42-9e19-b22343997d21/disk 1073741824" returned: 0 in 0.054s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:05:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.140s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:52 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bd1bf0f2-5c22-4c42-9e19-b22343997d21/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 02:05:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1bf0f2-5c22-4c42-9e19-b22343997d21/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:05:52 user nova-compute[71498]: DEBUG nova.network.neutron [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Successfully created port: adff1b77-9793-4fa2-8861-3bd2297c7841 {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 02:05:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1bf0f2-5c22-4c42-9e19-b22343997d21/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:05:52 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Cannot resize image /opt/stack/data/nova/instances/bd1bf0f2-5c22-4c42-9e19-b22343997d21/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 02:05:52 user nova-compute[71498]: DEBUG nova.objects.instance [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lazy-loading 'migration_context' on Instance uuid bd1bf0f2-5c22-4c42-9e19-b22343997d21 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:05:52 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 02:05:52 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Ensure instance console log exists: /opt/stack/data/nova/instances/bd1bf0f2-5c22-4c42-9e19-b22343997d21/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 02:05:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:05:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:05:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG nova.network.neutron [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Successfully updated port: adff1b77-9793-4fa2-8861-3bd2297c7841 {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Acquiring lock "refresh_cache-bd1bf0f2-5c22-4c42-9e19-b22343997d21" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Acquired lock "refresh_cache-bd1bf0f2-5c22-4c42-9e19-b22343997d21" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG nova.network.neutron [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG nova.compute.manager [req-2a43664c-af3a-4cbb-a211-f7b8bbdae92a req-f1902ac7-2847-46b9-b9ae-5e8db32bcd59 service nova] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Received event network-changed-adff1b77-9793-4fa2-8861-3bd2297c7841 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG nova.compute.manager [req-2a43664c-af3a-4cbb-a211-f7b8bbdae92a req-f1902ac7-2847-46b9-b9ae-5e8db32bcd59 service nova] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Refreshing instance network info cache due to event network-changed-adff1b77-9793-4fa2-8861-3bd2297c7841. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-2a43664c-af3a-4cbb-a211-f7b8bbdae92a req-f1902ac7-2847-46b9-b9ae-5e8db32bcd59 service nova] Acquiring lock "refresh_cache-bd1bf0f2-5c22-4c42-9e19-b22343997d21" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG nova.network.neutron [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG nova.network.neutron [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Updating instance_info_cache with network_info: [{"id": "adff1b77-9793-4fa2-8861-3bd2297c7841", "address": "fa:16:3e:61:0b:ed", "network": {"id": "2995521b-e746-4035-ab0e-41d7ffde35cc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-495953618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e7d826f5f9504efe95f0736f538951b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadff1b77-97", "ovs_interfaceid": "adff1b77-9793-4fa2-8861-3bd2297c7841", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Releasing lock "refresh_cache-bd1bf0f2-5c22-4c42-9e19-b22343997d21" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG nova.compute.manager [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Instance network_info: |[{"id": "adff1b77-9793-4fa2-8861-3bd2297c7841", "address": "fa:16:3e:61:0b:ed", "network": {"id": "2995521b-e746-4035-ab0e-41d7ffde35cc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-495953618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e7d826f5f9504efe95f0736f538951b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadff1b77-97", "ovs_interfaceid": "adff1b77-9793-4fa2-8861-3bd2297c7841", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-2a43664c-af3a-4cbb-a211-f7b8bbdae92a req-f1902ac7-2847-46b9-b9ae-5e8db32bcd59 service nova] Acquired lock "refresh_cache-bd1bf0f2-5c22-4c42-9e19-b22343997d21" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG nova.network.neutron [req-2a43664c-af3a-4cbb-a211-f7b8bbdae92a req-f1902ac7-2847-46b9-b9ae-5e8db32bcd59 service nova] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Refreshing network info cache for port adff1b77-9793-4fa2-8861-3bd2297c7841 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Start _get_guest_xml network_info=[{"id": "adff1b77-9793-4fa2-8861-3bd2297c7841", "address": "fa:16:3e:61:0b:ed", "network": {"id": "2995521b-e746-4035-ab0e-41d7ffde35cc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-495953618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e7d826f5f9504efe95f0736f538951b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadff1b77-97", "ovs_interfaceid": "adff1b77-9793-4fa2-8861-3bd2297c7841", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 02:05:53 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:05:53 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:05:53 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:05:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-526115198',display_name='tempest-VolumesActionsTest-instance-526115198',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-526115198',id=40,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7d826f5f9504efe95f0736f538951b4',ramdisk_id='',reservation_id='r-px2fr645',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1128976857',owner_user_name='tempest-VolumesActionsTest-1128976857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T02:05:52Z,user_data=None,user_id='97dc26d9782b4960af1ae5056a85616e',uuid=bd1bf0f2-5c22-4c42-9e19-b22343997d21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adff1b77-9793-4fa2-8861-3bd2297c7841", "address": "fa:16:3e:61:0b:ed", "network": {"id": "2995521b-e746-4035-ab0e-41d7ffde35cc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-495953618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e7d826f5f9504efe95f0736f538951b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadff1b77-97", "ovs_interfaceid": "adff1b77-9793-4fa2-8861-3bd2297c7841", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Converting VIF {"id": "adff1b77-9793-4fa2-8861-3bd2297c7841", "address": "fa:16:3e:61:0b:ed", "network": {"id": "2995521b-e746-4035-ab0e-41d7ffde35cc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-495953618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e7d826f5f9504efe95f0736f538951b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadff1b77-97", "ovs_interfaceid": "adff1b77-9793-4fa2-8861-3bd2297c7841", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:0b:ed,bridge_name='br-int',has_traffic_filtering=True,id=adff1b77-9793-4fa2-8861-3bd2297c7841,network=Network(2995521b-e746-4035-ab0e-41d7ffde35cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadff1b77-97') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG nova.objects.instance [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lazy-loading 'pci_devices' on Instance uuid bd1bf0f2-5c22-4c42-9e19-b22343997d21 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] End _get_guest_xml xml=<domain type="kvm">
Apr 14 02:05:53 user nova-compute[71498]:   <uuid>bd1bf0f2-5c22-4c42-9e19-b22343997d21</uuid>
Apr 14 02:05:53 user nova-compute[71498]:   <name>instance-00000028</name>
Apr 14 02:05:53 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 02:05:53 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 02:05:53 user nova-compute[71498]:   <metadata>
Apr 14 02:05:53 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 02:05:53 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 02:05:53 user nova-compute[71498]:       <nova:name>tempest-VolumesActionsTest-instance-526115198</nova:name>
Apr 14 02:05:53 user nova-compute[71498]:       <nova:creationTime>2023-04-14 02:05:53</nova:creationTime>
Apr 14 02:05:53 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 02:05:53 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 02:05:53 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 02:05:53 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 02:05:53 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 02:05:53 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 02:05:53 user nova-compute[71498]:       </nova:flavor>
Apr 14 02:05:53 user nova-compute[71498]:       <nova:owner>
Apr 14 02:05:53 user nova-compute[71498]:         <nova:user uuid="97dc26d9782b4960af1ae5056a85616e">tempest-VolumesActionsTest-1128976857-project-member</nova:user>
Apr 14 02:05:53 user nova-compute[71498]:         <nova:project uuid="e7d826f5f9504efe95f0736f538951b4">tempest-VolumesActionsTest-1128976857</nova:project>
Apr 14 02:05:53 user nova-compute[71498]:       </nova:owner>
Apr 14 02:05:53 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 02:05:53 user nova-compute[71498]:       <nova:ports>
Apr 14 02:05:53 user nova-compute[71498]:         <nova:port uuid="adff1b77-9793-4fa2-8861-3bd2297c7841">
Apr 14 02:05:53 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.2" ipVersion="4"/>
Apr 14 02:05:53 user nova-compute[71498]:         </nova:port>
Apr 14 02:05:53 user nova-compute[71498]:       </nova:ports>
Apr 14 02:05:53 user nova-compute[71498]:     </nova:instance>
Apr 14 02:05:53 user nova-compute[71498]:   </metadata>
Apr 14 02:05:53 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 02:05:53 user nova-compute[71498]:     <system>
Apr 14 02:05:53 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 02:05:53 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 02:05:53 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 02:05:53 user nova-compute[71498]:       <entry name="serial">bd1bf0f2-5c22-4c42-9e19-b22343997d21</entry>
Apr 14 02:05:53 user nova-compute[71498]:       <entry name="uuid">bd1bf0f2-5c22-4c42-9e19-b22343997d21</entry>
Apr 14 02:05:53 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 02:05:53 user nova-compute[71498]:     </system>
Apr 14 02:05:53 user nova-compute[71498]:   </sysinfo>
Apr 14 02:05:53 user nova-compute[71498]:   <os>
Apr 14 02:05:53 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 02:05:53 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 02:05:53 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 02:05:53 user nova-compute[71498]:   </os>
Apr 14 02:05:53 user nova-compute[71498]:   <features>
Apr 14 02:05:53 user nova-compute[71498]:     <acpi/>
Apr 14 02:05:53 user nova-compute[71498]:     <apic/>
Apr 14 02:05:53 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 02:05:53 user nova-compute[71498]:   </features>
Apr 14 02:05:53 user nova-compute[71498]:   <clock offset="utc">
Apr 14 02:05:53 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 02:05:53 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 02:05:53 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 02:05:53 user nova-compute[71498]:   </clock>
Apr 14 02:05:53 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 02:05:53 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 02:05:53 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 02:05:53 user nova-compute[71498]:   </cpu>
Apr 14 02:05:53 user nova-compute[71498]:   <devices>
Apr 14 02:05:53 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 02:05:53 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 02:05:53 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/bd1bf0f2-5c22-4c42-9e19-b22343997d21/disk"/>
Apr 14 02:05:53 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 02:05:53 user nova-compute[71498]:     </disk>
Apr 14 02:05:53 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 02:05:53 user nova-compute[71498]:       <mac address="fa:16:3e:61:0b:ed"/>
Apr 14 02:05:53 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 02:05:53 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 02:05:53 user nova-compute[71498]:       <target dev="tapadff1b77-97"/>
Apr 14 02:05:53 user nova-compute[71498]:     </interface>
Apr 14 02:05:53 user nova-compute[71498]:     <serial type="pty">
Apr 14 02:05:53 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/bd1bf0f2-5c22-4c42-9e19-b22343997d21/console.log" append="off"/>
Apr 14 02:05:53 user nova-compute[71498]:     </serial>
Apr 14 02:05:53 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 02:05:53 user nova-compute[71498]:     <video>
Apr 14 02:05:53 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 02:05:53 user nova-compute[71498]:     </video>
Apr 14 02:05:53 user nova-compute[71498]:     <rng model="virtio">
Apr 14 02:05:53 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 02:05:53 user nova-compute[71498]:     </rng>
Apr 14 02:05:53 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 02:05:53 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 02:05:53 user nova-compute[71498]:       <stats period="10"/>
Apr 14 02:05:53 user nova-compute[71498]:     </memballoon>
Apr 14 02:05:53 user nova-compute[71498]:   </devices>
Apr 14 02:05:53 user nova-compute[71498]: </domain>
Apr 14 02:05:53 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:05:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-526115198',display_name='tempest-VolumesActionsTest-instance-526115198',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-526115198',id=40,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7d826f5f9504efe95f0736f538951b4',ramdisk_id='',reservation_id='r-px2fr645',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1128976857',owner_user_name='tempest-VolumesActionsTest-1128976857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T02:05:52Z,user_data=None,user_id='97dc26d9782b4960af1ae5056a85616e',uuid=bd1bf0f2-5c22-4c42-9e19-b22343997d21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adff1b77-9793-4fa2-8861-3bd2297c7841", "address": "fa:16:3e:61:0b:ed", "network": {"id": "2995521b-e746-4035-ab0e-41d7ffde35cc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-495953618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e7d826f5f9504efe95f0736f538951b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadff1b77-97", "ovs_interfaceid": "adff1b77-9793-4fa2-8861-3bd2297c7841", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Converting VIF {"id": "adff1b77-9793-4fa2-8861-3bd2297c7841", "address": "fa:16:3e:61:0b:ed", "network": {"id": "2995521b-e746-4035-ab0e-41d7ffde35cc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-495953618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e7d826f5f9504efe95f0736f538951b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadff1b77-97", "ovs_interfaceid": "adff1b77-9793-4fa2-8861-3bd2297c7841", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:0b:ed,bridge_name='br-int',has_traffic_filtering=True,id=adff1b77-9793-4fa2-8861-3bd2297c7841,network=Network(2995521b-e746-4035-ab0e-41d7ffde35cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadff1b77-97') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG os_vif [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:0b:ed,bridge_name='br-int',has_traffic_filtering=True,id=adff1b77-9793-4fa2-8861-3bd2297c7841,network=Network(2995521b-e746-4035-ab0e-41d7ffde35cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadff1b77-97') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapadff1b77-97, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapadff1b77-97, col_values=(('external_ids', {'iface-id': 'adff1b77-9793-4fa2-8861-3bd2297c7841', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:0b:ed', 'vm-uuid': 'bd1bf0f2-5c22-4c42-9e19-b22343997d21'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:05:53 user nova-compute[71498]: INFO os_vif [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:0b:ed,bridge_name='br-int',has_traffic_filtering=True,id=adff1b77-9793-4fa2-8861-3bd2297c7841,network=Network(2995521b-e746-4035-ab0e-41d7ffde35cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadff1b77-97')
Apr 14 02:05:53 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:05:53 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] No VIF found with MAC fa:16:3e:61:0b:ed, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 02:05:54 user nova-compute[71498]: DEBUG nova.network.neutron [req-2a43664c-af3a-4cbb-a211-f7b8bbdae92a req-f1902ac7-2847-46b9-b9ae-5e8db32bcd59 service nova] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Updated VIF entry in instance network info cache for port adff1b77-9793-4fa2-8861-3bd2297c7841. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 02:05:54 user nova-compute[71498]: DEBUG nova.network.neutron [req-2a43664c-af3a-4cbb-a211-f7b8bbdae92a req-f1902ac7-2847-46b9-b9ae-5e8db32bcd59 service nova] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Updating instance_info_cache with network_info: [{"id": "adff1b77-9793-4fa2-8861-3bd2297c7841", "address": "fa:16:3e:61:0b:ed", "network": {"id": "2995521b-e746-4035-ab0e-41d7ffde35cc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-495953618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e7d826f5f9504efe95f0736f538951b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadff1b77-97", "ovs_interfaceid": "adff1b77-9793-4fa2-8861-3bd2297c7841", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:05:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-2a43664c-af3a-4cbb-a211-f7b8bbdae92a req-f1902ac7-2847-46b9-b9ae-5e8db32bcd59 service nova] Releasing lock "refresh_cache-bd1bf0f2-5c22-4c42-9e19-b22343997d21" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:05:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:05:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:05:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:05:55 user nova-compute[71498]: DEBUG nova.compute.manager [req-465b2c1b-1440-4f2a-b52c-374af965c2ef req-d957159a-62ca-43a8-838b-097f65399311 service nova] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Received event network-vif-plugged-adff1b77-9793-4fa2-8861-3bd2297c7841 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:05:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-465b2c1b-1440-4f2a-b52c-374af965c2ef req-d957159a-62ca-43a8-838b-097f65399311 service nova] Acquiring lock "bd1bf0f2-5c22-4c42-9e19-b22343997d21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:05:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-465b2c1b-1440-4f2a-b52c-374af965c2ef req-d957159a-62ca-43a8-838b-097f65399311 service nova] Lock "bd1bf0f2-5c22-4c42-9e19-b22343997d21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:05:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-465b2c1b-1440-4f2a-b52c-374af965c2ef req-d957159a-62ca-43a8-838b-097f65399311 service nova] Lock "bd1bf0f2-5c22-4c42-9e19-b22343997d21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:05:55 user nova-compute[71498]: DEBUG nova.compute.manager [req-465b2c1b-1440-4f2a-b52c-374af965c2ef req-d957159a-62ca-43a8-838b-097f65399311 service nova] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] No waiting events found dispatching network-vif-plugged-adff1b77-9793-4fa2-8861-3bd2297c7841 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:05:55 user nova-compute[71498]: WARNING nova.compute.manager [req-465b2c1b-1440-4f2a-b52c-374af965c2ef req-d957159a-62ca-43a8-838b-097f65399311 service nova] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Received unexpected event network-vif-plugged-adff1b77-9793-4fa2-8861-3bd2297c7841 for instance with vm_state building and task_state spawning.
Apr 14 02:05:57 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:05:57 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:05:57 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437957.1200426, bd1bf0f2-5c22-4c42-9e19-b22343997d21 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:05:57 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] VM Resumed (Lifecycle Event)
Apr 14 02:05:57 user nova-compute[71498]: DEBUG nova.compute.manager [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 02:05:57 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 02:05:57 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Instance spawned successfully.
Apr 14 02:05:57 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 02:05:57 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:05:57 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 02:05:57 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:05:57 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:05:57 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:05:57 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:05:57 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:05:57 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:05:57 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 02:05:57 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681437957.1217062, bd1bf0f2-5c22-4c42-9e19-b22343997d21 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:05:57 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] VM Started (Lifecycle Event)
Apr 14 02:05:57 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:05:57 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 02:05:57 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 02:05:57 user nova-compute[71498]: INFO nova.compute.manager [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Took 5.42 seconds to spawn the instance on the hypervisor.
Apr 14 02:05:57 user nova-compute[71498]: DEBUG nova.compute.manager [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:05:57 user nova-compute[71498]: INFO nova.compute.manager [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Took 6.00 seconds to build instance.
Apr 14 02:05:57 user nova-compute[71498]: DEBUG nova.compute.manager [req-a5365ab5-573c-44f8-8f7b-c56d13a84821 req-ef297206-2087-4285-8adf-4370d5d1c42e service nova] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Received event network-vif-plugged-adff1b77-9793-4fa2-8861-3bd2297c7841 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:05:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a5365ab5-573c-44f8-8f7b-c56d13a84821 req-ef297206-2087-4285-8adf-4370d5d1c42e service nova] Acquiring lock "bd1bf0f2-5c22-4c42-9e19-b22343997d21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:05:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a5365ab5-573c-44f8-8f7b-c56d13a84821 req-ef297206-2087-4285-8adf-4370d5d1c42e service nova] Lock "bd1bf0f2-5c22-4c42-9e19-b22343997d21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:05:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a5365ab5-573c-44f8-8f7b-c56d13a84821 req-ef297206-2087-4285-8adf-4370d5d1c42e service nova] Lock "bd1bf0f2-5c22-4c42-9e19-b22343997d21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:05:57 user nova-compute[71498]: DEBUG nova.compute.manager [req-a5365ab5-573c-44f8-8f7b-c56d13a84821 req-ef297206-2087-4285-8adf-4370d5d1c42e service nova] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] No waiting events found dispatching network-vif-plugged-adff1b77-9793-4fa2-8861-3bd2297c7841 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:05:57 user nova-compute[71498]: WARNING nova.compute.manager [req-a5365ab5-573c-44f8-8f7b-c56d13a84821 req-ef297206-2087-4285-8adf-4370d5d1c42e service nova] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Received unexpected event network-vif-plugged-adff1b77-9793-4fa2-8861-3bd2297c7841 for instance with vm_state active and task_state None.
Apr 14 02:05:57 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:05:57 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:05:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c30eb8fb-cdb2-41df-bba1-d3490dfdd0a0 tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "bd1bf0f2-5c22-4c42-9e19-b22343997d21" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.231s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:05:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:05:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:06:00 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:06:00 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 02:06:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:06:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:06:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:06:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:06:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:06:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:06:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:06:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:06:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:06:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:06:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:06:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "c63b62a9-626c-45ca-a454-4840f51bb28c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:06:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "c63b62a9-626c-45ca-a454-4840f51bb28c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:06:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 02:06:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:06:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:06:35 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 02:06:35 user nova-compute[71498]: INFO nova.compute.claims [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Claim successful on node user
Apr 14 02:06:35 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:06:35 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:06:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:06:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 02:06:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 02:06:35 user nova-compute[71498]: DEBUG nova.network.neutron [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 02:06:35 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 02:06:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 02:06:35 user nova-compute[71498]: DEBUG nova.compute.manager [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 02:06:35 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 02:06:35 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Creating image(s)
Apr 14 02:06:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "/opt/stack/data/nova/instances/c63b62a9-626c-45ca-a454-4840f51bb28c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:06:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "/opt/stack/data/nova/instances/c63b62a9-626c-45ca-a454-4840f51bb28c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:06:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "/opt/stack/data/nova/instances/c63b62a9-626c-45ca-a454-4840f51bb28c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:06:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:06:35 user nova-compute[71498]: DEBUG nova.policy [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fbb0e166c1f448cbba774b835f9798c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fba8f38142a41928f0d2e8ead3aab96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 02:06:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.134s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:06:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:06:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:06:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:06:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.127s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:06:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/c63b62a9-626c-45ca-a454-4840f51bb28c/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:06:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/c63b62a9-626c-45ca-a454-4840f51bb28c/disk 1073741824" returned: 0 in 0.093s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:06:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:06:35 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:06:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.153s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:06:36 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c63b62a9-626c-45ca-a454-4840f51bb28c/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 02:06:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63b62a9-626c-45ca-a454-4840f51bb28c/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:06:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63b62a9-626c-45ca-a454-4840f51bb28c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:06:36 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Cannot resize image /opt/stack/data/nova/instances/c63b62a9-626c-45ca-a454-4840f51bb28c/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 02:06:36 user nova-compute[71498]: DEBUG nova.objects.instance [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lazy-loading 'migration_context' on Instance uuid c63b62a9-626c-45ca-a454-4840f51bb28c {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:06:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 02:06:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Ensure instance console log exists: /opt/stack/data/nova/instances/c63b62a9-626c-45ca-a454-4840f51bb28c/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 02:06:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:06:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:06:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:06:36 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:06:36 user nova-compute[71498]: DEBUG nova.network.neutron [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Successfully created port: 92e48f25-5c12-4ff1-840d-54bee4da0ef2 {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG nova.network.neutron [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Successfully updated port: 92e48f25-5c12-4ff1-840d-54bee4da0ef2 {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "refresh_cache-c63b62a9-626c-45ca-a454-4840f51bb28c" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquired lock "refresh_cache-c63b62a9-626c-45ca-a454-4840f51bb28c" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG nova.network.neutron [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG nova.network.neutron [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG nova.compute.manager [req-3cc51e78-d51f-47fc-8724-3bd209de41cd req-1c7525c7-673e-4dd7-b4b3-2b15984cd0d4 service nova] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Received event network-changed-92e48f25-5c12-4ff1-840d-54bee4da0ef2 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG nova.compute.manager [req-3cc51e78-d51f-47fc-8724-3bd209de41cd req-1c7525c7-673e-4dd7-b4b3-2b15984cd0d4 service nova] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Refreshing instance network info cache due to event network-changed-92e48f25-5c12-4ff1-840d-54bee4da0ef2. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3cc51e78-d51f-47fc-8724-3bd209de41cd req-1c7525c7-673e-4dd7-b4b3-2b15984cd0d4 service nova] Acquiring lock "refresh_cache-c63b62a9-626c-45ca-a454-4840f51bb28c" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG nova.network.neutron [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Updating instance_info_cache with network_info: [{"id": "92e48f25-5c12-4ff1-840d-54bee4da0ef2", "address": "fa:16:3e:7a:12:c7", "network": {"id": "1cdc7ce4-e3ce-4e21-834b-712724a6c11d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-70541503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3fba8f38142a41928f0d2e8ead3aab96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e48f25-5c", "ovs_interfaceid": "92e48f25-5c12-4ff1-840d-54bee4da0ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Releasing lock "refresh_cache-c63b62a9-626c-45ca-a454-4840f51bb28c" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG nova.compute.manager [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Instance network_info: |[{"id": "92e48f25-5c12-4ff1-840d-54bee4da0ef2", "address": "fa:16:3e:7a:12:c7", "network": {"id": "1cdc7ce4-e3ce-4e21-834b-712724a6c11d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-70541503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3fba8f38142a41928f0d2e8ead3aab96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e48f25-5c", "ovs_interfaceid": "92e48f25-5c12-4ff1-840d-54bee4da0ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3cc51e78-d51f-47fc-8724-3bd209de41cd req-1c7525c7-673e-4dd7-b4b3-2b15984cd0d4 service nova] Acquired lock "refresh_cache-c63b62a9-626c-45ca-a454-4840f51bb28c" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG nova.network.neutron [req-3cc51e78-d51f-47fc-8724-3bd209de41cd req-1c7525c7-673e-4dd7-b4b3-2b15984cd0d4 service nova] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Refreshing network info cache for port 92e48f25-5c12-4ff1-840d-54bee4da0ef2 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Start _get_guest_xml network_info=[{"id": "92e48f25-5c12-4ff1-840d-54bee4da0ef2", "address": "fa:16:3e:7a:12:c7", "network": {"id": "1cdc7ce4-e3ce-4e21-834b-712724a6c11d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-70541503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3fba8f38142a41928f0d2e8ead3aab96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e48f25-5c", "ovs_interfaceid": "92e48f25-5c12-4ff1-840d-54bee4da0ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 02:06:37 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:06:37 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:06:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-295651143',display_name='tempest-VolumesSnapshotTestJSON-instance-295651143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-295651143',id=41,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fba8f38142a41928f0d2e8ead3aab96',ramdisk_id='',reservation_id='r-gf0r4rx1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2121749885',owner_user_name='tempest-VolumesSnapshotTestJSON-2121749885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T02:06:36Z,user_data=None,user_id='fbb0e166c1f448cbba774b835f9798c9',uuid=c63b62a9-626c-45ca-a454-4840f51bb28c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92e48f25-5c12-4ff1-840d-54bee4da0ef2", "address": "fa:16:3e:7a:12:c7", "network": {"id": "1cdc7ce4-e3ce-4e21-834b-712724a6c11d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-70541503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3fba8f38142a41928f0d2e8ead3aab96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e48f25-5c", "ovs_interfaceid": "92e48f25-5c12-4ff1-840d-54bee4da0ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Converting VIF {"id": "92e48f25-5c12-4ff1-840d-54bee4da0ef2", "address": "fa:16:3e:7a:12:c7", "network": {"id": "1cdc7ce4-e3ce-4e21-834b-712724a6c11d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-70541503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3fba8f38142a41928f0d2e8ead3aab96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e48f25-5c", "ovs_interfaceid": "92e48f25-5c12-4ff1-840d-54bee4da0ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:12:c7,bridge_name='br-int',has_traffic_filtering=True,id=92e48f25-5c12-4ff1-840d-54bee4da0ef2,network=Network(1cdc7ce4-e3ce-4e21-834b-712724a6c11d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e48f25-5c') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG nova.objects.instance [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lazy-loading 'pci_devices' on Instance uuid c63b62a9-626c-45ca-a454-4840f51bb28c {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] End _get_guest_xml xml=<domain type="kvm">
Apr 14 02:06:37 user nova-compute[71498]:   <uuid>c63b62a9-626c-45ca-a454-4840f51bb28c</uuid>
Apr 14 02:06:37 user nova-compute[71498]:   <name>instance-00000029</name>
Apr 14 02:06:37 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 02:06:37 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 02:06:37 user nova-compute[71498]:   <metadata>
Apr 14 02:06:37 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 02:06:37 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 02:06:37 user nova-compute[71498]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-295651143</nova:name>
Apr 14 02:06:37 user nova-compute[71498]:       <nova:creationTime>2023-04-14 02:06:37</nova:creationTime>
Apr 14 02:06:37 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 02:06:37 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 02:06:37 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 02:06:37 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 02:06:37 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 02:06:37 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 02:06:37 user nova-compute[71498]:       </nova:flavor>
Apr 14 02:06:37 user nova-compute[71498]:       <nova:owner>
Apr 14 02:06:37 user nova-compute[71498]:         <nova:user uuid="fbb0e166c1f448cbba774b835f9798c9">tempest-VolumesSnapshotTestJSON-2121749885-project-member</nova:user>
Apr 14 02:06:37 user nova-compute[71498]:         <nova:project uuid="3fba8f38142a41928f0d2e8ead3aab96">tempest-VolumesSnapshotTestJSON-2121749885</nova:project>
Apr 14 02:06:37 user nova-compute[71498]:       </nova:owner>
Apr 14 02:06:37 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 02:06:37 user nova-compute[71498]:       <nova:ports>
Apr 14 02:06:37 user nova-compute[71498]:         <nova:port uuid="92e48f25-5c12-4ff1-840d-54bee4da0ef2">
Apr 14 02:06:37 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.2" ipVersion="4"/>
Apr 14 02:06:37 user nova-compute[71498]:         </nova:port>
Apr 14 02:06:37 user nova-compute[71498]:       </nova:ports>
Apr 14 02:06:37 user nova-compute[71498]:     </nova:instance>
Apr 14 02:06:37 user nova-compute[71498]:   </metadata>
Apr 14 02:06:37 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 02:06:37 user nova-compute[71498]:     <system>
Apr 14 02:06:37 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 02:06:37 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 02:06:37 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 02:06:37 user nova-compute[71498]:       <entry name="serial">c63b62a9-626c-45ca-a454-4840f51bb28c</entry>
Apr 14 02:06:37 user nova-compute[71498]:       <entry name="uuid">c63b62a9-626c-45ca-a454-4840f51bb28c</entry>
Apr 14 02:06:37 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 02:06:37 user nova-compute[71498]:     </system>
Apr 14 02:06:37 user nova-compute[71498]:   </sysinfo>
Apr 14 02:06:37 user nova-compute[71498]:   <os>
Apr 14 02:06:37 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 02:06:37 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 02:06:37 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 02:06:37 user nova-compute[71498]:   </os>
Apr 14 02:06:37 user nova-compute[71498]:   <features>
Apr 14 02:06:37 user nova-compute[71498]:     <acpi/>
Apr 14 02:06:37 user nova-compute[71498]:     <apic/>
Apr 14 02:06:37 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 02:06:37 user nova-compute[71498]:   </features>
Apr 14 02:06:37 user nova-compute[71498]:   <clock offset="utc">
Apr 14 02:06:37 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 02:06:37 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 02:06:37 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 02:06:37 user nova-compute[71498]:   </clock>
Apr 14 02:06:37 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 02:06:37 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 02:06:37 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 02:06:37 user nova-compute[71498]:   </cpu>
Apr 14 02:06:37 user nova-compute[71498]:   <devices>
Apr 14 02:06:37 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 02:06:37 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 02:06:37 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/c63b62a9-626c-45ca-a454-4840f51bb28c/disk"/>
Apr 14 02:06:37 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 02:06:37 user nova-compute[71498]:     </disk>
Apr 14 02:06:37 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 02:06:37 user nova-compute[71498]:       <mac address="fa:16:3e:7a:12:c7"/>
Apr 14 02:06:37 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 02:06:37 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 02:06:37 user nova-compute[71498]:       <target dev="tap92e48f25-5c"/>
Apr 14 02:06:37 user nova-compute[71498]:     </interface>
Apr 14 02:06:37 user nova-compute[71498]:     <serial type="pty">
Apr 14 02:06:37 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/c63b62a9-626c-45ca-a454-4840f51bb28c/console.log" append="off"/>
Apr 14 02:06:37 user nova-compute[71498]:     </serial>
Apr 14 02:06:37 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 02:06:37 user nova-compute[71498]:     <video>
Apr 14 02:06:37 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 02:06:37 user nova-compute[71498]:     </video>
Apr 14 02:06:37 user nova-compute[71498]:     <rng model="virtio">
Apr 14 02:06:37 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 02:06:37 user nova-compute[71498]:     </rng>
Apr 14 02:06:37 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 02:06:37 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 02:06:37 user nova-compute[71498]:       <stats period="10"/>
Apr 14 02:06:37 user nova-compute[71498]:     </memballoon>
Apr 14 02:06:37 user nova-compute[71498]:   </devices>
Apr 14 02:06:37 user nova-compute[71498]: </domain>
Apr 14 02:06:37 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-295651143',display_name='tempest-VolumesSnapshotTestJSON-instance-295651143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-295651143',id=41,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fba8f38142a41928f0d2e8ead3aab96',ramdisk_id='',reservation_id='r-gf0r4rx1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2121749885',owner_user_name='tempest-VolumesSnapshotTestJSON-2121749885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T02:06:36Z,user_data=None,user_id='fbb0e166c1f448cbba774b835f9798c9',uuid=c63b62a9-626c-45ca-a454-4840f51bb28c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92e48f25-5c12-4ff1-840d-54bee4da0ef2", "address": "fa:16:3e:7a:12:c7", "network": {"id": "1cdc7ce4-e3ce-4e21-834b-712724a6c11d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-70541503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3fba8f38142a41928f0d2e8ead3aab96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e48f25-5c", "ovs_interfaceid": "92e48f25-5c12-4ff1-840d-54bee4da0ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Converting VIF {"id": "92e48f25-5c12-4ff1-840d-54bee4da0ef2", "address": "fa:16:3e:7a:12:c7", "network": {"id": "1cdc7ce4-e3ce-4e21-834b-712724a6c11d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-70541503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3fba8f38142a41928f0d2e8ead3aab96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e48f25-5c", "ovs_interfaceid": "92e48f25-5c12-4ff1-840d-54bee4da0ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:12:c7,bridge_name='br-int',has_traffic_filtering=True,id=92e48f25-5c12-4ff1-840d-54bee4da0ef2,network=Network(1cdc7ce4-e3ce-4e21-834b-712724a6c11d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e48f25-5c') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG os_vif [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:12:c7,bridge_name='br-int',has_traffic_filtering=True,id=92e48f25-5c12-4ff1-840d-54bee4da0ef2,network=Network(1cdc7ce4-e3ce-4e21-834b-712724a6c11d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e48f25-5c') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92e48f25-5c, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap92e48f25-5c, col_values=(('external_ids', {'iface-id': '92e48f25-5c12-4ff1-840d-54bee4da0ef2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:12:c7', 'vm-uuid': 'c63b62a9-626c-45ca-a454-4840f51bb28c'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:06:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:06:37 user nova-compute[71498]: INFO os_vif [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:12:c7,bridge_name='br-int',has_traffic_filtering=True,id=92e48f25-5c12-4ff1-840d-54bee4da0ef2,network=Network(1cdc7ce4-e3ce-4e21-834b-712724a6c11d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e48f25-5c')
Apr 14 02:06:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:06:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] No VIF found with MAC fa:16:3e:7a:12:c7, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 02:06:38 user nova-compute[71498]: DEBUG nova.network.neutron [req-3cc51e78-d51f-47fc-8724-3bd209de41cd req-1c7525c7-673e-4dd7-b4b3-2b15984cd0d4 service nova] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Updated VIF entry in instance network info cache for port 92e48f25-5c12-4ff1-840d-54bee4da0ef2. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 02:06:38 user nova-compute[71498]: DEBUG nova.network.neutron [req-3cc51e78-d51f-47fc-8724-3bd209de41cd req-1c7525c7-673e-4dd7-b4b3-2b15984cd0d4 service nova] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Updating instance_info_cache with network_info: [{"id": "92e48f25-5c12-4ff1-840d-54bee4da0ef2", "address": "fa:16:3e:7a:12:c7", "network": {"id": "1cdc7ce4-e3ce-4e21-834b-712724a6c11d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-70541503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3fba8f38142a41928f0d2e8ead3aab96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e48f25-5c", "ovs_interfaceid": "92e48f25-5c12-4ff1-840d-54bee4da0ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:06:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3cc51e78-d51f-47fc-8724-3bd209de41cd req-1c7525c7-673e-4dd7-b4b3-2b15984cd0d4 service nova] Releasing lock "refresh_cache-c63b62a9-626c-45ca-a454-4840f51bb28c" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:06:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:06:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:06:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:06:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:06:39 user nova-compute[71498]: DEBUG nova.compute.manager [req-bcd2b6a8-8389-49cf-953d-0e6bee9bbc26 req-cc257415-3f37-46fd-b972-6c5423a7de3e service nova] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Received event network-vif-plugged-92e48f25-5c12-4ff1-840d-54bee4da0ef2 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:06:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-bcd2b6a8-8389-49cf-953d-0e6bee9bbc26 req-cc257415-3f37-46fd-b972-6c5423a7de3e service nova] Acquiring lock "c63b62a9-626c-45ca-a454-4840f51bb28c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:06:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-bcd2b6a8-8389-49cf-953d-0e6bee9bbc26 req-cc257415-3f37-46fd-b972-6c5423a7de3e service nova] Lock "c63b62a9-626c-45ca-a454-4840f51bb28c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:06:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-bcd2b6a8-8389-49cf-953d-0e6bee9bbc26 req-cc257415-3f37-46fd-b972-6c5423a7de3e service nova] Lock "c63b62a9-626c-45ca-a454-4840f51bb28c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:06:39 user nova-compute[71498]: DEBUG nova.compute.manager [req-bcd2b6a8-8389-49cf-953d-0e6bee9bbc26 req-cc257415-3f37-46fd-b972-6c5423a7de3e service nova] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] No waiting events found dispatching network-vif-plugged-92e48f25-5c12-4ff1-840d-54bee4da0ef2 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:06:39 user nova-compute[71498]: WARNING nova.compute.manager [req-bcd2b6a8-8389-49cf-953d-0e6bee9bbc26 req-cc257415-3f37-46fd-b972-6c5423a7de3e service nova] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Received unexpected event network-vif-plugged-92e48f25-5c12-4ff1-840d-54bee4da0ef2 for instance with vm_state building and task_state spawning.
Apr 14 02:06:41 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681438001.4665687, c63b62a9-626c-45ca-a454-4840f51bb28c => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:06:41 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] VM Resumed (Lifecycle Event)
Apr 14 02:06:41 user nova-compute[71498]: DEBUG nova.compute.manager [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 02:06:41 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 02:06:41 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Instance spawned successfully.
Apr 14 02:06:41 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 02:06:41 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:06:41 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 02:06:41 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:06:41 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:06:41 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:06:41 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:06:41 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:06:41 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:06:41 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 02:06:41 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681438001.470311, c63b62a9-626c-45ca-a454-4840f51bb28c => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:06:41 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] VM Started (Lifecycle Event)
Apr 14 02:06:41 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:06:41 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 02:06:41 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 02:06:41 user nova-compute[71498]: INFO nova.compute.manager [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Took 5.96 seconds to spawn the instance on the hypervisor.
Apr 14 02:06:41 user nova-compute[71498]: DEBUG nova.compute.manager [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:06:41 user nova-compute[71498]: DEBUG nova.compute.manager [req-18fda0e9-5991-4ff6-8f34-a0729692550d req-ca7d8404-e998-4c7b-9356-fd0f2a3d223a service nova] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Received event network-vif-plugged-92e48f25-5c12-4ff1-840d-54bee4da0ef2 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:06:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-18fda0e9-5991-4ff6-8f34-a0729692550d req-ca7d8404-e998-4c7b-9356-fd0f2a3d223a service nova] Acquiring lock "c63b62a9-626c-45ca-a454-4840f51bb28c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:06:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-18fda0e9-5991-4ff6-8f34-a0729692550d req-ca7d8404-e998-4c7b-9356-fd0f2a3d223a service nova] Lock "c63b62a9-626c-45ca-a454-4840f51bb28c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:06:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-18fda0e9-5991-4ff6-8f34-a0729692550d req-ca7d8404-e998-4c7b-9356-fd0f2a3d223a service nova] Lock "c63b62a9-626c-45ca-a454-4840f51bb28c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:06:41 user nova-compute[71498]: DEBUG nova.compute.manager [req-18fda0e9-5991-4ff6-8f34-a0729692550d req-ca7d8404-e998-4c7b-9356-fd0f2a3d223a service nova] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] No waiting events found dispatching network-vif-plugged-92e48f25-5c12-4ff1-840d-54bee4da0ef2 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:06:41 user nova-compute[71498]: WARNING nova.compute.manager [req-18fda0e9-5991-4ff6-8f34-a0729692550d req-ca7d8404-e998-4c7b-9356-fd0f2a3d223a service nova] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Received unexpected event network-vif-plugged-92e48f25-5c12-4ff1-840d-54bee4da0ef2 for instance with vm_state building and task_state spawning.
Apr 14 02:06:41 user nova-compute[71498]: INFO nova.compute.manager [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Took 6.59 seconds to build instance.
Apr 14 02:06:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-796a9af9-a00d-49ab-b7c4-9103276aacf9 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "c63b62a9-626c-45ca-a454-4840f51bb28c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.677s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:06:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:06:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:06:47 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:06:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:06:48 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:06:48 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 02:06:48 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Didn't find any instances for network info cache update. {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 02:06:49 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:06:50 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:06:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:06:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:06:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:06:50 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 02:06:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63b62a9-626c-45ca-a454-4840f51bb28c/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:06:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63b62a9-626c-45ca-a454-4840f51bb28c/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:06:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63b62a9-626c-45ca-a454-4840f51bb28c/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:06:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63b62a9-626c-45ca-a454-4840f51bb28c/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:06:50 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 02:06:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:06:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:06:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:06:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:06:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:06:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:06:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:06:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:06:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:06:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:06:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:06:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:06:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1bf0f2-5c22-4c42-9e19-b22343997d21/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:06:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1bf0f2-5c22-4c42-9e19-b22343997d21/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:06:51 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1bf0f2-5c22-4c42-9e19-b22343997d21/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:06:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd1bf0f2-5c22-4c42-9e19-b22343997d21/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:06:52 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:06:52 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:06:52 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=8338MB free_disk=26.154582977294922GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 02:06:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:06:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:06:52 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 5ba29111-1e9b-4947-b046-6bbe888eca06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:06:52 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 57b15ad5-341a-47f8-9e3e-5cec8a85098a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:06:52 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:06:52 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:06:52 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance bd1bf0f2-5c22-4c42-9e19-b22343997d21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:06:52 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance c63b62a9-626c-45ca-a454-4840f51bb28c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:06:52 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 02:06:52 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=1344MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 02:06:52 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:06:52 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:06:52 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 02:06:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.335s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:06:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:06:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:06:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:06:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:06:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:06:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:06:53 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:06:53 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Cleaning up deleted instances {{(pid=71498) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 02:06:53 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] There are 0 instances to clean {{(pid=71498) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 02:06:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:06:56 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:06:56 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:06:57 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:06:57 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:06:57 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:06:57 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:06:57 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Cleaning up deleted instances with incomplete migration  {{(pid=71498) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 02:06:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:06:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:07:02 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:07:02 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 02:07:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:07:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:07:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:07:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:07:09 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:07:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:07:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:07:16 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:07:17 user nova-compute[71498]: INFO nova.compute.manager [None req-71034c29-3a3c-42c6-9b7e-b947ed3c8712 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Get console output
Apr 14 02:07:17 user nova-compute[71498]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Apr 14 02:07:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:07:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:07:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:07:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:07:23 user nova-compute[71498]: DEBUG nova.compute.manager [req-70157b57-2a83-4cd4-9a4e-89ae6327abb6 req-5d56a284-6ed2-4d73-bc83-a67863db87b0 service nova] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Received event network-changed-735565d4-21ba-4824-9dcb-d464456080fc {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:07:23 user nova-compute[71498]: DEBUG nova.compute.manager [req-70157b57-2a83-4cd4-9a4e-89ae6327abb6 req-5d56a284-6ed2-4d73-bc83-a67863db87b0 service nova] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Refreshing instance network info cache due to event network-changed-735565d4-21ba-4824-9dcb-d464456080fc. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 02:07:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-70157b57-2a83-4cd4-9a4e-89ae6327abb6 req-5d56a284-6ed2-4d73-bc83-a67863db87b0 service nova] Acquiring lock "refresh_cache-2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:07:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-70157b57-2a83-4cd4-9a4e-89ae6327abb6 req-5d56a284-6ed2-4d73-bc83-a67863db87b0 service nova] Acquired lock "refresh_cache-2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:07:23 user nova-compute[71498]: DEBUG nova.network.neutron [req-70157b57-2a83-4cd4-9a4e-89ae6327abb6 req-5d56a284-6ed2-4d73-bc83-a67863db87b0 service nova] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Refreshing network info cache for port 735565d4-21ba-4824-9dcb-d464456080fc {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 02:07:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:07:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:07:23 user nova-compute[71498]: DEBUG nova.objects.instance [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lazy-loading 'flavor' on Instance uuid 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:07:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:07:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:07:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:07:24 user nova-compute[71498]: INFO nova.compute.manager [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Attaching volume 4c538a4c-d102-445d-bfef-2cb750d83cb9 to /dev/vdb
Apr 14 02:07:24 user nova-compute[71498]: DEBUG os_brick.utils [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:07:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:07:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:07:24 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[44108b68-7eaa-4bac-8fdd-1ce826c27fc8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:07:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:07:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:07:24 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fef0397-141c-4378-b9af-880611e4d298]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:07:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:07:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:07:24 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[515d1844-d311-48d6-b6c9-e2546c7e222e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:07:24 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee1c216-fb80-476d-a74d-8f447a331ff9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:07:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:07:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 02:07:24 user nova-compute[71498]: DEBUG nova.network.neutron [req-70157b57-2a83-4cd4-9a4e-89ae6327abb6 req-5d56a284-6ed2-4d73-bc83-a67863db87b0 service nova] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Updated VIF entry in instance network info cache for port 735565d4-21ba-4824-9dcb-d464456080fc. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 02:07:24 user nova-compute[71498]: DEBUG nova.network.neutron [req-70157b57-2a83-4cd4-9a4e-89ae6327abb6 req-5d56a284-6ed2-4d73-bc83-a67863db87b0 service nova] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Updating instance_info_cache with network_info: [{"id": "735565d4-21ba-4824-9dcb-d464456080fc", "address": "fa:16:3e:3a:68:0a", "network": {"id": "d099696f-2c31-4ce1-89d8-680d87d17b9b", "bridge": "br-int", "label": "tempest-TestStampPattern-665967680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27dc405e16434633956ed2cd7e1791cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735565d4-21", "ovs_interfaceid": "735565d4-21ba-4824-9dcb-d464456080fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:07:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 02:07:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:07:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-70157b57-2a83-4cd4-9a4e-89ae6327abb6 req-5d56a284-6ed2-4d73-bc83-a67863db87b0 service nova] Releasing lock "refresh_cache-2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:07:24 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 02:07:24 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 02:07:24 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[72497627-3893-4958-ba61-0cfe09b7de46]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:07:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 02:07:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 02:07:24 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 02:07:24 user nova-compute[71498]: DEBUG os_brick.utils [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:07:24 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Updating existing volume attachment record: a929b529-cdbd-4be1-b921-dd79c1e4abd9 {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 02:07:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'alqbUyWc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:07:28 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:07:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:07:28 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:07:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:07:28 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 02:07:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8543567-0072-4a92-920e-48ebbc98989f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 02:07:28 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[778518e2-2a01-445e-9e60-565050e92259]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9] added
Apr 14 02:07:28 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7208e410-115b-4a62-a513-e47dced1799f]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b4c8f7-6abf-4537-898a-9ea00c97c119]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v alqbUyWc {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v alqbUyWc" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a800d99-6423-4711-9ae2-7c20e52f6f5c]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'alqbUyWc'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[69852f80-e0c2-477a-a966-3578caba4245]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e362c552-8d4c-4e95-86f8-fe9fa86f7468]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:07:28 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:07:28 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c881ead-d00f-4823-9e78-4d1d6b547fb8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9, portal: 172.16.0.220,3260]
Apr 14 02:07:28 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9, portal: 172.16.0.220,3260] successful.
Apr 14 02:07:28 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ed9082-aa62-40f4-b02a-e07b357aa406]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[18eb5064-0843-4bd6-a6f6-dbc22f9238e2]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:07:28 user nova-compute[71498]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 (non-flash)
Apr 14 02:07:28 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:07:28 user nova-compute[71498]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 (non-flash)
Apr 14 02:07:28 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c56ee0b-e386-4196-8d16-985830762736]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 02:07:28 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'alqbUyWc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 02:07:29 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:07:29 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26461353137376534', 'path': '/dev/sdc'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:07:29 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461353137376534', 'path': '/dev/sdc'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 02:07:29 user nova-compute[71498]: DEBUG nova.objects.instance [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lazy-loading 'flavor' on Instance uuid 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:07:29 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 02:07:29 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:07:29 user nova-compute[71498]:   <source dev="/dev/sdc"/>
Apr 14 02:07:29 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 02:07:29 user nova-compute[71498]:   <serial>4c538a4c-d102-445d-bfef-2cb750d83cb9</serial>
Apr 14 02:07:29 user nova-compute[71498]: </disk>
Apr 14 02:07:29 user nova-compute[71498]:  {{(pid=71498) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 02:07:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:07:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:07:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] No VIF found with MAC fa:16:3e:3a:68:0a, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 02:07:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-9c3cf0e8-51dd-4c09-801a-558e44aa5ba2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.398s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:07:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:07:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:07:32 user nova-compute[71498]: INFO nova.compute.manager [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Detaching volume 4c538a4c-d102-445d-bfef-2cb750d83cb9
Apr 14 02:07:32 user nova-compute[71498]: INFO nova.virt.block_device [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Attempting to driver detach volume 4c538a4c-d102-445d-bfef-2cb750d83cb9 from mountpoint /dev/vdb
Apr 14 02:07:32 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Attempting to detach device vdb from instance 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 from the persistent domain config. {{(pid=71498) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 02:07:32 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 02:07:32 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:07:32 user nova-compute[71498]:   <source dev="/dev/sdc"/>
Apr 14 02:07:32 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 02:07:32 user nova-compute[71498]:   <serial>4c538a4c-d102-445d-bfef-2cb750d83cb9</serial>
Apr 14 02:07:32 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 02:07:32 user nova-compute[71498]: </disk>
Apr 14 02:07:32 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 02:07:32 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Successfully detached device vdb from instance 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 from the persistent domain config.
Apr 14 02:07:32 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 from the live domain config. {{(pid=71498) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 02:07:32 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 02:07:32 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:07:32 user nova-compute[71498]:   <source dev="/dev/sdc"/>
Apr 14 02:07:32 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 02:07:32 user nova-compute[71498]:   <serial>4c538a4c-d102-445d-bfef-2cb750d83cb9</serial>
Apr 14 02:07:32 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 02:07:32 user nova-compute[71498]: </disk>
Apr 14 02:07:32 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 02:07:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:07:32 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Received event <DeviceRemovedEvent: 1681438052.940789, 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71498) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 02:07:32 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 {{(pid=71498) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 02:07:32 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Successfully detached device vdb from instance 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 from the live domain config.
Apr 14 02:07:32 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 02:07:32 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'alqbUyWc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:07:32 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:07:32 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:07:32 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:07:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:07:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:07:32 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0387e4d5-7f9c-4824-86ce-21bdbcb1401e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:07:32 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 02:07:32 user nova-compute[71498]: No targets found.
Apr 14 02:07:32 user nova-compute[71498]: iSNS:
Apr 14 02:07:32 user nova-compute[71498]: No targets found.
Apr 14 02:07:32 user nova-compute[71498]: STATIC:
Apr 14 02:07:32 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238
Apr 14 02:07:32 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 02:07:32 user nova-compute[71498]:                 Iface Name: default
Apr 14 02:07:32 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9
Apr 14 02:07:32 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 02:07:32 user nova-compute[71498]:                 Iface Name: default
Apr 14 02:07:32 user nova-compute[71498]: FIRMWARE:
Apr 14 02:07:32 user nova-compute[71498]: No targets found.
Apr 14 02:07:32 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:07:32 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 02:07:32 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 02:07:32 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 02:07:32 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 02:07:32 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52ae6e8-c89a-4897-bb4b-a9aefe053cb0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[54718e1a-9cbb-4ce2-b434-8cf515ab8be5]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:07:33 user nova-compute[71498]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 (non-flash)
Apr 14 02:07:33 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:07:33 user nova-compute[71498]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 (non-flash)
Apr 14 02:07:33 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52014649d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9'): ({'sdc'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Removing single pathed devices sdc {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e4f411-3cb7-4204-aa91-5911ff8a46dd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2854c8f6-8ecc-42a1-b8d7-553606c04b41]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Flushing IO for device /dev/sdc {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[138c4b28-c367-43eb-9209-f0d667b824a4]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca09e57-11b9-4591-95fe-424de2f8695c]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] SCSI volumes sdc have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9263d2-4ae0-44be-8cb0-82a43a4afbeb]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bba347-f96b-4522-8311-bfb06c1f1f24]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9, portal: 172.16.0.220,3260]
Apr 14 02:07:33 user nova-compute[71498]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9, portal: 172.16.0.220,3260] successful.
Apr 14 02:07:33 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c538a4c-d102-445d-bfef-2cb750d83cb9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[367a6ccd-6a02-4d5b-9495-e8df2b80310f]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] <== disconnect_volume: return (337ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 02:07:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:07:34 user nova-compute[71498]: DEBUG nova.objects.instance [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lazy-loading 'flavor' on Instance uuid 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:07:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-340378ae-6cdf-4796-8250-446676e867ce tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.823s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:07:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:07:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:07:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:07:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:07:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Acquiring lock "bd1bf0f2-5c22-4c42-9e19-b22343997d21" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:07:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "bd1bf0f2-5c22-4c42-9e19-b22343997d21" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:07:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Acquiring lock "bd1bf0f2-5c22-4c42-9e19-b22343997d21-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:07:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "bd1bf0f2-5c22-4c42-9e19-b22343997d21-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:07:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "bd1bf0f2-5c22-4c42-9e19-b22343997d21-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:07:48 user nova-compute[71498]: INFO nova.compute.manager [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Terminating instance
Apr 14 02:07:48 user nova-compute[71498]: DEBUG nova.compute.manager [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 02:07:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:07:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:07:48 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:07:48 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 02:07:48 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Rebuilding the list of instances to heal {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 02:07:48 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Skipping network cache update for instance because it is being deleted. {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9809}}
Apr 14 02:07:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-5ba29111-1e9b-4947-b046-6bbe888eca06" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:07:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-5ba29111-1e9b-4947-b046-6bbe888eca06" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:07:48 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 02:07:48 user nova-compute[71498]: DEBUG nova.objects.instance [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lazy-loading 'info_cache' on Instance uuid 5ba29111-1e9b-4947-b046-6bbe888eca06 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:07:48 user nova-compute[71498]: DEBUG nova.compute.manager [req-3964fe27-23c4-42a3-b9af-ad48346b749a req-51e19890-75c5-4b30-9f9b-6fb75840cfe5 service nova] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Received event network-vif-unplugged-adff1b77-9793-4fa2-8861-3bd2297c7841 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:07:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3964fe27-23c4-42a3-b9af-ad48346b749a req-51e19890-75c5-4b30-9f9b-6fb75840cfe5 service nova] Acquiring lock "bd1bf0f2-5c22-4c42-9e19-b22343997d21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:07:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3964fe27-23c4-42a3-b9af-ad48346b749a req-51e19890-75c5-4b30-9f9b-6fb75840cfe5 service nova] Lock "bd1bf0f2-5c22-4c42-9e19-b22343997d21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:07:48 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3964fe27-23c4-42a3-b9af-ad48346b749a req-51e19890-75c5-4b30-9f9b-6fb75840cfe5 service nova] Lock "bd1bf0f2-5c22-4c42-9e19-b22343997d21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:07:48 user nova-compute[71498]: DEBUG nova.compute.manager [req-3964fe27-23c4-42a3-b9af-ad48346b749a req-51e19890-75c5-4b30-9f9b-6fb75840cfe5 service nova] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] No waiting events found dispatching network-vif-unplugged-adff1b77-9793-4fa2-8861-3bd2297c7841 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:07:48 user nova-compute[71498]: DEBUG nova.compute.manager [req-3964fe27-23c4-42a3-b9af-ad48346b749a req-51e19890-75c5-4b30-9f9b-6fb75840cfe5 service nova] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Received event network-vif-unplugged-adff1b77-9793-4fa2-8861-3bd2297c7841 for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 02:07:48 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Instance destroyed successfully.
Apr 14 02:07:48 user nova-compute[71498]: DEBUG nova.objects.instance [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lazy-loading 'resources' on Instance uuid bd1bf0f2-5c22-4c42-9e19-b22343997d21 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:07:48 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:05:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-526115198',display_name='tempest-VolumesActionsTest-instance-526115198',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-526115198',id=40,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T02:05:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7d826f5f9504efe95f0736f538951b4',ramdisk_id='',reservation_id='r-px2fr645',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1128976857',owner_user_name='tempest-VolumesActionsTest-1128976857-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T02:05:57Z,user_data=None,user_id='97dc26d9782b4960af1ae5056a85616e',uuid=bd1bf0f2-5c22-4c42-9e19-b22343997d21,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "adff1b77-9793-4fa2-8861-3bd2297c7841", "address": "fa:16:3e:61:0b:ed", "network": {"id": "2995521b-e746-4035-ab0e-41d7ffde35cc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-495953618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e7d826f5f9504efe95f0736f538951b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadff1b77-97", "ovs_interfaceid": "adff1b77-9793-4fa2-8861-3bd2297c7841", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 02:07:48 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Converting VIF {"id": "adff1b77-9793-4fa2-8861-3bd2297c7841", "address": "fa:16:3e:61:0b:ed", "network": {"id": "2995521b-e746-4035-ab0e-41d7ffde35cc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-495953618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e7d826f5f9504efe95f0736f538951b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadff1b77-97", "ovs_interfaceid": "adff1b77-9793-4fa2-8861-3bd2297c7841", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:07:48 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:0b:ed,bridge_name='br-int',has_traffic_filtering=True,id=adff1b77-9793-4fa2-8861-3bd2297c7841,network=Network(2995521b-e746-4035-ab0e-41d7ffde35cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadff1b77-97') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:07:48 user nova-compute[71498]: DEBUG os_vif [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:0b:ed,bridge_name='br-int',has_traffic_filtering=True,id=adff1b77-9793-4fa2-8861-3bd2297c7841,network=Network(2995521b-e746-4035-ab0e-41d7ffde35cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadff1b77-97') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 02:07:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:07:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapadff1b77-97, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:07:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:07:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:07:48 user nova-compute[71498]: INFO os_vif [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:0b:ed,bridge_name='br-int',has_traffic_filtering=True,id=adff1b77-9793-4fa2-8861-3bd2297c7841,network=Network(2995521b-e746-4035-ab0e-41d7ffde35cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadff1b77-97')
Apr 14 02:07:48 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Deleting instance files /opt/stack/data/nova/instances/bd1bf0f2-5c22-4c42-9e19-b22343997d21_del
Apr 14 02:07:48 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Deletion of /opt/stack/data/nova/instances/bd1bf0f2-5c22-4c42-9e19-b22343997d21_del complete
Apr 14 02:07:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:07:48 user nova-compute[71498]: INFO nova.compute.manager [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Took 0.69 seconds to destroy the instance on the hypervisor.
Apr 14 02:07:48 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 02:07:48 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 02:07:48 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 02:07:49 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Updating instance_info_cache with network_info: [{"id": "5b8a0a31-9ecf-4b31-a458-778005d846f4", "address": "fa:16:3e:90:92:14", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8a0a31-9e", "ovs_interfaceid": "5b8a0a31-9ecf-4b31-a458-778005d846f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:07:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-5ba29111-1e9b-4947-b046-6bbe888eca06" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:07:49 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 02:07:49 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:07:49 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._sync_power_states {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:07:49 user nova-compute[71498]: WARNING nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] While synchronizing instance power states, found 6 instances in the database and 5 instances on the hypervisor.
Apr 14 02:07:49 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Triggering sync for uuid 5ba29111-1e9b-4947-b046-6bbe888eca06 {{(pid=71498) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 02:07:49 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Triggering sync for uuid 24db983d-4ad5-45be-a8e5-8448b3e5e065 {{(pid=71498) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 02:07:49 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Triggering sync for uuid 57b15ad5-341a-47f8-9e3e-5cec8a85098a {{(pid=71498) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 02:07:49 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Triggering sync for uuid 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 {{(pid=71498) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 02:07:49 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Triggering sync for uuid bd1bf0f2-5c22-4c42-9e19-b22343997d21 {{(pid=71498) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 02:07:49 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Triggering sync for uuid c63b62a9-626c-45ca-a454-4840f51bb28c {{(pid=71498) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 02:07:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "5ba29111-1e9b-4947-b046-6bbe888eca06" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:07:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "5ba29111-1e9b-4947-b046-6bbe888eca06" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:07:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "24db983d-4ad5-45be-a8e5-8448b3e5e065" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:07:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "24db983d-4ad5-45be-a8e5-8448b3e5e065" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:07:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "57b15ad5-341a-47f8-9e3e-5cec8a85098a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:07:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "57b15ad5-341a-47f8-9e3e-5cec8a85098a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:07:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:07:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:07:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "bd1bf0f2-5c22-4c42-9e19-b22343997d21" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:07:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "c63b62a9-626c-45ca-a454-4840f51bb28c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:07:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "c63b62a9-626c-45ca-a454-4840f51bb28c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:07:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "57b15ad5-341a-47f8-9e3e-5cec8a85098a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:07:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "24db983d-4ad5-45be-a8e5-8448b3e5e065" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:07:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "5ba29111-1e9b-4947-b046-6bbe888eca06" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:07:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "c63b62a9-626c-45ca-a454-4840f51bb28c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:07:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:07:49 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:07:49 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Took 0.57 seconds to deallocate network for instance.
Apr 14 02:07:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:07:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:07:49 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Refreshing inventories for resource provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 02:07:49 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Updating ProviderTree inventory for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 02:07:49 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Updating inventory in ProviderTree for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 02:07:49 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Refreshing aggregate associations for resource provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4, aggregates: None {{(pid=71498) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 02:07:49 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Refreshing trait associations for resource provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,HW_CPU_X86_SSE2 {{(pid=71498) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 02:07:49 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:07:50 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:07:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.464s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:07:50 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Deleted allocations for instance bd1bf0f2-5c22-4c42-9e19-b22343997d21
Apr 14 02:07:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-586e6d41-045b-4ac9-b7e5-b0470439afdd tempest-VolumesActionsTest-1128976857 tempest-VolumesActionsTest-1128976857-project-member] Lock "bd1bf0f2-5c22-4c42-9e19-b22343997d21" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.905s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:07:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "bd1bf0f2-5c22-4c42-9e19-b22343997d21" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.029s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:07:50 user nova-compute[71498]: INFO nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] During sync_power_state the instance has a pending task (deleting). Skip.
Apr 14 02:07:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "bd1bf0f2-5c22-4c42-9e19-b22343997d21" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:07:50 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:07:50 user nova-compute[71498]: DEBUG nova.compute.manager [req-904a48d7-1176-478b-aed7-232edfc90483 req-905d6dd5-881b-404d-9728-6e584eab33e6 service nova] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Received event network-vif-plugged-adff1b77-9793-4fa2-8861-3bd2297c7841 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:07:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-904a48d7-1176-478b-aed7-232edfc90483 req-905d6dd5-881b-404d-9728-6e584eab33e6 service nova] Acquiring lock "bd1bf0f2-5c22-4c42-9e19-b22343997d21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:07:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-904a48d7-1176-478b-aed7-232edfc90483 req-905d6dd5-881b-404d-9728-6e584eab33e6 service nova] Lock "bd1bf0f2-5c22-4c42-9e19-b22343997d21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:07:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-904a48d7-1176-478b-aed7-232edfc90483 req-905d6dd5-881b-404d-9728-6e584eab33e6 service nova] Lock "bd1bf0f2-5c22-4c42-9e19-b22343997d21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:07:50 user nova-compute[71498]: DEBUG nova.compute.manager [req-904a48d7-1176-478b-aed7-232edfc90483 req-905d6dd5-881b-404d-9728-6e584eab33e6 service nova] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] No waiting events found dispatching network-vif-plugged-adff1b77-9793-4fa2-8861-3bd2297c7841 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:07:50 user nova-compute[71498]: WARNING nova.compute.manager [req-904a48d7-1176-478b-aed7-232edfc90483 req-905d6dd5-881b-404d-9728-6e584eab33e6 service nova] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Received unexpected event network-vif-plugged-adff1b77-9793-4fa2-8861-3bd2297c7841 for instance with vm_state deleted and task_state None.
Apr 14 02:07:50 user nova-compute[71498]: DEBUG nova.compute.manager [req-904a48d7-1176-478b-aed7-232edfc90483 req-905d6dd5-881b-404d-9728-6e584eab33e6 service nova] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Received event network-vif-deleted-adff1b77-9793-4fa2-8861-3bd2297c7841 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:07:52 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:07:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:07:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:07:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:07:52 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 02:07:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63b62a9-626c-45ca-a454-4840f51bb28c/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:07:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63b62a9-626c-45ca-a454-4840f51bb28c/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:07:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63b62a9-626c-45ca-a454-4840f51bb28c/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:07:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c63b62a9-626c-45ca-a454-4840f51bb28c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:07:52 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 02:07:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:07:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:07:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:07:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:07:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:07:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:07:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:07:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:07:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:07:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:07:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:07:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:07:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:07:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:07:54 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:07:54 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:07:54 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=8387MB free_disk=26.153297424316406GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 02:07:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:07:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:07:54 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 5ba29111-1e9b-4947-b046-6bbe888eca06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:07:54 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 57b15ad5-341a-47f8-9e3e-5cec8a85098a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:07:54 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 24db983d-4ad5-45be-a8e5-8448b3e5e065 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:07:54 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:07:54 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance c63b62a9-626c-45ca-a454-4840f51bb28c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:07:54 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 02:07:54 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=1216MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 02:07:54 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:07:54 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:07:54 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 02:07:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.335s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:07:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:07:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:07:59 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:07:59 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:07:59 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:07:59 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:08:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:08:03 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681438068.8648663, bd1bf0f2-5c22-4c42-9e19-b22343997d21 => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:08:03 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] VM Stopped (Lifecycle Event)
Apr 14 02:08:03 user nova-compute[71498]: DEBUG nova.compute.manager [None req-f18b6f12-1564-4209-8536-b4d138ce6b01 None None] [instance: bd1bf0f2-5c22-4c42-9e19-b22343997d21] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:08:04 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:08:04 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:08:04 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 02:08:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:08:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:08:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:08:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:08:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:08:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:08:14 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:08:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "24db983d-4ad5-45be-a8e5-8448b3e5e065" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:08:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "24db983d-4ad5-45be-a8e5-8448b3e5e065" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:08:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "24db983d-4ad5-45be-a8e5-8448b3e5e065-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:08:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "24db983d-4ad5-45be-a8e5-8448b3e5e065-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:08:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "24db983d-4ad5-45be-a8e5-8448b3e5e065-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:08:18 user nova-compute[71498]: INFO nova.compute.manager [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Terminating instance
Apr 14 02:08:18 user nova-compute[71498]: DEBUG nova.compute.manager [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 02:08:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:08:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:08:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:08:18 user nova-compute[71498]: DEBUG nova.compute.manager [req-e8b558cd-f217-4590-84bc-4463b7332df6 req-63a48dcf-97a3-44db-a6db-029afb4f48c7 service nova] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Received event network-vif-unplugged-9f06d104-c24c-4287-817c-9f05b53fbb29 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:08:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e8b558cd-f217-4590-84bc-4463b7332df6 req-63a48dcf-97a3-44db-a6db-029afb4f48c7 service nova] Acquiring lock "24db983d-4ad5-45be-a8e5-8448b3e5e065-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:08:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e8b558cd-f217-4590-84bc-4463b7332df6 req-63a48dcf-97a3-44db-a6db-029afb4f48c7 service nova] Lock "24db983d-4ad5-45be-a8e5-8448b3e5e065-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:08:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e8b558cd-f217-4590-84bc-4463b7332df6 req-63a48dcf-97a3-44db-a6db-029afb4f48c7 service nova] Lock "24db983d-4ad5-45be-a8e5-8448b3e5e065-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:08:18 user nova-compute[71498]: DEBUG nova.compute.manager [req-e8b558cd-f217-4590-84bc-4463b7332df6 req-63a48dcf-97a3-44db-a6db-029afb4f48c7 service nova] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] No waiting events found dispatching network-vif-unplugged-9f06d104-c24c-4287-817c-9f05b53fbb29 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:08:18 user nova-compute[71498]: DEBUG nova.compute.manager [req-e8b558cd-f217-4590-84bc-4463b7332df6 req-63a48dcf-97a3-44db-a6db-029afb4f48c7 service nova] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Received event network-vif-unplugged-9f06d104-c24c-4287-817c-9f05b53fbb29 for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 02:08:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:08:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:08:19 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Instance destroyed successfully.
Apr 14 02:08:19 user nova-compute[71498]: DEBUG nova.objects.instance [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lazy-loading 'resources' on Instance uuid 24db983d-4ad5-45be-a8e5-8448b3e5e065 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:01:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-240203784',display_name='tempest-ServerActionsTestJSON-server-240203784',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-240203784',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7iIvlhM+wCditCRaonOriLx8WWyehY8kYxTUZ36Z1Q4VGm2JnuefQ18D+1ncnGXJXgbpg/EWHmDPRQFx9TQ2PBQ5aNgSGRUcq/Ovi+zGjOYQDNVYkQyEvsulSNtijWoQ==',key_name='tempest-keypair-165395776',keypairs=<?>,launch_index=0,launched_at=2023-04-14T02:03:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ed4ed4ab2fd4c14b3e2afe343fd7256',ramdisk_id='',reservation_id='r-wapff4we',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-2035821517',owner_user_name='tempest-ServerActionsTestJSON-2035821517-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T02:05:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78ccd1a1ec1b486981d850881734fe02',uuid=24db983d-4ad5-45be-a8e5-8448b3e5e065,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f06d104-c24c-4287-817c-9f05b53fbb29", "address": "fa:16:3e:7b:17:65", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f06d104-c2", "ovs_interfaceid": "9f06d104-c24c-4287-817c-9f05b53fbb29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converting VIF {"id": "9f06d104-c24c-4287-817c-9f05b53fbb29", "address": "fa:16:3e:7b:17:65", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f06d104-c2", "ovs_interfaceid": "9f06d104-c24c-4287-817c-9f05b53fbb29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:17:65,bridge_name='br-int',has_traffic_filtering=True,id=9f06d104-c24c-4287-817c-9f05b53fbb29,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f06d104-c2') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG os_vif [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:17:65,bridge_name='br-int',has_traffic_filtering=True,id=9f06d104-c24c-4287-817c-9f05b53fbb29,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f06d104-c2') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f06d104-c2, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:08:19 user nova-compute[71498]: INFO os_vif [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:17:65,bridge_name='br-int',has_traffic_filtering=True,id=9f06d104-c24c-4287-817c-9f05b53fbb29,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f06d104-c2')
Apr 14 02:08:19 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBVCXlJa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:08:19 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:08:19 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0137ee6-88ee-4762-90ae-9fb01a1c89ed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 02:08:19 user nova-compute[71498]: No targets found.
Apr 14 02:08:19 user nova-compute[71498]: iSNS:
Apr 14 02:08:19 user nova-compute[71498]: No targets found.
Apr 14 02:08:19 user nova-compute[71498]: STATIC:
Apr 14 02:08:19 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238
Apr 14 02:08:19 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 02:08:19 user nova-compute[71498]:                 Iface Name: default
Apr 14 02:08:19 user nova-compute[71498]: FIRMWARE:
Apr 14 02:08:19 user nova-compute[71498]: No targets found.
Apr 14 02:08:19 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 02:08:19 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 02:08:19 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef89242-f446-47e7-b4fe-c71f991a3b30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[75893406-c15e-4481-a593-8d36c946ebd0]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:08:19 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 (non-flash)
Apr 14 02:08:19 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51f42ae0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238'): ({'sdb'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Removing single pathed devices sdb {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99d3f65-65bb-4ba9-8047-e6b04422f7f4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ea5601-68fb-4585-a566-12971f5fea24]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Flushing IO for device /dev/sdb {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6a4474-cde1-4273-88d1-13d748941a72]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[668a33a9-9d8b-4d0b-ab61-6776de0f78c5]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] SCSI volumes sdb have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23466306261366663', '/dev/disk/by-id/scsi-1SCST_BIOf6529d39-4f0ba6fcc48ee1f6', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f6529d39') {{(pid=81721) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b304653a-258e-445e-a6ee-8b57e6544bd2]: (4, None) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.115s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8212ddb-6d5e-47ea-b7a2-e3da72af4027]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc32786e-7ed4-48d2-9813-8847049f150f]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238, portal: 172.16.0.220,3260]
Apr 14 02:08:19 user nova-compute[71498]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238, portal: 172.16.0.220,3260] successful.
Apr 14 02:08:19 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b73a5e-5178-4561-af91-11e1028d2238 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9325de4-7853-47b4-99a4-eb3c8c6d1369]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] <== disconnect_volume: return (388ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 02:08:19 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Deleting instance files /opt/stack/data/nova/instances/24db983d-4ad5-45be-a8e5-8448b3e5e065_del
Apr 14 02:08:19 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Deletion of /opt/stack/data/nova/instances/24db983d-4ad5-45be-a8e5-8448b3e5e065_del complete
Apr 14 02:08:19 user nova-compute[71498]: INFO nova.compute.manager [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Took 1.23 seconds to destroy the instance on the hypervisor.
Apr 14 02:08:19 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 02:08:19 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 02:08:20 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:08:20 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Took 1.09 seconds to deallocate network for instance.
Apr 14 02:08:20 user nova-compute[71498]: DEBUG nova.compute.manager [req-12c23434-de70-49f6-b670-3e34a788619a req-c3885e82-c222-43b6-8b07-a326183487dc service nova] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Received event network-vif-plugged-9f06d104-c24c-4287-817c-9f05b53fbb29 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:08:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-12c23434-de70-49f6-b670-3e34a788619a req-c3885e82-c222-43b6-8b07-a326183487dc service nova] Acquiring lock "24db983d-4ad5-45be-a8e5-8448b3e5e065-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:08:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-12c23434-de70-49f6-b670-3e34a788619a req-c3885e82-c222-43b6-8b07-a326183487dc service nova] Lock "24db983d-4ad5-45be-a8e5-8448b3e5e065-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:08:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-12c23434-de70-49f6-b670-3e34a788619a req-c3885e82-c222-43b6-8b07-a326183487dc service nova] Lock "24db983d-4ad5-45be-a8e5-8448b3e5e065-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:08:20 user nova-compute[71498]: DEBUG nova.compute.manager [req-12c23434-de70-49f6-b670-3e34a788619a req-c3885e82-c222-43b6-8b07-a326183487dc service nova] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] No waiting events found dispatching network-vif-plugged-9f06d104-c24c-4287-817c-9f05b53fbb29 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:08:20 user nova-compute[71498]: WARNING nova.compute.manager [req-12c23434-de70-49f6-b670-3e34a788619a req-c3885e82-c222-43b6-8b07-a326183487dc service nova] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Received unexpected event network-vif-plugged-9f06d104-c24c-4287-817c-9f05b53fbb29 for instance with vm_state active and task_state deleting.
Apr 14 02:08:21 user nova-compute[71498]: INFO nova.compute.manager [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Took 0.77 seconds to detach 1 volumes for instance.
Apr 14 02:08:21 user nova-compute[71498]: DEBUG nova.compute.manager [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Deleting volume: 06b73a5e-5178-4561-af91-11e1028d2238 {{(pid=71498) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 02:08:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:08:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:08:21 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:08:21 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:08:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:08:21 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Deleted allocations for instance 24db983d-4ad5-45be-a8e5-8448b3e5e065
Apr 14 02:08:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a3a67fa7-c7ff-4d31-8b40-1593ba8d2638 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "24db983d-4ad5-45be-a8e5-8448b3e5e065" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.512s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:08:22 user nova-compute[71498]: DEBUG nova.compute.manager [req-9d31e043-558d-4df2-a863-ed86ef2f64c5 req-3accd0c5-1ddc-49b8-9961-899376895ae2 service nova] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Received event network-vif-deleted-9f06d104-c24c-4287-817c-9f05b53fbb29 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:08:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-33a0260c-c5c5-4732-bf0e-1b23d2699667 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:08:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-33a0260c-c5c5-4732-bf0e-1b23d2699667 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:08:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-33a0260c-c5c5-4732-bf0e-1b23d2699667 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:08:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-33a0260c-c5c5-4732-bf0e-1b23d2699667 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:08:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-33a0260c-c5c5-4732-bf0e-1b23d2699667 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:08:23 user nova-compute[71498]: INFO nova.compute.manager [None req-33a0260c-c5c5-4732-bf0e-1b23d2699667 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Terminating instance
Apr 14 02:08:23 user nova-compute[71498]: DEBUG nova.compute.manager [None req-33a0260c-c5c5-4732-bf0e-1b23d2699667 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 02:08:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:08:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:08:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:08:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:08:24 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Instance destroyed successfully.
Apr 14 02:08:24 user nova-compute[71498]: DEBUG nova.objects.instance [None req-33a0260c-c5c5-4732-bf0e-1b23d2699667 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lazy-loading 'resources' on Instance uuid 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:08:24 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-33a0260c-c5c5-4732-bf0e-1b23d2699667 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:05:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-835223747',display_name='tempest-TestStampPattern-server-835223747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-835223747',id=39,image_ref='04ce4b97-8518-4303-b06d-8307b1cb09b8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN71XmYAhugQNhgl+EJR/4+t7AjKtKkpcGBG8gx2VPAwa0I3bKysgOFGLrmgG1OeFgwpiuJDroargohcSM2hH/0cqZkFOvlkmK46/6QQTJRBUwCSuTngzFe2HQ0i1G666A==',key_name='tempest-TestStampPattern-610075453',keypairs=<?>,launch_index=0,launched_at=2023-04-14T02:05:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27dc405e16434633956ed2cd7e1791cd',ramdisk_id='',reservation_id='r-mndxqxw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='57b15ad5-341a-47f8-9e3e-5cec8a85098a',image_min_disk='1',image_min_ram='0',image_owner_id='27dc405e16434633956ed2cd7e1791cd',image_owner_project_name='tempest-TestStampPattern-190654074',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-190654074-project-member',image_user_id='7ae5170969344b9fa5294231f8ffbe72',owner_project_name='tempest-TestStampPattern-190654074',owner_user_name='tempest-TestStampPattern-190654074-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T02:05:40Z,user_data=None,user_id='7ae5170969344b9fa5294231f8ffbe72',uuid=2bf92b68-9cc4-4e22-b7b8-30eb6b69c570,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "735565d4-21ba-4824-9dcb-d464456080fc", "address": "fa:16:3e:3a:68:0a", "network": {"id": "d099696f-2c31-4ce1-89d8-680d87d17b9b", "bridge": "br-int", "label": "tempest-TestStampPattern-665967680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27dc405e16434633956ed2cd7e1791cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735565d4-21", "ovs_interfaceid": "735565d4-21ba-4824-9dcb-d464456080fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 02:08:24 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-33a0260c-c5c5-4732-bf0e-1b23d2699667 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Converting VIF {"id": "735565d4-21ba-4824-9dcb-d464456080fc", "address": "fa:16:3e:3a:68:0a", "network": {"id": "d099696f-2c31-4ce1-89d8-680d87d17b9b", "bridge": "br-int", "label": "tempest-TestStampPattern-665967680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27dc405e16434633956ed2cd7e1791cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735565d4-21", "ovs_interfaceid": "735565d4-21ba-4824-9dcb-d464456080fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:08:24 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-33a0260c-c5c5-4732-bf0e-1b23d2699667 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:68:0a,bridge_name='br-int',has_traffic_filtering=True,id=735565d4-21ba-4824-9dcb-d464456080fc,network=Network(d099696f-2c31-4ce1-89d8-680d87d17b9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap735565d4-21') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:08:24 user nova-compute[71498]: DEBUG os_vif [None req-33a0260c-c5c5-4732-bf0e-1b23d2699667 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:68:0a,bridge_name='br-int',has_traffic_filtering=True,id=735565d4-21ba-4824-9dcb-d464456080fc,network=Network(d099696f-2c31-4ce1-89d8-680d87d17b9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap735565d4-21') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 02:08:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:08:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap735565d4-21, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:08:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:08:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:08:24 user nova-compute[71498]: INFO os_vif [None req-33a0260c-c5c5-4732-bf0e-1b23d2699667 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:68:0a,bridge_name='br-int',has_traffic_filtering=True,id=735565d4-21ba-4824-9dcb-d464456080fc,network=Network(d099696f-2c31-4ce1-89d8-680d87d17b9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap735565d4-21')
Apr 14 02:08:24 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-33a0260c-c5c5-4732-bf0e-1b23d2699667 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Deleting instance files /opt/stack/data/nova/instances/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570_del
Apr 14 02:08:24 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-33a0260c-c5c5-4732-bf0e-1b23d2699667 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Deletion of /opt/stack/data/nova/instances/2bf92b68-9cc4-4e22-b7b8-30eb6b69c570_del complete
Apr 14 02:08:24 user nova-compute[71498]: INFO nova.compute.manager [None req-33a0260c-c5c5-4732-bf0e-1b23d2699667 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 14 02:08:24 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-33a0260c-c5c5-4732-bf0e-1b23d2699667 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 02:08:24 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 02:08:24 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 02:08:24 user nova-compute[71498]: DEBUG nova.compute.manager [req-9d5b0125-4471-4c07-91df-bd5a12268d80 req-8ff922ba-a936-4df8-9efe-581ff77a7f0b service nova] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Received event network-changed-735565d4-21ba-4824-9dcb-d464456080fc {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:08:24 user nova-compute[71498]: DEBUG nova.compute.manager [req-9d5b0125-4471-4c07-91df-bd5a12268d80 req-8ff922ba-a936-4df8-9efe-581ff77a7f0b service nova] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Refreshing instance network info cache due to event network-changed-735565d4-21ba-4824-9dcb-d464456080fc. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 02:08:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-9d5b0125-4471-4c07-91df-bd5a12268d80 req-8ff922ba-a936-4df8-9efe-581ff77a7f0b service nova] Acquiring lock "refresh_cache-2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:08:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-9d5b0125-4471-4c07-91df-bd5a12268d80 req-8ff922ba-a936-4df8-9efe-581ff77a7f0b service nova] Acquired lock "refresh_cache-2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:08:24 user nova-compute[71498]: DEBUG nova.network.neutron [req-9d5b0125-4471-4c07-91df-bd5a12268d80 req-8ff922ba-a936-4df8-9efe-581ff77a7f0b service nova] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Refreshing network info cache for port 735565d4-21ba-4824-9dcb-d464456080fc {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 02:08:24 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:08:24 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Took 0.50 seconds to deallocate network for instance.
Apr 14 02:08:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-33a0260c-c5c5-4732-bf0e-1b23d2699667 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-33a0260c-c5c5-4732-bf0e-1b23d2699667 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "c63b62a9-626c-45ca-a454-4840f51bb28c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "c63b62a9-626c-45ca-a454-4840f51bb28c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG nova.objects.instance [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lazy-loading 'flavor' on Instance uuid c63b62a9-626c-45ca-a454-4840f51bb28c {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:08:25 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Ignoring supplied device name: /dev/vdb
Apr 14 02:08:25 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-33a0260c-c5c5-4732-bf0e-1b23d2699667 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-33a0260c-c5c5-4732-bf0e-1b23d2699667 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "c63b62a9-626c-45ca-a454-4840f51bb28c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-33a0260c-c5c5-4732-bf0e-1b23d2699667 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:08:25 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-33a0260c-c5c5-4732-bf0e-1b23d2699667 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Deleted allocations for instance 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570
Apr 14 02:08:25 user nova-compute[71498]: DEBUG nova.network.neutron [req-9d5b0125-4471-4c07-91df-bd5a12268d80 req-8ff922ba-a936-4df8-9efe-581ff77a7f0b service nova] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Updated VIF entry in instance network info cache for port 735565d4-21ba-4824-9dcb-d464456080fc. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG nova.network.neutron [req-9d5b0125-4471-4c07-91df-bd5a12268d80 req-8ff922ba-a936-4df8-9efe-581ff77a7f0b service nova] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Updating instance_info_cache with network_info: [{"id": "735565d4-21ba-4824-9dcb-d464456080fc", "address": "fa:16:3e:3a:68:0a", "network": {"id": "d099696f-2c31-4ce1-89d8-680d87d17b9b", "bridge": "br-int", "label": "tempest-TestStampPattern-665967680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27dc405e16434633956ed2cd7e1791cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap735565d4-21", "ovs_interfaceid": "735565d4-21ba-4824-9dcb-d464456080fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-9d5b0125-4471-4c07-91df-bd5a12268d80 req-8ff922ba-a936-4df8-9efe-581ff77a7f0b service nova] Releasing lock "refresh_cache-2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG nova.compute.manager [req-9d5b0125-4471-4c07-91df-bd5a12268d80 req-8ff922ba-a936-4df8-9efe-581ff77a7f0b service nova] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Received event network-vif-unplugged-735565d4-21ba-4824-9dcb-d464456080fc {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-9d5b0125-4471-4c07-91df-bd5a12268d80 req-8ff922ba-a936-4df8-9efe-581ff77a7f0b service nova] Acquiring lock "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-9d5b0125-4471-4c07-91df-bd5a12268d80 req-8ff922ba-a936-4df8-9efe-581ff77a7f0b service nova] Lock "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-9d5b0125-4471-4c07-91df-bd5a12268d80 req-8ff922ba-a936-4df8-9efe-581ff77a7f0b service nova] Lock "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG nova.compute.manager [req-9d5b0125-4471-4c07-91df-bd5a12268d80 req-8ff922ba-a936-4df8-9efe-581ff77a7f0b service nova] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] No waiting events found dispatching network-vif-unplugged-735565d4-21ba-4824-9dcb-d464456080fc {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG nova.compute.manager [req-9d5b0125-4471-4c07-91df-bd5a12268d80 req-8ff922ba-a936-4df8-9efe-581ff77a7f0b service nova] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Received event network-vif-unplugged-735565d4-21ba-4824-9dcb-d464456080fc for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG nova.compute.manager [req-9d5b0125-4471-4c07-91df-bd5a12268d80 req-8ff922ba-a936-4df8-9efe-581ff77a7f0b service nova] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Received event network-vif-plugged-735565d4-21ba-4824-9dcb-d464456080fc {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-9d5b0125-4471-4c07-91df-bd5a12268d80 req-8ff922ba-a936-4df8-9efe-581ff77a7f0b service nova] Acquiring lock "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-9d5b0125-4471-4c07-91df-bd5a12268d80 req-8ff922ba-a936-4df8-9efe-581ff77a7f0b service nova] Lock "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-9d5b0125-4471-4c07-91df-bd5a12268d80 req-8ff922ba-a936-4df8-9efe-581ff77a7f0b service nova] Lock "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG nova.compute.manager [req-9d5b0125-4471-4c07-91df-bd5a12268d80 req-8ff922ba-a936-4df8-9efe-581ff77a7f0b service nova] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] No waiting events found dispatching network-vif-plugged-735565d4-21ba-4824-9dcb-d464456080fc {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:08:25 user nova-compute[71498]: WARNING nova.compute.manager [req-9d5b0125-4471-4c07-91df-bd5a12268d80 req-8ff922ba-a936-4df8-9efe-581ff77a7f0b service nova] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Received unexpected event network-vif-plugged-735565d4-21ba-4824-9dcb-d464456080fc for instance with vm_state active and task_state deleting.
Apr 14 02:08:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-33a0260c-c5c5-4732-bf0e-1b23d2699667 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "2bf92b68-9cc4-4e22-b7b8-30eb6b69c570" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.693s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "c63b62a9-626c-45ca-a454-4840f51bb28c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "c63b62a9-626c-45ca-a454-4840f51bb28c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:08:25 user nova-compute[71498]: INFO nova.compute.manager [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Attaching volume 5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 to /dev/vdb
Apr 14 02:08:25 user nova-compute[71498]: DEBUG os_brick.utils [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9720ef81-a7da-4181-9e7f-6b77e8b7cc6d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de9132a-a3f9-4594-9a13-4d39d72df052]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a58204e-c32e-45b3-bf9e-7bda5cf81950]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa7909b-c530-4c24-9ecd-d00356c0b4bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 02:08:25 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 02:08:25 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1acb86c-416d-4e71-b32c-4dfb621318f1]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG os_brick.utils [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:08:25 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Updating existing volume attachment record: 3fad3d3a-fc9e-49ba-adad-dba96b56b680 {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 02:08:26 user nova-compute[71498]: DEBUG nova.compute.manager [req-15be3ab8-eb3b-4a15-b445-df7980517e97 req-d1b9112e-cf56-481c-a690-24de70d25e2b service nova] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Received event network-vif-deleted-735565d4-21ba-4824-9dcb-d464456080fc {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:08:26 user nova-compute[71498]: INFO nova.compute.manager [req-15be3ab8-eb3b-4a15-b445-df7980517e97 req-d1b9112e-cf56-481c-a690-24de70d25e2b service nova] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Neutron deleted interface 735565d4-21ba-4824-9dcb-d464456080fc; detaching it from the instance and deleting it from the info cache
Apr 14 02:08:26 user nova-compute[71498]: DEBUG nova.network.neutron [req-15be3ab8-eb3b-4a15-b445-df7980517e97 req-d1b9112e-cf56-481c-a690-24de70d25e2b service nova] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Instance is deleted, no further info cache update {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
Apr 14 02:08:26 user nova-compute[71498]: DEBUG nova.compute.manager [req-15be3ab8-eb3b-4a15-b445-df7980517e97 req-d1b9112e-cf56-481c-a690-24de70d25e2b service nova] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Detach interface failed, port_id=735565d4-21ba-4824-9dcb-d464456080fc, reason: Instance 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 could not be found. {{(pid=71498) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 02:08:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:08:29 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 02:08:29 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQWcapHS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:08:29 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:08:29 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:08:29 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:08:29 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:08:29 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:08:29 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:08:29 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 02:08:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:29 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee923626-63bd-4e77-97e6-79e8d27180ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:29 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 02:08:29 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:08:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:29 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb9c9ac-ea9d-4eec-b6f3-d488bd96f94c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:29 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449] added
Apr 14 02:08:29 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:08:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:29 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9702cdc-c604-4133-a45a-6c4e94ae6bbb]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:29 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:08:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:29 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c86837-40a7-434d-a529-c4f727c423ec]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:29 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:08:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kQWcapHS {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kQWcapHS" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:29 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae2dbbf-ff6c-42ab-bc91-e934c2ae386e]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:29 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kQWcapHS'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:08:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:29 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ef4e21-b416-455c-889c-49791783b51d]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:29 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:08:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:29 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64fc320-9d5b-426b-ba87-6e053ed7f407]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:29 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 02:08:29 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:08:29 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 02:08:29 user nova-compute[71498]:  {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:08:29 user nova-compute[71498]: WARNING os_brick.initiator.connectors.iscsi [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 02:08:29 user nova-compute[71498]: 
Apr 14 02:08:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:30 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5f4ba4-1eb8-4b1d-a15b-09012252249c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:30 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449, portal: 172.16.0.220,3260]
Apr 14 02:08:30 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449, portal: 172.16.0.220,3260] successful.
Apr 14 02:08:30 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:08:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:30 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7a3fbd-bd69-435d-87d4-5b1b78ec6ec0]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:30 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:08:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:30 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11aefb4-7a09-4ef0-ac68-7723d396fec0]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:30 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 (non-flash)
Apr 14 02:08:30 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:08:30 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 (non-flash)
Apr 14 02:08:30 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:08:30 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:08:30 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 02:08:30 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 02:08:30 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 02:08:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:30 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c7b6c5-14f6-40ea-a207-c2835e04b4bd]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:30 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 02:08:31 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 02:08:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQWcapHS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 02:08:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:08:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23430303862323336', 'path': '/dev/sdb'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:08:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430303862323336', 'path': '/dev/sdb'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 02:08:31 user nova-compute[71498]: DEBUG nova.objects.instance [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lazy-loading 'flavor' on Instance uuid c63b62a9-626c-45ca-a454-4840f51bb28c {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:08:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 02:08:31 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:08:31 user nova-compute[71498]:   <source dev="/dev/sdb"/>
Apr 14 02:08:31 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 02:08:31 user nova-compute[71498]:   <serial>5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449</serial>
Apr 14 02:08:31 user nova-compute[71498]: </disk>
Apr 14 02:08:31 user nova-compute[71498]:  {{(pid=71498) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 02:08:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:08:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:08:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] No VIF found with MAC fa:16:3e:7a:12:c7, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 02:08:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2f74a1ad-9556-4177-bf4c-9ec818db3dc4 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "c63b62a9-626c-45ca-a454-4840f51bb28c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.295s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:08:34 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681438099.118782, 24db983d-4ad5-45be-a8e5-8448b3e5e065 => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:08:34 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] VM Stopped (Lifecycle Event)
Apr 14 02:08:34 user nova-compute[71498]: DEBUG nova.compute.manager [None req-9a4a0a66-5916-40e2-8974-797b87d96837 None None] [instance: 24db983d-4ad5-45be-a8e5-8448b3e5e065] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:08:34 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:08:34 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:08:34 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:08:34 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:08:34 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:08:34 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:08:39 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681438104.3815522, 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570 => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:08:39 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] VM Stopped (Lifecycle Event)
Apr 14 02:08:39 user nova-compute[71498]: DEBUG nova.compute.manager [None req-51453253-2e6f-4fcf-9f71-6e95e02374f0 None None] [instance: 2bf92b68-9cc4-4e22-b7b8-30eb6b69c570] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:08:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:08:44 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:08:44 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:08:44 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:08:44 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:08:44 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:08:44 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:08:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "c63b62a9-626c-45ca-a454-4840f51bb28c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:08:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "c63b62a9-626c-45ca-a454-4840f51bb28c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:08:47 user nova-compute[71498]: INFO nova.compute.manager [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Detaching volume 5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449
Apr 14 02:08:47 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "c63b62a9-626c-45ca-a454-4840f51bb28c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:08:47 user nova-compute[71498]: INFO nova.virt.block_device [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Attempting to driver detach volume 5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 from mountpoint /dev/vdb
Apr 14 02:08:47 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Attempting to detach device vdb from instance c63b62a9-626c-45ca-a454-4840f51bb28c from the persistent domain config. {{(pid=71498) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 02:08:47 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 02:08:47 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:08:47 user nova-compute[71498]:   <source dev="/dev/sdb"/>
Apr 14 02:08:47 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 02:08:47 user nova-compute[71498]:   <serial>5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449</serial>
Apr 14 02:08:47 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 02:08:47 user nova-compute[71498]: </disk>
Apr 14 02:08:47 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 02:08:47 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Successfully detached device vdb from instance c63b62a9-626c-45ca-a454-4840f51bb28c from the persistent domain config.
Apr 14 02:08:47 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c63b62a9-626c-45ca-a454-4840f51bb28c from the live domain config. {{(pid=71498) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 02:08:47 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 02:08:47 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:08:47 user nova-compute[71498]:   <source dev="/dev/sdb"/>
Apr 14 02:08:47 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 02:08:47 user nova-compute[71498]:   <serial>5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449</serial>
Apr 14 02:08:47 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 02:08:47 user nova-compute[71498]: </disk>
Apr 14 02:08:47 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Received event <DeviceRemovedEvent: 1681438128.4001102, c63b62a9-626c-45ca-a454-4840f51bb28c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71498) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c63b62a9-626c-45ca-a454-4840f51bb28c {{(pid=71498) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 02:08:48 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Successfully detached device vdb from instance c63b62a9-626c-45ca-a454-4840f51bb28c from the live domain config.
Apr 14 02:08:48 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQWcapHS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:08:48 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:08:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eea02bd-7d69-405e-a976-dee0408901af]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 02:08:48 user nova-compute[71498]: No targets found.
Apr 14 02:08:48 user nova-compute[71498]: iSNS:
Apr 14 02:08:48 user nova-compute[71498]: No targets found.
Apr 14 02:08:48 user nova-compute[71498]: STATIC:
Apr 14 02:08:48 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449
Apr 14 02:08:48 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 02:08:48 user nova-compute[71498]:                 Iface Name: default
Apr 14 02:08:48 user nova-compute[71498]: FIRMWARE:
Apr 14 02:08:48 user nova-compute[71498]: No targets found.
Apr 14 02:08:48 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 02:08:48 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 02:08:48 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b36a45-1193-437b-ad72-90ebb38adbf0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9959c34c-17e3-463f-a39f-d565e763a8b5]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 (non-flash)
Apr 14 02:08:48 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 (non-flash)
Apr 14 02:08:48 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51f44f4b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449'): ({'sdb'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Removing single pathed devices sdb {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43b146d-7c99-4ea0-9a4a-63608af48ae3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dad8381-f47a-4e34-a23a-3701de90059a]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Flushing IO for device /dev/sdb {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb93b9f-4183-4cd3-bd52-2997644b3c2f]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[617f2c5a-b896-4170-90f1-70c1c91c83e3]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] SCSI volumes sdb have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3399cd3-85ec-422d-bd04-e92aa80ce20e]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70dccca-c0d0-41b9-9cb0-7815d94672ad]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449, portal: 172.16.0.220,3260]
Apr 14 02:08:48 user nova-compute[71498]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449, portal: 172.16.0.220,3260] successful.
Apr 14 02:08:48 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2ee759-583f-49ec-b59f-fb1a887052f5]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] <== disconnect_volume: return (266ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:08:48 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 02:08:49 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:08:49 user nova-compute[71498]: DEBUG nova.objects.instance [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lazy-loading 'flavor' on Instance uuid c63b62a9-626c-45ca-a454-4840f51bb28c {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:08:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2622476e-84eb-40bf-8437-86ecbb69c377 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "c63b62a9-626c-45ca-a454-4840f51bb28c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.633s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:08:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "c63b62a9-626c-45ca-a454-4840f51bb28c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.585s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:08:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "c63b62a9-626c-45ca-a454-4840f51bb28c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:08:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "c63b62a9-626c-45ca-a454-4840f51bb28c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:08:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "c63b62a9-626c-45ca-a454-4840f51bb28c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:08:49 user nova-compute[71498]: INFO nova.compute.manager [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Terminating instance
Apr 14 02:08:49 user nova-compute[71498]: DEBUG nova.compute.manager [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 02:08:49 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:08:49 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:08:49 user nova-compute[71498]: DEBUG nova.compute.manager [req-64286bbe-627a-48dc-86cb-209bf498498c req-0c517b4e-cdd9-422c-b0a7-dc898add5d3f service nova] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Received event network-vif-unplugged-92e48f25-5c12-4ff1-840d-54bee4da0ef2 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:08:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-64286bbe-627a-48dc-86cb-209bf498498c req-0c517b4e-cdd9-422c-b0a7-dc898add5d3f service nova] Acquiring lock "c63b62a9-626c-45ca-a454-4840f51bb28c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:08:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-64286bbe-627a-48dc-86cb-209bf498498c req-0c517b4e-cdd9-422c-b0a7-dc898add5d3f service nova] Lock "c63b62a9-626c-45ca-a454-4840f51bb28c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:08:49 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-64286bbe-627a-48dc-86cb-209bf498498c req-0c517b4e-cdd9-422c-b0a7-dc898add5d3f service nova] Lock "c63b62a9-626c-45ca-a454-4840f51bb28c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:08:49 user nova-compute[71498]: DEBUG nova.compute.manager [req-64286bbe-627a-48dc-86cb-209bf498498c req-0c517b4e-cdd9-422c-b0a7-dc898add5d3f service nova] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] No waiting events found dispatching network-vif-unplugged-92e48f25-5c12-4ff1-840d-54bee4da0ef2 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:08:49 user nova-compute[71498]: DEBUG nova.compute.manager [req-64286bbe-627a-48dc-86cb-209bf498498c req-0c517b4e-cdd9-422c-b0a7-dc898add5d3f service nova] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Received event network-vif-unplugged-92e48f25-5c12-4ff1-840d-54bee4da0ef2 for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 02:08:49 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:08:49 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:08:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:08:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:08:50 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Instance destroyed successfully.
Apr 14 02:08:50 user nova-compute[71498]: DEBUG nova.objects.instance [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lazy-loading 'resources' on Instance uuid c63b62a9-626c-45ca-a454-4840f51bb28c {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:08:50 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:06:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-295651143',display_name='tempest-VolumesSnapshotTestJSON-instance-295651143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-295651143',id=41,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T02:06:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3fba8f38142a41928f0d2e8ead3aab96',ramdisk_id='',reservation_id='r-gf0r4rx1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2121749885',owner_user_name='tempest-VolumesSnapshotTestJSON-2121749885-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T02:06:42Z,user_data=None,user_id='fbb0e166c1f448cbba774b835f9798c9',uuid=c63b62a9-626c-45ca-a454-4840f51bb28c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92e48f25-5c12-4ff1-840d-54bee4da0ef2", "address": "fa:16:3e:7a:12:c7", "network": {"id": "1cdc7ce4-e3ce-4e21-834b-712724a6c11d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-70541503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3fba8f38142a41928f0d2e8ead3aab96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e48f25-5c", "ovs_interfaceid": "92e48f25-5c12-4ff1-840d-54bee4da0ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 02:08:50 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Converting VIF {"id": "92e48f25-5c12-4ff1-840d-54bee4da0ef2", "address": "fa:16:3e:7a:12:c7", "network": {"id": "1cdc7ce4-e3ce-4e21-834b-712724a6c11d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-70541503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3fba8f38142a41928f0d2e8ead3aab96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e48f25-5c", "ovs_interfaceid": "92e48f25-5c12-4ff1-840d-54bee4da0ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:08:50 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:12:c7,bridge_name='br-int',has_traffic_filtering=True,id=92e48f25-5c12-4ff1-840d-54bee4da0ef2,network=Network(1cdc7ce4-e3ce-4e21-834b-712724a6c11d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e48f25-5c') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:08:50 user nova-compute[71498]: DEBUG os_vif [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:12:c7,bridge_name='br-int',has_traffic_filtering=True,id=92e48f25-5c12-4ff1-840d-54bee4da0ef2,network=Network(1cdc7ce4-e3ce-4e21-834b-712724a6c11d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e48f25-5c') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 02:08:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:08:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92e48f25-5c, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:08:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:08:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:08:50 user nova-compute[71498]: INFO os_vif [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:12:c7,bridge_name='br-int',has_traffic_filtering=True,id=92e48f25-5c12-4ff1-840d-54bee4da0ef2,network=Network(1cdc7ce4-e3ce-4e21-834b-712724a6c11d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e48f25-5c')
Apr 14 02:08:50 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 02:08:50 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:5fe8dcdd-a23d-42d8-bb31-c4a6cc11f449', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQWcapHS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:08:50 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:08:50 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:08:50 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:08:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:50 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 02:08:50 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[d6bd5a2a-9078-4f9c-ada0-314400cdbb44]: Unexpected error while running command.
Apr 14 02:08:50 user nova-compute[71498]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 02:08:50 user nova-compute[71498]: Exit code: 21
Apr 14 02:08:50 user nova-compute[71498]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 02:08:50 user nova-compute[71498]: Stderr: '' {{(pid=81721) _process_cmd /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:479}}
Apr 14 02:08:50 user nova-compute[71498]: Traceback (most recent call last):
Apr 14 02:08:50 user nova-compute[71498]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Apr 14 02:08:50 user nova-compute[71498]:     ret = func(*f_args, **f_kwargs)
Apr 14 02:08:50 user nova-compute[71498]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Apr 14 02:08:50 user nova-compute[71498]:     return func(*args, **kwargs)
Apr 14 02:08:50 user nova-compute[71498]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Apr 14 02:08:50 user nova-compute[71498]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Apr 14 02:08:50 user nova-compute[71498]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Apr 14 02:08:50 user nova-compute[71498]:     return putils.execute(on_execute=on_execute,
Apr 14 02:08:50 user nova-compute[71498]:   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py", line 438, in execute
Apr 14 02:08:50 user nova-compute[71498]:     raise ProcessExecutionError(exit_code=_returncode,
Apr 14 02:08:50 user nova-compute[71498]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 14 02:08:50 user nova-compute[71498]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 02:08:50 user nova-compute[71498]: Exit code: 21
Apr 14 02:08:50 user nova-compute[71498]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 02:08:50 user nova-compute[71498]: Stderr: ''
Apr 14 02:08:50 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bd5a2a-9078-4f9c-ada0-314400cdbb44]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:08:50 user nova-compute[71498]: ERROR os_brick.initiator.connectors.iscsi [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 14 02:08:50 user nova-compute[71498]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 02:08:50 user nova-compute[71498]: Exit code: 21
Apr 14 02:08:50 user nova-compute[71498]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 02:08:50 user nova-compute[71498]: Stderr: ''
Apr 14 02:08:50 user nova-compute[71498]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Apr 14 02:08:50 user nova-compute[71498]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 206, in _get_ips_iqns_luns
Apr 14 02:08:50 user nova-compute[71498]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Apr 14 02:08:50 user nova-compute[71498]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 365, in _get_discoverydb_portals
Apr 14 02:08:50 user nova-compute[71498]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Apr 14 02:08:50 user nova-compute[71498]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 1177, in _run_iscsiadm_bare
Apr 14 02:08:50 user nova-compute[71498]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Apr 14 02:08:50 user nova-compute[71498]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/executor.py", line 55, in _execute
Apr 14 02:08:50 user nova-compute[71498]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Apr 14 02:08:50 user nova-compute[71498]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Apr 14 02:08:50 user nova-compute[71498]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Apr 14 02:08:50 user nova-compute[71498]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Apr 14 02:08:50 user nova-compute[71498]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Apr 14 02:08:50 user nova-compute[71498]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 215, in remote_call
Apr 14 02:08:50 user nova-compute[71498]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Apr 14 02:08:50 user nova-compute[71498]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 14 02:08:50 user nova-compute[71498]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 02:08:50 user nova-compute[71498]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Apr 14 02:08:50 user nova-compute[71498]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 02:08:50 user nova-compute[71498]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Apr 14 02:08:50 user nova-compute[71498]: ERROR os_brick.initiator.connectors.iscsi 
Apr 14 02:08:50 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=71498) _cleanup_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:923}}
Apr 14 02:08:50 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.037s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:08:50 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] <== disconnect_volume: return (38ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:08:50 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 02:08:50 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Deleting instance files /opt/stack/data/nova/instances/c63b62a9-626c-45ca-a454-4840f51bb28c_del
Apr 14 02:08:50 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Deletion of /opt/stack/data/nova/instances/c63b62a9-626c-45ca-a454-4840f51bb28c_del complete
Apr 14 02:08:50 user nova-compute[71498]: INFO nova.compute.manager [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Took 0.81 seconds to destroy the instance on the hypervisor.
Apr 14 02:08:50 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 02:08:50 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 02:08:50 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 02:08:50 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:08:50 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 02:08:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-57b15ad5-341a-47f8-9e3e-5cec8a85098a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:08:50 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-57b15ad5-341a-47f8-9e3e-5cec8a85098a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:08:50 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 02:08:51 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:08:51 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Took 0.77 seconds to deallocate network for instance.
Apr 14 02:08:51 user nova-compute[71498]: DEBUG nova.compute.manager [req-0d0e43e0-1397-4f68-a5a0-aca4c34c29be req-3a71a187-6966-424a-a670-55ccec29b3eb service nova] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Received event network-vif-deleted-92e48f25-5c12-4ff1-840d-54bee4da0ef2 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:08:51 user nova-compute[71498]: WARNING nova.volume.cinder [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Attachment 3fad3d3a-fc9e-49ba-adad-dba96b56b680 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 3fad3d3a-fc9e-49ba-adad-dba96b56b680. (HTTP 404) (Request-ID: req-f76d4780-2ce0-46db-9ceb-3c24d3ba94d1)
Apr 14 02:08:51 user nova-compute[71498]: INFO nova.compute.manager [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Took 0.02 seconds to detach 1 volumes for instance.
Apr 14 02:08:51 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Updating instance_info_cache with network_info: [{"id": "18eed24e-8acb-457c-95b8-64c141faa4aa", "address": "fa:16:3e:8a:75:08", "network": {"id": "d099696f-2c31-4ce1-89d8-680d87d17b9b", "bridge": "br-int", "label": "tempest-TestStampPattern-665967680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27dc405e16434633956ed2cd7e1791cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18eed24e-8a", "ovs_interfaceid": "18eed24e-8acb-457c-95b8-64c141faa4aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:08:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-57b15ad5-341a-47f8-9e3e-5cec8a85098a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:08:51 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 02:08:51 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:08:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:08:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:08:51 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:08:51 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:08:51 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:08:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:08:51 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Deleted allocations for instance c63b62a9-626c-45ca-a454-4840f51bb28c
Apr 14 02:08:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-eae6932d-0125-4950-8831-dbe746d834a5 tempest-VolumesSnapshotTestJSON-2121749885 tempest-VolumesSnapshotTestJSON-2121749885-project-member] Lock "c63b62a9-626c-45ca-a454-4840f51bb28c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.042s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:08:51 user nova-compute[71498]: DEBUG nova.compute.manager [req-544da1d4-9cd5-4780-94ba-69fe51d846af req-f06bd41c-212a-4a8c-8716-7ef9538b9455 service nova] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Received event network-vif-plugged-92e48f25-5c12-4ff1-840d-54bee4da0ef2 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:08:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-544da1d4-9cd5-4780-94ba-69fe51d846af req-f06bd41c-212a-4a8c-8716-7ef9538b9455 service nova] Acquiring lock "c63b62a9-626c-45ca-a454-4840f51bb28c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:08:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-544da1d4-9cd5-4780-94ba-69fe51d846af req-f06bd41c-212a-4a8c-8716-7ef9538b9455 service nova] Lock "c63b62a9-626c-45ca-a454-4840f51bb28c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:08:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-544da1d4-9cd5-4780-94ba-69fe51d846af req-f06bd41c-212a-4a8c-8716-7ef9538b9455 service nova] Lock "c63b62a9-626c-45ca-a454-4840f51bb28c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:08:51 user nova-compute[71498]: DEBUG nova.compute.manager [req-544da1d4-9cd5-4780-94ba-69fe51d846af req-f06bd41c-212a-4a8c-8716-7ef9538b9455 service nova] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] No waiting events found dispatching network-vif-plugged-92e48f25-5c12-4ff1-840d-54bee4da0ef2 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:08:51 user nova-compute[71498]: WARNING nova.compute.manager [req-544da1d4-9cd5-4780-94ba-69fe51d846af req-f06bd41c-212a-4a8c-8716-7ef9538b9455 service nova] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Received unexpected event network-vif-plugged-92e48f25-5c12-4ff1-840d-54bee4da0ef2 for instance with vm_state deleted and task_state None.
Apr 14 02:08:51 user nova-compute[71498]: DEBUG nova.compute.manager [req-544da1d4-9cd5-4780-94ba-69fe51d846af req-f06bd41c-212a-4a8c-8716-7ef9538b9455 service nova] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Received event network-vif-plugged-92e48f25-5c12-4ff1-840d-54bee4da0ef2 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:08:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-544da1d4-9cd5-4780-94ba-69fe51d846af req-f06bd41c-212a-4a8c-8716-7ef9538b9455 service nova] Acquiring lock "c63b62a9-626c-45ca-a454-4840f51bb28c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:08:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-544da1d4-9cd5-4780-94ba-69fe51d846af req-f06bd41c-212a-4a8c-8716-7ef9538b9455 service nova] Lock "c63b62a9-626c-45ca-a454-4840f51bb28c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:08:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-544da1d4-9cd5-4780-94ba-69fe51d846af req-f06bd41c-212a-4a8c-8716-7ef9538b9455 service nova] Lock "c63b62a9-626c-45ca-a454-4840f51bb28c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:08:51 user nova-compute[71498]: DEBUG nova.compute.manager [req-544da1d4-9cd5-4780-94ba-69fe51d846af req-f06bd41c-212a-4a8c-8716-7ef9538b9455 service nova] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] No waiting events found dispatching network-vif-plugged-92e48f25-5c12-4ff1-840d-54bee4da0ef2 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:08:51 user nova-compute[71498]: WARNING nova.compute.manager [req-544da1d4-9cd5-4780-94ba-69fe51d846af req-f06bd41c-212a-4a8c-8716-7ef9538b9455 service nova] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Received unexpected event network-vif-plugged-92e48f25-5c12-4ff1-840d-54bee4da0ef2 for instance with vm_state deleted and task_state None.
Apr 14 02:08:51 user nova-compute[71498]: DEBUG nova.compute.manager [req-544da1d4-9cd5-4780-94ba-69fe51d846af req-f06bd41c-212a-4a8c-8716-7ef9538b9455 service nova] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Received event network-vif-plugged-92e48f25-5c12-4ff1-840d-54bee4da0ef2 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:08:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-544da1d4-9cd5-4780-94ba-69fe51d846af req-f06bd41c-212a-4a8c-8716-7ef9538b9455 service nova] Acquiring lock "c63b62a9-626c-45ca-a454-4840f51bb28c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:08:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-544da1d4-9cd5-4780-94ba-69fe51d846af req-f06bd41c-212a-4a8c-8716-7ef9538b9455 service nova] Lock "c63b62a9-626c-45ca-a454-4840f51bb28c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:08:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-544da1d4-9cd5-4780-94ba-69fe51d846af req-f06bd41c-212a-4a8c-8716-7ef9538b9455 service nova] Lock "c63b62a9-626c-45ca-a454-4840f51bb28c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:08:51 user nova-compute[71498]: DEBUG nova.compute.manager [req-544da1d4-9cd5-4780-94ba-69fe51d846af req-f06bd41c-212a-4a8c-8716-7ef9538b9455 service nova] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] No waiting events found dispatching network-vif-plugged-92e48f25-5c12-4ff1-840d-54bee4da0ef2 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:08:51 user nova-compute[71498]: WARNING nova.compute.manager [req-544da1d4-9cd5-4780-94ba-69fe51d846af req-f06bd41c-212a-4a8c-8716-7ef9538b9455 service nova] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Received unexpected event network-vif-plugged-92e48f25-5c12-4ff1-840d-54bee4da0ef2 for instance with vm_state deleted and task_state None.
Apr 14 02:08:51 user nova-compute[71498]: DEBUG nova.compute.manager [req-544da1d4-9cd5-4780-94ba-69fe51d846af req-f06bd41c-212a-4a8c-8716-7ef9538b9455 service nova] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Received event network-vif-plugged-92e48f25-5c12-4ff1-840d-54bee4da0ef2 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:08:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-544da1d4-9cd5-4780-94ba-69fe51d846af req-f06bd41c-212a-4a8c-8716-7ef9538b9455 service nova] Acquiring lock "c63b62a9-626c-45ca-a454-4840f51bb28c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:08:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-544da1d4-9cd5-4780-94ba-69fe51d846af req-f06bd41c-212a-4a8c-8716-7ef9538b9455 service nova] Lock "c63b62a9-626c-45ca-a454-4840f51bb28c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:08:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-544da1d4-9cd5-4780-94ba-69fe51d846af req-f06bd41c-212a-4a8c-8716-7ef9538b9455 service nova] Lock "c63b62a9-626c-45ca-a454-4840f51bb28c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:08:51 user nova-compute[71498]: DEBUG nova.compute.manager [req-544da1d4-9cd5-4780-94ba-69fe51d846af req-f06bd41c-212a-4a8c-8716-7ef9538b9455 service nova] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] No waiting events found dispatching network-vif-plugged-92e48f25-5c12-4ff1-840d-54bee4da0ef2 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:08:51 user nova-compute[71498]: WARNING nova.compute.manager [req-544da1d4-9cd5-4780-94ba-69fe51d846af req-f06bd41c-212a-4a8c-8716-7ef9538b9455 service nova] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Received unexpected event network-vif-plugged-92e48f25-5c12-4ff1-840d-54bee4da0ef2 for instance with vm_state deleted and task_state None.
Apr 14 02:08:54 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:08:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:08:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:08:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:08:54 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 02:08:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:08:55 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:08:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:08:55 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:08:55 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:08:55 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=8601MB free_disk=26.170501708984375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 02:08:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:08:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:08:55 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 5ba29111-1e9b-4947-b046-6bbe888eca06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:08:55 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 57b15ad5-341a-47f8-9e3e-5cec8a85098a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:08:55 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 02:08:55 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 02:08:55 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:08:55 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:08:55 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 02:08:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.245s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:08:59 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:08:59 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:08:59 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:09:00 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:09:00 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:09:00 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:00 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:09:00 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:09:00 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:09:00 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:01 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:09:05 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681438130.133976, c63b62a9-626c-45ca-a454-4840f51bb28c => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:09:05 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] VM Stopped (Lifecycle Event)
Apr 14 02:09:05 user nova-compute[71498]: DEBUG nova.compute.manager [None req-b3188c07-a2a5-410e-add8-ff58382114f7 None None] [instance: c63b62a9-626c-45ca-a454-4840f51bb28c] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:09:05 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:09:05 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 02:09:05 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:09:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d34cd1eb-6a29-4ac9-a296-3c0c1d6b5611 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "5ba29111-1e9b-4947-b046-6bbe888eca06" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:09:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d34cd1eb-6a29-4ac9-a296-3c0c1d6b5611 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "5ba29111-1e9b-4947-b046-6bbe888eca06" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:09:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d34cd1eb-6a29-4ac9-a296-3c0c1d6b5611 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "5ba29111-1e9b-4947-b046-6bbe888eca06-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:09:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d34cd1eb-6a29-4ac9-a296-3c0c1d6b5611 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "5ba29111-1e9b-4947-b046-6bbe888eca06-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:09:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d34cd1eb-6a29-4ac9-a296-3c0c1d6b5611 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "5ba29111-1e9b-4947-b046-6bbe888eca06-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:09:08 user nova-compute[71498]: INFO nova.compute.manager [None req-d34cd1eb-6a29-4ac9-a296-3c0c1d6b5611 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Terminating instance
Apr 14 02:09:08 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d34cd1eb-6a29-4ac9-a296-3c0c1d6b5611 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 02:09:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:09 user nova-compute[71498]: DEBUG nova.compute.manager [req-0e3d91f4-f19b-48fa-ac85-7899a79cb3f8 req-e846918b-e315-40b3-ab19-99a623cfda09 service nova] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Received event network-vif-unplugged-5b8a0a31-9ecf-4b31-a458-778005d846f4 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:09:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0e3d91f4-f19b-48fa-ac85-7899a79cb3f8 req-e846918b-e315-40b3-ab19-99a623cfda09 service nova] Acquiring lock "5ba29111-1e9b-4947-b046-6bbe888eca06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:09:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0e3d91f4-f19b-48fa-ac85-7899a79cb3f8 req-e846918b-e315-40b3-ab19-99a623cfda09 service nova] Lock "5ba29111-1e9b-4947-b046-6bbe888eca06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:09:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0e3d91f4-f19b-48fa-ac85-7899a79cb3f8 req-e846918b-e315-40b3-ab19-99a623cfda09 service nova] Lock "5ba29111-1e9b-4947-b046-6bbe888eca06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:09:09 user nova-compute[71498]: DEBUG nova.compute.manager [req-0e3d91f4-f19b-48fa-ac85-7899a79cb3f8 req-e846918b-e315-40b3-ab19-99a623cfda09 service nova] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] No waiting events found dispatching network-vif-unplugged-5b8a0a31-9ecf-4b31-a458-778005d846f4 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:09:09 user nova-compute[71498]: DEBUG nova.compute.manager [req-0e3d91f4-f19b-48fa-ac85-7899a79cb3f8 req-e846918b-e315-40b3-ab19-99a623cfda09 service nova] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Received event network-vif-unplugged-5b8a0a31-9ecf-4b31-a458-778005d846f4 for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 02:09:09 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Instance destroyed successfully.
Apr 14 02:09:09 user nova-compute[71498]: DEBUG nova.objects.instance [None req-d34cd1eb-6a29-4ac9-a296-3c0c1d6b5611 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lazy-loading 'resources' on Instance uuid 5ba29111-1e9b-4947-b046-6bbe888eca06 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:09:09 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-d34cd1eb-6a29-4ac9-a296-3c0c1d6b5611 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:59:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1095400783',display_name='tempest-ServerActionsTestJSON-server-1095400783',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1095400783',id=34,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7iIvlhM+wCditCRaonOriLx8WWyehY8kYxTUZ36Z1Q4VGm2JnuefQ18D+1ncnGXJXgbpg/EWHmDPRQFx9TQ2PBQ5aNgSGRUcq/Ovi+zGjOYQDNVYkQyEvsulSNtijWoQ==',key_name='tempest-keypair-165395776',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:59:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ed4ed4ab2fd4c14b3e2afe343fd7256',ramdisk_id='',reservation_id='r-qvoej0va',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-2035821517',owner_user_name='tempest-ServerActionsTestJSON-2035821517-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:59:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78ccd1a1ec1b486981d850881734fe02',uuid=5ba29111-1e9b-4947-b046-6bbe888eca06,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b8a0a31-9ecf-4b31-a458-778005d846f4", "address": "fa:16:3e:90:92:14", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8a0a31-9e", "ovs_interfaceid": "5b8a0a31-9ecf-4b31-a458-778005d846f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 02:09:09 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-d34cd1eb-6a29-4ac9-a296-3c0c1d6b5611 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converting VIF {"id": "5b8a0a31-9ecf-4b31-a458-778005d846f4", "address": "fa:16:3e:90:92:14", "network": {"id": "c74d53a0-681c-4b19-b3a3-f51d6cfc7775", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1797376284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ed4ed4ab2fd4c14b3e2afe343fd7256", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b8a0a31-9e", "ovs_interfaceid": "5b8a0a31-9ecf-4b31-a458-778005d846f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:09:09 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-d34cd1eb-6a29-4ac9-a296-3c0c1d6b5611 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:92:14,bridge_name='br-int',has_traffic_filtering=True,id=5b8a0a31-9ecf-4b31-a458-778005d846f4,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b8a0a31-9e') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:09:09 user nova-compute[71498]: DEBUG os_vif [None req-d34cd1eb-6a29-4ac9-a296-3c0c1d6b5611 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:92:14,bridge_name='br-int',has_traffic_filtering=True,id=5b8a0a31-9ecf-4b31-a458-778005d846f4,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b8a0a31-9e') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 02:09:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b8a0a31-9e, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:09:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:09 user nova-compute[71498]: INFO os_vif [None req-d34cd1eb-6a29-4ac9-a296-3c0c1d6b5611 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:92:14,bridge_name='br-int',has_traffic_filtering=True,id=5b8a0a31-9ecf-4b31-a458-778005d846f4,network=Network(c74d53a0-681c-4b19-b3a3-f51d6cfc7775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b8a0a31-9e')
Apr 14 02:09:09 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-d34cd1eb-6a29-4ac9-a296-3c0c1d6b5611 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Deleting instance files /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06_del
Apr 14 02:09:09 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-d34cd1eb-6a29-4ac9-a296-3c0c1d6b5611 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Deletion of /opt/stack/data/nova/instances/5ba29111-1e9b-4947-b046-6bbe888eca06_del complete
Apr 14 02:09:09 user nova-compute[71498]: INFO nova.compute.manager [None req-d34cd1eb-6a29-4ac9-a296-3c0c1d6b5611 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 14 02:09:09 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-d34cd1eb-6a29-4ac9-a296-3c0c1d6b5611 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 02:09:09 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 02:09:09 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 02:09:10 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:09:10 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Took 0.75 seconds to deallocate network for instance.
Apr 14 02:09:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d34cd1eb-6a29-4ac9-a296-3c0c1d6b5611 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:09:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d34cd1eb-6a29-4ac9-a296-3c0c1d6b5611 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:09:10 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d34cd1eb-6a29-4ac9-a296-3c0c1d6b5611 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:09:10 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d34cd1eb-6a29-4ac9-a296-3c0c1d6b5611 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:09:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d34cd1eb-6a29-4ac9-a296-3c0c1d6b5611 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.197s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:09:10 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-d34cd1eb-6a29-4ac9-a296-3c0c1d6b5611 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Deleted allocations for instance 5ba29111-1e9b-4947-b046-6bbe888eca06
Apr 14 02:09:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d34cd1eb-6a29-4ac9-a296-3c0c1d6b5611 tempest-ServerActionsTestJSON-2035821517 tempest-ServerActionsTestJSON-2035821517-project-member] Lock "5ba29111-1e9b-4947-b046-6bbe888eca06" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.974s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:09:11 user nova-compute[71498]: DEBUG nova.compute.manager [req-6cf8ff18-0572-4ba8-907c-fa7d4a574d0b req-11d61794-88f3-439f-9fba-2775252e4a47 service nova] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Received event network-vif-plugged-5b8a0a31-9ecf-4b31-a458-778005d846f4 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:09:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6cf8ff18-0572-4ba8-907c-fa7d4a574d0b req-11d61794-88f3-439f-9fba-2775252e4a47 service nova] Acquiring lock "5ba29111-1e9b-4947-b046-6bbe888eca06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:09:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6cf8ff18-0572-4ba8-907c-fa7d4a574d0b req-11d61794-88f3-439f-9fba-2775252e4a47 service nova] Lock "5ba29111-1e9b-4947-b046-6bbe888eca06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:09:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6cf8ff18-0572-4ba8-907c-fa7d4a574d0b req-11d61794-88f3-439f-9fba-2775252e4a47 service nova] Lock "5ba29111-1e9b-4947-b046-6bbe888eca06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:09:11 user nova-compute[71498]: DEBUG nova.compute.manager [req-6cf8ff18-0572-4ba8-907c-fa7d4a574d0b req-11d61794-88f3-439f-9fba-2775252e4a47 service nova] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] No waiting events found dispatching network-vif-plugged-5b8a0a31-9ecf-4b31-a458-778005d846f4 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:09:11 user nova-compute[71498]: WARNING nova.compute.manager [req-6cf8ff18-0572-4ba8-907c-fa7d4a574d0b req-11d61794-88f3-439f-9fba-2775252e4a47 service nova] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Received unexpected event network-vif-plugged-5b8a0a31-9ecf-4b31-a458-778005d846f4 for instance with vm_state deleted and task_state None.
Apr 14 02:09:11 user nova-compute[71498]: DEBUG nova.compute.manager [req-6cf8ff18-0572-4ba8-907c-fa7d4a574d0b req-11d61794-88f3-439f-9fba-2775252e4a47 service nova] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Received event network-vif-deleted-5b8a0a31-9ecf-4b31-a458-778005d846f4 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:09:14 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:15 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:19 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a7b1c31f-92a3-423c-8e01-621428d1b6d2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "57b15ad5-341a-47f8-9e3e-5cec8a85098a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:09:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a7b1c31f-92a3-423c-8e01-621428d1b6d2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "57b15ad5-341a-47f8-9e3e-5cec8a85098a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:09:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a7b1c31f-92a3-423c-8e01-621428d1b6d2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "57b15ad5-341a-47f8-9e3e-5cec8a85098a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:09:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a7b1c31f-92a3-423c-8e01-621428d1b6d2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "57b15ad5-341a-47f8-9e3e-5cec8a85098a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:09:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a7b1c31f-92a3-423c-8e01-621428d1b6d2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "57b15ad5-341a-47f8-9e3e-5cec8a85098a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:09:20 user nova-compute[71498]: INFO nova.compute.manager [None req-a7b1c31f-92a3-423c-8e01-621428d1b6d2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Terminating instance
Apr 14 02:09:20 user nova-compute[71498]: DEBUG nova.compute.manager [None req-a7b1c31f-92a3-423c-8e01-621428d1b6d2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 02:09:20 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:20 user nova-compute[71498]: DEBUG nova.compute.manager [req-8a463ca9-0dd6-4fdd-8c45-3e0a36350d9d req-93853ed1-0be3-46c6-a940-3ccf1fb810b7 service nova] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Received event network-changed-18eed24e-8acb-457c-95b8-64c141faa4aa {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:09:20 user nova-compute[71498]: DEBUG nova.compute.manager [req-8a463ca9-0dd6-4fdd-8c45-3e0a36350d9d req-93853ed1-0be3-46c6-a940-3ccf1fb810b7 service nova] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Refreshing instance network info cache due to event network-changed-18eed24e-8acb-457c-95b8-64c141faa4aa. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 02:09:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8a463ca9-0dd6-4fdd-8c45-3e0a36350d9d req-93853ed1-0be3-46c6-a940-3ccf1fb810b7 service nova] Acquiring lock "refresh_cache-57b15ad5-341a-47f8-9e3e-5cec8a85098a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:09:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8a463ca9-0dd6-4fdd-8c45-3e0a36350d9d req-93853ed1-0be3-46c6-a940-3ccf1fb810b7 service nova] Acquired lock "refresh_cache-57b15ad5-341a-47f8-9e3e-5cec8a85098a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:09:20 user nova-compute[71498]: DEBUG nova.network.neutron [req-8a463ca9-0dd6-4fdd-8c45-3e0a36350d9d req-93853ed1-0be3-46c6-a940-3ccf1fb810b7 service nova] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Refreshing network info cache for port 18eed24e-8acb-457c-95b8-64c141faa4aa {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 02:09:20 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:20 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:20 user nova-compute[71498]: DEBUG nova.compute.manager [req-7109a6b7-a833-4890-b0f7-fa27ac607a25 req-da43a2d5-41f9-47f8-a90b-a166ce5c998e service nova] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Received event network-vif-unplugged-18eed24e-8acb-457c-95b8-64c141faa4aa {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:09:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7109a6b7-a833-4890-b0f7-fa27ac607a25 req-da43a2d5-41f9-47f8-a90b-a166ce5c998e service nova] Acquiring lock "57b15ad5-341a-47f8-9e3e-5cec8a85098a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:09:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7109a6b7-a833-4890-b0f7-fa27ac607a25 req-da43a2d5-41f9-47f8-a90b-a166ce5c998e service nova] Lock "57b15ad5-341a-47f8-9e3e-5cec8a85098a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:09:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7109a6b7-a833-4890-b0f7-fa27ac607a25 req-da43a2d5-41f9-47f8-a90b-a166ce5c998e service nova] Lock "57b15ad5-341a-47f8-9e3e-5cec8a85098a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:09:20 user nova-compute[71498]: DEBUG nova.compute.manager [req-7109a6b7-a833-4890-b0f7-fa27ac607a25 req-da43a2d5-41f9-47f8-a90b-a166ce5c998e service nova] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] No waiting events found dispatching network-vif-unplugged-18eed24e-8acb-457c-95b8-64c141faa4aa {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:09:20 user nova-compute[71498]: DEBUG nova.compute.manager [req-7109a6b7-a833-4890-b0f7-fa27ac607a25 req-da43a2d5-41f9-47f8-a90b-a166ce5c998e service nova] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Received event network-vif-unplugged-18eed24e-8acb-457c-95b8-64c141faa4aa for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 02:09:21 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Instance destroyed successfully.
Apr 14 02:09:21 user nova-compute[71498]: DEBUG nova.objects.instance [None req-a7b1c31f-92a3-423c-8e01-621428d1b6d2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lazy-loading 'resources' on Instance uuid 57b15ad5-341a-47f8-9e3e-5cec8a85098a {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:09:21 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-a7b1c31f-92a3-423c-8e01-621428d1b6d2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:02:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-237482406',display_name='tempest-TestStampPattern-server-237482406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-237482406',id=37,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN71XmYAhugQNhgl+EJR/4+t7AjKtKkpcGBG8gx2VPAwa0I3bKysgOFGLrmgG1OeFgwpiuJDroargohcSM2hH/0cqZkFOvlkmK46/6QQTJRBUwCSuTngzFe2HQ0i1G666A==',key_name='tempest-TestStampPattern-610075453',keypairs=<?>,launch_index=0,launched_at=2023-04-14T02:02:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27dc405e16434633956ed2cd7e1791cd',ramdisk_id='',reservation_id='r-0y7kuukr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-190654074',owner_user_name='tempest-TestStampPattern-190654074-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T02:05:27Z,user_data=None,user_id='7ae5170969344b9fa5294231f8ffbe72',uuid=57b15ad5-341a-47f8-9e3e-5cec8a85098a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18eed24e-8acb-457c-95b8-64c141faa4aa", "address": "fa:16:3e:8a:75:08", "network": {"id": "d099696f-2c31-4ce1-89d8-680d87d17b9b", "bridge": "br-int", "label": "tempest-TestStampPattern-665967680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27dc405e16434633956ed2cd7e1791cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18eed24e-8a", "ovs_interfaceid": "18eed24e-8acb-457c-95b8-64c141faa4aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 02:09:21 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-a7b1c31f-92a3-423c-8e01-621428d1b6d2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Converting VIF {"id": "18eed24e-8acb-457c-95b8-64c141faa4aa", "address": "fa:16:3e:8a:75:08", "network": {"id": "d099696f-2c31-4ce1-89d8-680d87d17b9b", "bridge": "br-int", "label": "tempest-TestStampPattern-665967680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27dc405e16434633956ed2cd7e1791cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18eed24e-8a", "ovs_interfaceid": "18eed24e-8acb-457c-95b8-64c141faa4aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:09:21 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-a7b1c31f-92a3-423c-8e01-621428d1b6d2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:75:08,bridge_name='br-int',has_traffic_filtering=True,id=18eed24e-8acb-457c-95b8-64c141faa4aa,network=Network(d099696f-2c31-4ce1-89d8-680d87d17b9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18eed24e-8a') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:09:21 user nova-compute[71498]: DEBUG os_vif [None req-a7b1c31f-92a3-423c-8e01-621428d1b6d2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:75:08,bridge_name='br-int',has_traffic_filtering=True,id=18eed24e-8acb-457c-95b8-64c141faa4aa,network=Network(d099696f-2c31-4ce1-89d8-680d87d17b9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18eed24e-8a') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 02:09:21 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:21 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18eed24e-8a, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:09:21 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:21 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:09:21 user nova-compute[71498]: INFO os_vif [None req-a7b1c31f-92a3-423c-8e01-621428d1b6d2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:75:08,bridge_name='br-int',has_traffic_filtering=True,id=18eed24e-8acb-457c-95b8-64c141faa4aa,network=Network(d099696f-2c31-4ce1-89d8-680d87d17b9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18eed24e-8a')
Apr 14 02:09:21 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-a7b1c31f-92a3-423c-8e01-621428d1b6d2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Deleting instance files /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a_del
Apr 14 02:09:21 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-a7b1c31f-92a3-423c-8e01-621428d1b6d2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Deletion of /opt/stack/data/nova/instances/57b15ad5-341a-47f8-9e3e-5cec8a85098a_del complete
Apr 14 02:09:21 user nova-compute[71498]: DEBUG nova.network.neutron [req-8a463ca9-0dd6-4fdd-8c45-3e0a36350d9d req-93853ed1-0be3-46c6-a940-3ccf1fb810b7 service nova] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Updated VIF entry in instance network info cache for port 18eed24e-8acb-457c-95b8-64c141faa4aa. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 02:09:21 user nova-compute[71498]: DEBUG nova.network.neutron [req-8a463ca9-0dd6-4fdd-8c45-3e0a36350d9d req-93853ed1-0be3-46c6-a940-3ccf1fb810b7 service nova] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Updating instance_info_cache with network_info: [{"id": "18eed24e-8acb-457c-95b8-64c141faa4aa", "address": "fa:16:3e:8a:75:08", "network": {"id": "d099696f-2c31-4ce1-89d8-680d87d17b9b", "bridge": "br-int", "label": "tempest-TestStampPattern-665967680-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27dc405e16434633956ed2cd7e1791cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18eed24e-8a", "ovs_interfaceid": "18eed24e-8acb-457c-95b8-64c141faa4aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:09:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8a463ca9-0dd6-4fdd-8c45-3e0a36350d9d req-93853ed1-0be3-46c6-a940-3ccf1fb810b7 service nova] Releasing lock "refresh_cache-57b15ad5-341a-47f8-9e3e-5cec8a85098a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:09:21 user nova-compute[71498]: INFO nova.compute.manager [None req-a7b1c31f-92a3-423c-8e01-621428d1b6d2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 14 02:09:21 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-a7b1c31f-92a3-423c-8e01-621428d1b6d2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 02:09:21 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 02:09:21 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 02:09:21 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:22 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:09:22 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Took 0.99 seconds to deallocate network for instance.
Apr 14 02:09:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a7b1c31f-92a3-423c-8e01-621428d1b6d2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:09:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a7b1c31f-92a3-423c-8e01-621428d1b6d2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:09:22 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-a7b1c31f-92a3-423c-8e01-621428d1b6d2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:09:22 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-a7b1c31f-92a3-423c-8e01-621428d1b6d2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:09:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a7b1c31f-92a3-423c-8e01-621428d1b6d2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.158s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:09:22 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-a7b1c31f-92a3-423c-8e01-621428d1b6d2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Deleted allocations for instance 57b15ad5-341a-47f8-9e3e-5cec8a85098a
Apr 14 02:09:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-a7b1c31f-92a3-423c-8e01-621428d1b6d2 tempest-TestStampPattern-190654074 tempest-TestStampPattern-190654074-project-member] Lock "57b15ad5-341a-47f8-9e3e-5cec8a85098a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.228s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:09:22 user nova-compute[71498]: DEBUG nova.compute.manager [req-09e5c406-6cb5-4dc1-ac0e-c2f30cdb16d6 req-9179aa33-a925-4f45-a9d7-df410e94f2b1 service nova] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Received event network-vif-plugged-18eed24e-8acb-457c-95b8-64c141faa4aa {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:09:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-09e5c406-6cb5-4dc1-ac0e-c2f30cdb16d6 req-9179aa33-a925-4f45-a9d7-df410e94f2b1 service nova] Acquiring lock "57b15ad5-341a-47f8-9e3e-5cec8a85098a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:09:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-09e5c406-6cb5-4dc1-ac0e-c2f30cdb16d6 req-9179aa33-a925-4f45-a9d7-df410e94f2b1 service nova] Lock "57b15ad5-341a-47f8-9e3e-5cec8a85098a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:09:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-09e5c406-6cb5-4dc1-ac0e-c2f30cdb16d6 req-9179aa33-a925-4f45-a9d7-df410e94f2b1 service nova] Lock "57b15ad5-341a-47f8-9e3e-5cec8a85098a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:09:22 user nova-compute[71498]: DEBUG nova.compute.manager [req-09e5c406-6cb5-4dc1-ac0e-c2f30cdb16d6 req-9179aa33-a925-4f45-a9d7-df410e94f2b1 service nova] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] No waiting events found dispatching network-vif-plugged-18eed24e-8acb-457c-95b8-64c141faa4aa {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:09:22 user nova-compute[71498]: WARNING nova.compute.manager [req-09e5c406-6cb5-4dc1-ac0e-c2f30cdb16d6 req-9179aa33-a925-4f45-a9d7-df410e94f2b1 service nova] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Received unexpected event network-vif-plugged-18eed24e-8acb-457c-95b8-64c141faa4aa for instance with vm_state deleted and task_state None.
Apr 14 02:09:22 user nova-compute[71498]: DEBUG nova.compute.manager [req-09e5c406-6cb5-4dc1-ac0e-c2f30cdb16d6 req-9179aa33-a925-4f45-a9d7-df410e94f2b1 service nova] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Received event network-vif-deleted-18eed24e-8acb-457c-95b8-64c141faa4aa {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:09:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:24 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681438149.6147444, 5ba29111-1e9b-4947-b046-6bbe888eca06 => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:09:24 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] VM Stopped (Lifecycle Event)
Apr 14 02:09:24 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d77f9ba5-a024-43df-9b88-ebdd66890e5e None None] [instance: 5ba29111-1e9b-4947-b046-6bbe888eca06] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:09:26 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:09:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:09:28 user nova-compute[71498]: DEBUG nova.compute.manager [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 02:09:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:09:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:09:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:28 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 02:09:28 user nova-compute[71498]: INFO nova.compute.claims [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Claim successful on node user
Apr 14 02:09:28 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:09:28 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:09:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.194s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:09:28 user nova-compute[71498]: DEBUG nova.compute.manager [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 02:09:28 user nova-compute[71498]: DEBUG nova.compute.manager [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 02:09:28 user nova-compute[71498]: DEBUG nova.network.neutron [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 02:09:28 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 02:09:28 user nova-compute[71498]: DEBUG nova.compute.manager [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 02:09:28 user nova-compute[71498]: DEBUG nova.policy [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19633f8d769c4e50b5e6c9a75497b510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20723e8ba2f5480b8c17e6c4fc8fff9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 02:09:28 user nova-compute[71498]: DEBUG nova.compute.manager [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 02:09:28 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 02:09:28 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Creating image(s)
Apr 14 02:09:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "/opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:09:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "/opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:09:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "/opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:09:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "d04c3460e4b72ac20f143e769721db0d5b61f406" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:09:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "d04c3460e4b72ac20f143e769721db0d5b61f406" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:09:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d04c3460e4b72ac20f143e769721db0d5b61f406.part --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:09:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d04c3460e4b72ac20f143e769721db0d5b61f406.part --force-share --output=json" returned: 0 in 0.137s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:09:29 user nova-compute[71498]: DEBUG nova.virt.images [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] b0ff2602-d4a4-4cb3-95c3-5e9dfd3c74c5 was qcow2, converting to raw {{(pid=71498) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 02:09:29 user nova-compute[71498]: DEBUG nova.privsep.utils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71498) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 02:09:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d04c3460e4b72ac20f143e769721db0d5b61f406.part /opt/stack/data/nova/instances/_base/d04c3460e4b72ac20f143e769721db0d5b61f406.converted {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:09:29 user nova-compute[71498]: DEBUG nova.network.neutron [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Successfully created port: e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 02:09:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d04c3460e4b72ac20f143e769721db0d5b61f406.part /opt/stack/data/nova/instances/_base/d04c3460e4b72ac20f143e769721db0d5b61f406.converted" returned: 0 in 0.201s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:09:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d04c3460e4b72ac20f143e769721db0d5b61f406.converted --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:09:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d04c3460e4b72ac20f143e769721db0d5b61f406.converted --force-share --output=json" returned: 0 in 0.128s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:09:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "d04c3460e4b72ac20f143e769721db0d5b61f406" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.041s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:09:29 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d04c3460e4b72ac20f143e769721db0d5b61f406 --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d04c3460e4b72ac20f143e769721db0d5b61f406 --force-share --output=json" returned: 0 in 0.146s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "d04c3460e4b72ac20f143e769721db0d5b61f406" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "d04c3460e4b72ac20f143e769721db0d5b61f406" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d04c3460e4b72ac20f143e769721db0d5b61f406 --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d04c3460e4b72ac20f143e769721db0d5b61f406 --force-share --output=json" returned: 0 in 0.147s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d04c3460e4b72ac20f143e769721db0d5b61f406,backing_fmt=raw /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d04c3460e4b72ac20f143e769721db0d5b61f406,backing_fmt=raw /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk 1073741824" returned: 0 in 0.058s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "d04c3460e4b72ac20f143e769721db0d5b61f406" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d04c3460e4b72ac20f143e769721db0d5b61f406 --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.network.neutron [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Successfully updated port: e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "refresh_cache-9b29ba99-4234-4bbc-80a2-ad49127e8c9a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquired lock "refresh_cache-9b29ba99-4234-4bbc-80a2-ad49127e8c9a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.network.neutron [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.compute.manager [req-1bf5a664-aa08-4a92-8096-f9936a481c39 req-b514de87-af05-44e2-a7de-55ef32771c2e service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Received event network-changed-e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.compute.manager [req-1bf5a664-aa08-4a92-8096-f9936a481c39 req-b514de87-af05-44e2-a7de-55ef32771c2e service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Refreshing instance network info cache due to event network-changed-e204d7f5-314e-43ce-8772-e2f288f1858f. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1bf5a664-aa08-4a92-8096-f9936a481c39 req-b514de87-af05-44e2-a7de-55ef32771c2e service nova] Acquiring lock "refresh_cache-9b29ba99-4234-4bbc-80a2-ad49127e8c9a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.network.neutron [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d04c3460e4b72ac20f143e769721db0d5b61f406 --force-share --output=json" returned: 0 in 0.153s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Cannot resize image /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.objects.instance [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lazy-loading 'migration_context' on Instance uuid 9b29ba99-4234-4bbc-80a2-ad49127e8c9a {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Ensure instance console log exists: /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.network.neutron [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Updating instance_info_cache with network_info: [{"id": "e204d7f5-314e-43ce-8772-e2f288f1858f", "address": "fa:16:3e:30:bf:7a", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape204d7f5-31", "ovs_interfaceid": "e204d7f5-314e-43ce-8772-e2f288f1858f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Releasing lock "refresh_cache-9b29ba99-4234-4bbc-80a2-ad49127e8c9a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.compute.manager [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Instance network_info: |[{"id": "e204d7f5-314e-43ce-8772-e2f288f1858f", "address": "fa:16:3e:30:bf:7a", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape204d7f5-31", "ovs_interfaceid": "e204d7f5-314e-43ce-8772-e2f288f1858f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1bf5a664-aa08-4a92-8096-f9936a481c39 req-b514de87-af05-44e2-a7de-55ef32771c2e service nova] Acquired lock "refresh_cache-9b29ba99-4234-4bbc-80a2-ad49127e8c9a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.network.neutron [req-1bf5a664-aa08-4a92-8096-f9936a481c39 req-b514de87-af05-44e2-a7de-55ef32771c2e service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Refreshing network info cache for port e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Start _get_guest_xml network_info=[{"id": "e204d7f5-314e-43ce-8772-e2f288f1858f", "address": "fa:16:3e:30:bf:7a", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape204d7f5-31", "ovs_interfaceid": "e204d7f5-314e-43ce-8772-e2f288f1858f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T02:09:26Z,direct_url=<?>,disk_format='qcow2',id=b0ff2602-d4a4-4cb3-95c3-5e9dfd3c74c5,min_disk=0,min_ram=0,name='tempest-scenario-img--843011405',owner='20723e8ba2f5480b8c17e6c4fc8fff9f',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T02:09:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b0ff2602-d4a4-4cb3-95c3-5e9dfd3c74c5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 02:09:30 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:09:30 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T02:09:26Z,direct_url=<?>,disk_format='qcow2',id=b0ff2602-d4a4-4cb3-95c3-5e9dfd3c74c5,min_disk=0,min_ram=0,name='tempest-scenario-img--843011405',owner='20723e8ba2f5480b8c17e6c4fc8fff9f',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T02:09:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:09:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-435405212',display_name='tempest-TestMinimumBasicScenario-server-435405212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-435405212',id=42,image_ref='b0ff2602-d4a4-4cb3-95c3-5e9dfd3c74c5',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtEzsPoBbdFHW/OauW1N2nA3eHApzo9P+avktVZiY+BDznrsT5FrpFSwKh0+oQn87dy12kX9i8d8dwF2rJqPbbOiawNN4AoRze6n/YxMVSWae21mhWOZtM+ldYOp4zong==',key_name='tempest-TestMinimumBasicScenario-1668215586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20723e8ba2f5480b8c17e6c4fc8fff9f',ramdisk_id='',reservation_id='r-cbhvzk20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b0ff2602-d4a4-4cb3-95c3-5e9dfd3c74c5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1976287714',owner_user_name='tempest-TestMinimumBasicScenario-1976287714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T02:09:29Z,user_data=None,user_id='19633f8d769c4e50b5e6c9a75497b510',uuid=9b29ba99-4234-4bbc-80a2-ad49127e8c9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e204d7f5-314e-43ce-8772-e2f288f1858f", "address": "fa:16:3e:30:bf:7a", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape204d7f5-31", "ovs_interfaceid": "e204d7f5-314e-43ce-8772-e2f288f1858f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Converting VIF {"id": "e204d7f5-314e-43ce-8772-e2f288f1858f", "address": "fa:16:3e:30:bf:7a", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape204d7f5-31", "ovs_interfaceid": "e204d7f5-314e-43ce-8772-e2f288f1858f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:bf:7a,bridge_name='br-int',has_traffic_filtering=True,id=e204d7f5-314e-43ce-8772-e2f288f1858f,network=Network(6a2a0716-97e3-42a7-bdf8-5f5548cf550b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape204d7f5-31') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.objects.instance [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b29ba99-4234-4bbc-80a2-ad49127e8c9a {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] End _get_guest_xml xml=<domain type="kvm">
Apr 14 02:09:30 user nova-compute[71498]:   <uuid>9b29ba99-4234-4bbc-80a2-ad49127e8c9a</uuid>
Apr 14 02:09:30 user nova-compute[71498]:   <name>instance-0000002a</name>
Apr 14 02:09:30 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 02:09:30 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 02:09:30 user nova-compute[71498]:   <metadata>
Apr 14 02:09:30 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 02:09:30 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 02:09:30 user nova-compute[71498]:       <nova:name>tempest-TestMinimumBasicScenario-server-435405212</nova:name>
Apr 14 02:09:30 user nova-compute[71498]:       <nova:creationTime>2023-04-14 02:09:30</nova:creationTime>
Apr 14 02:09:30 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 02:09:30 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 02:09:30 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 02:09:30 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 02:09:30 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 02:09:30 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 02:09:30 user nova-compute[71498]:       </nova:flavor>
Apr 14 02:09:30 user nova-compute[71498]:       <nova:owner>
Apr 14 02:09:30 user nova-compute[71498]:         <nova:user uuid="19633f8d769c4e50b5e6c9a75497b510">tempest-TestMinimumBasicScenario-1976287714-project-member</nova:user>
Apr 14 02:09:30 user nova-compute[71498]:         <nova:project uuid="20723e8ba2f5480b8c17e6c4fc8fff9f">tempest-TestMinimumBasicScenario-1976287714</nova:project>
Apr 14 02:09:30 user nova-compute[71498]:       </nova:owner>
Apr 14 02:09:30 user nova-compute[71498]:       <nova:root type="image" uuid="b0ff2602-d4a4-4cb3-95c3-5e9dfd3c74c5"/>
Apr 14 02:09:30 user nova-compute[71498]:       <nova:ports>
Apr 14 02:09:30 user nova-compute[71498]:         <nova:port uuid="e204d7f5-314e-43ce-8772-e2f288f1858f">
Apr 14 02:09:30 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 02:09:30 user nova-compute[71498]:         </nova:port>
Apr 14 02:09:30 user nova-compute[71498]:       </nova:ports>
Apr 14 02:09:30 user nova-compute[71498]:     </nova:instance>
Apr 14 02:09:30 user nova-compute[71498]:   </metadata>
Apr 14 02:09:30 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 02:09:30 user nova-compute[71498]:     <system>
Apr 14 02:09:30 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 02:09:30 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 02:09:30 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 02:09:30 user nova-compute[71498]:       <entry name="serial">9b29ba99-4234-4bbc-80a2-ad49127e8c9a</entry>
Apr 14 02:09:30 user nova-compute[71498]:       <entry name="uuid">9b29ba99-4234-4bbc-80a2-ad49127e8c9a</entry>
Apr 14 02:09:30 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 02:09:30 user nova-compute[71498]:     </system>
Apr 14 02:09:30 user nova-compute[71498]:   </sysinfo>
Apr 14 02:09:30 user nova-compute[71498]:   <os>
Apr 14 02:09:30 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 02:09:30 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 02:09:30 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 02:09:30 user nova-compute[71498]:   </os>
Apr 14 02:09:30 user nova-compute[71498]:   <features>
Apr 14 02:09:30 user nova-compute[71498]:     <acpi/>
Apr 14 02:09:30 user nova-compute[71498]:     <apic/>
Apr 14 02:09:30 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 02:09:30 user nova-compute[71498]:   </features>
Apr 14 02:09:30 user nova-compute[71498]:   <clock offset="utc">
Apr 14 02:09:30 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 02:09:30 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 02:09:30 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 02:09:30 user nova-compute[71498]:   </clock>
Apr 14 02:09:30 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 02:09:30 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 02:09:30 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 02:09:30 user nova-compute[71498]:   </cpu>
Apr 14 02:09:30 user nova-compute[71498]:   <devices>
Apr 14 02:09:30 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 02:09:30 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 02:09:30 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk"/>
Apr 14 02:09:30 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 02:09:30 user nova-compute[71498]:     </disk>
Apr 14 02:09:30 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 02:09:30 user nova-compute[71498]:       <mac address="fa:16:3e:30:bf:7a"/>
Apr 14 02:09:30 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 02:09:30 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 02:09:30 user nova-compute[71498]:       <target dev="tape204d7f5-31"/>
Apr 14 02:09:30 user nova-compute[71498]:     </interface>
Apr 14 02:09:30 user nova-compute[71498]:     <serial type="pty">
Apr 14 02:09:30 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/console.log" append="off"/>
Apr 14 02:09:30 user nova-compute[71498]:     </serial>
Apr 14 02:09:30 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 02:09:30 user nova-compute[71498]:     <video>
Apr 14 02:09:30 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 02:09:30 user nova-compute[71498]:     </video>
Apr 14 02:09:30 user nova-compute[71498]:     <rng model="virtio">
Apr 14 02:09:30 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 02:09:30 user nova-compute[71498]:     </rng>
Apr 14 02:09:30 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 02:09:30 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 02:09:30 user nova-compute[71498]:       <stats period="10"/>
Apr 14 02:09:30 user nova-compute[71498]:     </memballoon>
Apr 14 02:09:30 user nova-compute[71498]:   </devices>
Apr 14 02:09:30 user nova-compute[71498]: </domain>
Apr 14 02:09:30 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:09:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-435405212',display_name='tempest-TestMinimumBasicScenario-server-435405212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-435405212',id=42,image_ref='b0ff2602-d4a4-4cb3-95c3-5e9dfd3c74c5',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtEzsPoBbdFHW/OauW1N2nA3eHApzo9P+avktVZiY+BDznrsT5FrpFSwKh0+oQn87dy12kX9i8d8dwF2rJqPbbOiawNN4AoRze6n/YxMVSWae21mhWOZtM+ldYOp4zong==',key_name='tempest-TestMinimumBasicScenario-1668215586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20723e8ba2f5480b8c17e6c4fc8fff9f',ramdisk_id='',reservation_id='r-cbhvzk20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b0ff2602-d4a4-4cb3-95c3-5e9dfd3c74c5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1976287714',owner_user_name='tempest-TestMinimumBasicScenario-1976287714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T02:09:29Z,user_data=None,user_id='19633f8d769c4e50b5e6c9a75497b510',uuid=9b29ba99-4234-4bbc-80a2-ad49127e8c9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e204d7f5-314e-43ce-8772-e2f288f1858f", "address": "fa:16:3e:30:bf:7a", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape204d7f5-31", "ovs_interfaceid": "e204d7f5-314e-43ce-8772-e2f288f1858f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Converting VIF {"id": "e204d7f5-314e-43ce-8772-e2f288f1858f", "address": "fa:16:3e:30:bf:7a", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape204d7f5-31", "ovs_interfaceid": "e204d7f5-314e-43ce-8772-e2f288f1858f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:bf:7a,bridge_name='br-int',has_traffic_filtering=True,id=e204d7f5-314e-43ce-8772-e2f288f1858f,network=Network(6a2a0716-97e3-42a7-bdf8-5f5548cf550b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape204d7f5-31') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG os_vif [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:bf:7a,bridge_name='br-int',has_traffic_filtering=True,id=e204d7f5-314e-43ce-8772-e2f288f1858f,network=Network(6a2a0716-97e3-42a7-bdf8-5f5548cf550b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape204d7f5-31') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape204d7f5-31, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape204d7f5-31, col_values=(('external_ids', {'iface-id': 'e204d7f5-314e-43ce-8772-e2f288f1858f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:bf:7a', 'vm-uuid': '9b29ba99-4234-4bbc-80a2-ad49127e8c9a'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:30 user nova-compute[71498]: INFO os_vif [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:bf:7a,bridge_name='br-int',has_traffic_filtering=True,id=e204d7f5-314e-43ce-8772-e2f288f1858f,network=Network(6a2a0716-97e3-42a7-bdf8-5f5548cf550b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape204d7f5-31')
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:09:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] No VIF found with MAC fa:16:3e:30:bf:7a, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 02:09:31 user nova-compute[71498]: DEBUG nova.network.neutron [req-1bf5a664-aa08-4a92-8096-f9936a481c39 req-b514de87-af05-44e2-a7de-55ef32771c2e service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Updated VIF entry in instance network info cache for port e204d7f5-314e-43ce-8772-e2f288f1858f. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 02:09:31 user nova-compute[71498]: DEBUG nova.network.neutron [req-1bf5a664-aa08-4a92-8096-f9936a481c39 req-b514de87-af05-44e2-a7de-55ef32771c2e service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Updating instance_info_cache with network_info: [{"id": "e204d7f5-314e-43ce-8772-e2f288f1858f", "address": "fa:16:3e:30:bf:7a", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape204d7f5-31", "ovs_interfaceid": "e204d7f5-314e-43ce-8772-e2f288f1858f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:09:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1bf5a664-aa08-4a92-8096-f9936a481c39 req-b514de87-af05-44e2-a7de-55ef32771c2e service nova] Releasing lock "refresh_cache-9b29ba99-4234-4bbc-80a2-ad49127e8c9a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:09:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:32 user nova-compute[71498]: DEBUG nova.compute.manager [req-ef295a4a-2ae6-4246-a56c-14f2bb5e8ec5 req-9cf2559d-8906-41f1-9556-b027b828a0d9 service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Received event network-vif-plugged-e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:09:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ef295a4a-2ae6-4246-a56c-14f2bb5e8ec5 req-9cf2559d-8906-41f1-9556-b027b828a0d9 service nova] Acquiring lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:09:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ef295a4a-2ae6-4246-a56c-14f2bb5e8ec5 req-9cf2559d-8906-41f1-9556-b027b828a0d9 service nova] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:09:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ef295a4a-2ae6-4246-a56c-14f2bb5e8ec5 req-9cf2559d-8906-41f1-9556-b027b828a0d9 service nova] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:09:32 user nova-compute[71498]: DEBUG nova.compute.manager [req-ef295a4a-2ae6-4246-a56c-14f2bb5e8ec5 req-9cf2559d-8906-41f1-9556-b027b828a0d9 service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] No waiting events found dispatching network-vif-plugged-e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:09:32 user nova-compute[71498]: WARNING nova.compute.manager [req-ef295a4a-2ae6-4246-a56c-14f2bb5e8ec5 req-9cf2559d-8906-41f1-9556-b027b828a0d9 service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Received unexpected event network-vif-plugged-e204d7f5-314e-43ce-8772-e2f288f1858f for instance with vm_state building and task_state spawning.
Apr 14 02:09:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:34 user nova-compute[71498]: DEBUG nova.compute.manager [req-697cbc47-ccda-497b-85bf-c3131f7eb689 req-807c9427-c883-4ff9-b9c0-3bc43098904f service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Received event network-vif-plugged-e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:09:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-697cbc47-ccda-497b-85bf-c3131f7eb689 req-807c9427-c883-4ff9-b9c0-3bc43098904f service nova] Acquiring lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:09:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-697cbc47-ccda-497b-85bf-c3131f7eb689 req-807c9427-c883-4ff9-b9c0-3bc43098904f service nova] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:09:34 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-697cbc47-ccda-497b-85bf-c3131f7eb689 req-807c9427-c883-4ff9-b9c0-3bc43098904f service nova] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:09:34 user nova-compute[71498]: DEBUG nova.compute.manager [req-697cbc47-ccda-497b-85bf-c3131f7eb689 req-807c9427-c883-4ff9-b9c0-3bc43098904f service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] No waiting events found dispatching network-vif-plugged-e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:09:34 user nova-compute[71498]: WARNING nova.compute.manager [req-697cbc47-ccda-497b-85bf-c3131f7eb689 req-807c9427-c883-4ff9-b9c0-3bc43098904f service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Received unexpected event network-vif-plugged-e204d7f5-314e-43ce-8772-e2f288f1858f for instance with vm_state building and task_state spawning.
Apr 14 02:09:34 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681438174.8102336, 9b29ba99-4234-4bbc-80a2-ad49127e8c9a => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:09:34 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] VM Resumed (Lifecycle Event)
Apr 14 02:09:34 user nova-compute[71498]: DEBUG nova.compute.manager [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 02:09:34 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 02:09:34 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Instance spawned successfully.
Apr 14 02:09:34 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 02:09:34 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:09:34 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 02:09:34 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:09:34 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:09:34 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:09:34 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:09:34 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:09:34 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:09:34 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 02:09:34 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681438174.81419, 9b29ba99-4234-4bbc-80a2-ad49127e8c9a => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:09:34 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] VM Started (Lifecycle Event)
Apr 14 02:09:34 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:09:34 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 02:09:34 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 02:09:34 user nova-compute[71498]: INFO nova.compute.manager [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Took 6.02 seconds to spawn the instance on the hypervisor.
Apr 14 02:09:34 user nova-compute[71498]: DEBUG nova.compute.manager [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:09:34 user nova-compute[71498]: INFO nova.compute.manager [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Took 6.51 seconds to build instance.
Apr 14 02:09:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-6481150a-4c00-420b-94c2-2218a6d9be16 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.608s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:09:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:36 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681438161.2707171, 57b15ad5-341a-47f8-9e3e-5cec8a85098a => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:09:36 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] VM Stopped (Lifecycle Event)
Apr 14 02:09:36 user nova-compute[71498]: DEBUG nova.compute.manager [None req-02d64d03-8574-4c27-9443-b5269cac4b34 None None] [instance: 57b15ad5-341a-47f8-9e3e-5cec8a85098a] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:09:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:45 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:09:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:50 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:09:50 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 02:09:50 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Didn't find any instances for network info cache update. {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 02:09:50 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:09:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:52 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:09:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:54 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:09:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:09:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:09:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:09:54 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 02:09:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:09:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:09:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:09:54 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:09:55 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:09:55 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:09:55 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=8628MB free_disk=26.204025268554688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 02:09:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:09:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:09:55 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:09:55 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 02:09:55 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 02:09:55 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:09:55 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:09:55 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 02:09:55 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:09:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:09:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:00 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:10:00 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:01 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:10:01 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:10:01 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:10:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:05 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:06 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:07 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:10:07 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 02:10:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:15 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:15 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "21ac5dda-cff9-4da5-a19d-49b74491f007" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:10:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "21ac5dda-cff9-4da5-a19d-49b74491f007" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:10:20 user nova-compute[71498]: DEBUG nova.compute.manager [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 02:10:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:10:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:10:20 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 02:10:20 user nova-compute[71498]: INFO nova.compute.claims [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Claim successful on node user
Apr 14 02:10:20 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:10:20 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:10:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.203s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:10:20 user nova-compute[71498]: DEBUG nova.compute.manager [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 02:10:20 user nova-compute[71498]: DEBUG nova.compute.manager [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 02:10:20 user nova-compute[71498]: DEBUG nova.network.neutron [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 02:10:20 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 02:10:20 user nova-compute[71498]: DEBUG nova.compute.manager [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 02:10:20 user nova-compute[71498]: DEBUG nova.policy [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '168a0142cf984aacb1f087adcaa96468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcde6e918d64d70b69d2d81e1bdbe79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 02:10:20 user nova-compute[71498]: DEBUG nova.compute.manager [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 02:10:20 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 02:10:20 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Creating image(s)
Apr 14 02:10:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "/opt/stack/data/nova/instances/21ac5dda-cff9-4da5-a19d-49b74491f007/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:10:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "/opt/stack/data/nova/instances/21ac5dda-cff9-4da5-a19d-49b74491f007/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:10:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "/opt/stack/data/nova/instances/21ac5dda-cff9-4da5-a19d-49b74491f007/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:10:20 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:10:20 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:20 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.136s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:10:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:10:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:10:20 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:10:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.133s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:10:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/21ac5dda-cff9-4da5-a19d-49b74491f007/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:10:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/21ac5dda-cff9-4da5-a19d-49b74491f007/disk 1073741824" returned: 0 in 0.048s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:10:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:10:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:10:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.137s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:10:21 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Checking if we can resize image /opt/stack/data/nova/instances/21ac5dda-cff9-4da5-a19d-49b74491f007/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 02:10:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ac5dda-cff9-4da5-a19d-49b74491f007/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:10:21 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ac5dda-cff9-4da5-a19d-49b74491f007/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:10:21 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Cannot resize image /opt/stack/data/nova/instances/21ac5dda-cff9-4da5-a19d-49b74491f007/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 02:10:21 user nova-compute[71498]: DEBUG nova.objects.instance [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lazy-loading 'migration_context' on Instance uuid 21ac5dda-cff9-4da5-a19d-49b74491f007 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:10:21 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 02:10:21 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Ensure instance console log exists: /opt/stack/data/nova/instances/21ac5dda-cff9-4da5-a19d-49b74491f007/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 02:10:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:10:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:10:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:10:21 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:21 user nova-compute[71498]: DEBUG nova.network.neutron [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Successfully created port: 38b47774-08a0-4e14-a236-fcab2f3bdb06 {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 02:10:22 user nova-compute[71498]: DEBUG nova.network.neutron [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Successfully updated port: 38b47774-08a0-4e14-a236-fcab2f3bdb06 {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 02:10:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "refresh_cache-21ac5dda-cff9-4da5-a19d-49b74491f007" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:10:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquired lock "refresh_cache-21ac5dda-cff9-4da5-a19d-49b74491f007" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:10:22 user nova-compute[71498]: DEBUG nova.network.neutron [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 02:10:22 user nova-compute[71498]: DEBUG nova.compute.manager [req-d345e88c-0918-433d-9740-5528dbf6a1a3 req-1317e7af-3c10-44c2-95ff-bdf79a5b8916 service nova] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Received event network-changed-38b47774-08a0-4e14-a236-fcab2f3bdb06 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:10:22 user nova-compute[71498]: DEBUG nova.compute.manager [req-d345e88c-0918-433d-9740-5528dbf6a1a3 req-1317e7af-3c10-44c2-95ff-bdf79a5b8916 service nova] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Refreshing instance network info cache due to event network-changed-38b47774-08a0-4e14-a236-fcab2f3bdb06. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 02:10:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d345e88c-0918-433d-9740-5528dbf6a1a3 req-1317e7af-3c10-44c2-95ff-bdf79a5b8916 service nova] Acquiring lock "refresh_cache-21ac5dda-cff9-4da5-a19d-49b74491f007" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:10:22 user nova-compute[71498]: DEBUG nova.network.neutron [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG nova.network.neutron [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Updating instance_info_cache with network_info: [{"id": "38b47774-08a0-4e14-a236-fcab2f3bdb06", "address": "fa:16:3e:b9:1d:89", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b47774-08", "ovs_interfaceid": "38b47774-08a0-4e14-a236-fcab2f3bdb06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Releasing lock "refresh_cache-21ac5dda-cff9-4da5-a19d-49b74491f007" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG nova.compute.manager [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Instance network_info: |[{"id": "38b47774-08a0-4e14-a236-fcab2f3bdb06", "address": "fa:16:3e:b9:1d:89", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b47774-08", "ovs_interfaceid": "38b47774-08a0-4e14-a236-fcab2f3bdb06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d345e88c-0918-433d-9740-5528dbf6a1a3 req-1317e7af-3c10-44c2-95ff-bdf79a5b8916 service nova] Acquired lock "refresh_cache-21ac5dda-cff9-4da5-a19d-49b74491f007" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG nova.network.neutron [req-d345e88c-0918-433d-9740-5528dbf6a1a3 req-1317e7af-3c10-44c2-95ff-bdf79a5b8916 service nova] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Refreshing network info cache for port 38b47774-08a0-4e14-a236-fcab2f3bdb06 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Start _get_guest_xml network_info=[{"id": "38b47774-08a0-4e14-a236-fcab2f3bdb06", "address": "fa:16:3e:b9:1d:89", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b47774-08", "ovs_interfaceid": "38b47774-08a0-4e14-a236-fcab2f3bdb06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 02:10:23 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:10:23 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:10:23 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1446254601',display_name='tempest-AttachVolumeNegativeTest-server-1446254601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1446254601',id=43,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIV4Y4FLi2GXegSJpwzJ9Ks60PPN72JDpmIKogBiE9qPz09L2D+DrHUUiWU4bmSP6spYC9uqMNwovh5BE5nQXgHNE0RBRiSaKwEcuLeVhSC3e8O/srH8F+vT0QL+25dXIg==',key_name='tempest-keypair-867176451',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0dcde6e918d64d70b69d2d81e1bdbe79',ramdisk_id='',reservation_id='r-2vyargm9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1854704348',owner_user_name='tempest-AttachVolumeNegativeTest-1854704348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T02:10:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='168a0142cf984aacb1f087adcaa96468',uuid=21ac5dda-cff9-4da5-a19d-49b74491f007,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38b47774-08a0-4e14-a236-fcab2f3bdb06", "address": "fa:16:3e:b9:1d:89", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b47774-08", "ovs_interfaceid": "38b47774-08a0-4e14-a236-fcab2f3bdb06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Converting VIF {"id": "38b47774-08a0-4e14-a236-fcab2f3bdb06", "address": "fa:16:3e:b9:1d:89", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b47774-08", "ovs_interfaceid": "38b47774-08a0-4e14-a236-fcab2f3bdb06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:1d:89,bridge_name='br-int',has_traffic_filtering=True,id=38b47774-08a0-4e14-a236-fcab2f3bdb06,network=Network(981c880a-2147-4da6-8021-a03d0aee3f3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38b47774-08') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG nova.objects.instance [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lazy-loading 'pci_devices' on Instance uuid 21ac5dda-cff9-4da5-a19d-49b74491f007 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] End _get_guest_xml xml=<domain type="kvm">
Apr 14 02:10:23 user nova-compute[71498]:   <uuid>21ac5dda-cff9-4da5-a19d-49b74491f007</uuid>
Apr 14 02:10:23 user nova-compute[71498]:   <name>instance-0000002b</name>
Apr 14 02:10:23 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 02:10:23 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 02:10:23 user nova-compute[71498]:   <metadata>
Apr 14 02:10:23 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 02:10:23 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 02:10:23 user nova-compute[71498]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1446254601</nova:name>
Apr 14 02:10:23 user nova-compute[71498]:       <nova:creationTime>2023-04-14 02:10:23</nova:creationTime>
Apr 14 02:10:23 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 02:10:23 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 02:10:23 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 02:10:23 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 02:10:23 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 02:10:23 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 02:10:23 user nova-compute[71498]:       </nova:flavor>
Apr 14 02:10:23 user nova-compute[71498]:       <nova:owner>
Apr 14 02:10:23 user nova-compute[71498]:         <nova:user uuid="168a0142cf984aacb1f087adcaa96468">tempest-AttachVolumeNegativeTest-1854704348-project-member</nova:user>
Apr 14 02:10:23 user nova-compute[71498]:         <nova:project uuid="0dcde6e918d64d70b69d2d81e1bdbe79">tempest-AttachVolumeNegativeTest-1854704348</nova:project>
Apr 14 02:10:23 user nova-compute[71498]:       </nova:owner>
Apr 14 02:10:23 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 02:10:23 user nova-compute[71498]:       <nova:ports>
Apr 14 02:10:23 user nova-compute[71498]:         <nova:port uuid="38b47774-08a0-4e14-a236-fcab2f3bdb06">
Apr 14 02:10:23 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 02:10:23 user nova-compute[71498]:         </nova:port>
Apr 14 02:10:23 user nova-compute[71498]:       </nova:ports>
Apr 14 02:10:23 user nova-compute[71498]:     </nova:instance>
Apr 14 02:10:23 user nova-compute[71498]:   </metadata>
Apr 14 02:10:23 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 02:10:23 user nova-compute[71498]:     <system>
Apr 14 02:10:23 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 02:10:23 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 02:10:23 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 02:10:23 user nova-compute[71498]:       <entry name="serial">21ac5dda-cff9-4da5-a19d-49b74491f007</entry>
Apr 14 02:10:23 user nova-compute[71498]:       <entry name="uuid">21ac5dda-cff9-4da5-a19d-49b74491f007</entry>
Apr 14 02:10:23 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 02:10:23 user nova-compute[71498]:     </system>
Apr 14 02:10:23 user nova-compute[71498]:   </sysinfo>
Apr 14 02:10:23 user nova-compute[71498]:   <os>
Apr 14 02:10:23 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 02:10:23 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 02:10:23 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 02:10:23 user nova-compute[71498]:   </os>
Apr 14 02:10:23 user nova-compute[71498]:   <features>
Apr 14 02:10:23 user nova-compute[71498]:     <acpi/>
Apr 14 02:10:23 user nova-compute[71498]:     <apic/>
Apr 14 02:10:23 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 02:10:23 user nova-compute[71498]:   </features>
Apr 14 02:10:23 user nova-compute[71498]:   <clock offset="utc">
Apr 14 02:10:23 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 02:10:23 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 02:10:23 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 02:10:23 user nova-compute[71498]:   </clock>
Apr 14 02:10:23 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 02:10:23 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 02:10:23 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 02:10:23 user nova-compute[71498]:   </cpu>
Apr 14 02:10:23 user nova-compute[71498]:   <devices>
Apr 14 02:10:23 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 02:10:23 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 02:10:23 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/21ac5dda-cff9-4da5-a19d-49b74491f007/disk"/>
Apr 14 02:10:23 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 02:10:23 user nova-compute[71498]:     </disk>
Apr 14 02:10:23 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 02:10:23 user nova-compute[71498]:       <mac address="fa:16:3e:b9:1d:89"/>
Apr 14 02:10:23 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 02:10:23 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 02:10:23 user nova-compute[71498]:       <target dev="tap38b47774-08"/>
Apr 14 02:10:23 user nova-compute[71498]:     </interface>
Apr 14 02:10:23 user nova-compute[71498]:     <serial type="pty">
Apr 14 02:10:23 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/21ac5dda-cff9-4da5-a19d-49b74491f007/console.log" append="off"/>
Apr 14 02:10:23 user nova-compute[71498]:     </serial>
Apr 14 02:10:23 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 02:10:23 user nova-compute[71498]:     <video>
Apr 14 02:10:23 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 02:10:23 user nova-compute[71498]:     </video>
Apr 14 02:10:23 user nova-compute[71498]:     <rng model="virtio">
Apr 14 02:10:23 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 02:10:23 user nova-compute[71498]:     </rng>
Apr 14 02:10:23 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 02:10:23 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 02:10:23 user nova-compute[71498]:       <stats period="10"/>
Apr 14 02:10:23 user nova-compute[71498]:     </memballoon>
Apr 14 02:10:23 user nova-compute[71498]:   </devices>
Apr 14 02:10:23 user nova-compute[71498]: </domain>
Apr 14 02:10:23 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1446254601',display_name='tempest-AttachVolumeNegativeTest-server-1446254601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1446254601',id=43,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIV4Y4FLi2GXegSJpwzJ9Ks60PPN72JDpmIKogBiE9qPz09L2D+DrHUUiWU4bmSP6spYC9uqMNwovh5BE5nQXgHNE0RBRiSaKwEcuLeVhSC3e8O/srH8F+vT0QL+25dXIg==',key_name='tempest-keypair-867176451',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0dcde6e918d64d70b69d2d81e1bdbe79',ramdisk_id='',reservation_id='r-2vyargm9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1854704348',owner_user_name='tempest-AttachVolumeNegativeTest-1854704348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T02:10:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='168a0142cf984aacb1f087adcaa96468',uuid=21ac5dda-cff9-4da5-a19d-49b74491f007,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38b47774-08a0-4e14-a236-fcab2f3bdb06", "address": "fa:16:3e:b9:1d:89", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b47774-08", "ovs_interfaceid": "38b47774-08a0-4e14-a236-fcab2f3bdb06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Converting VIF {"id": "38b47774-08a0-4e14-a236-fcab2f3bdb06", "address": "fa:16:3e:b9:1d:89", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b47774-08", "ovs_interfaceid": "38b47774-08a0-4e14-a236-fcab2f3bdb06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:1d:89,bridge_name='br-int',has_traffic_filtering=True,id=38b47774-08a0-4e14-a236-fcab2f3bdb06,network=Network(981c880a-2147-4da6-8021-a03d0aee3f3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38b47774-08') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG os_vif [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:1d:89,bridge_name='br-int',has_traffic_filtering=True,id=38b47774-08a0-4e14-a236-fcab2f3bdb06,network=Network(981c880a-2147-4da6-8021-a03d0aee3f3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38b47774-08') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38b47774-08, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap38b47774-08, col_values=(('external_ids', {'iface-id': '38b47774-08a0-4e14-a236-fcab2f3bdb06', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:1d:89', 'vm-uuid': '21ac5dda-cff9-4da5-a19d-49b74491f007'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:23 user nova-compute[71498]: INFO os_vif [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:1d:89,bridge_name='br-int',has_traffic_filtering=True,id=38b47774-08a0-4e14-a236-fcab2f3bdb06,network=Network(981c880a-2147-4da6-8021-a03d0aee3f3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38b47774-08')
Apr 14 02:10:23 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] No VIF found with MAC fa:16:3e:b9:1d:89, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG nova.network.neutron [req-d345e88c-0918-433d-9740-5528dbf6a1a3 req-1317e7af-3c10-44c2-95ff-bdf79a5b8916 service nova] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Updated VIF entry in instance network info cache for port 38b47774-08a0-4e14-a236-fcab2f3bdb06. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG nova.network.neutron [req-d345e88c-0918-433d-9740-5528dbf6a1a3 req-1317e7af-3c10-44c2-95ff-bdf79a5b8916 service nova] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Updating instance_info_cache with network_info: [{"id": "38b47774-08a0-4e14-a236-fcab2f3bdb06", "address": "fa:16:3e:b9:1d:89", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b47774-08", "ovs_interfaceid": "38b47774-08a0-4e14-a236-fcab2f3bdb06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:10:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d345e88c-0918-433d-9740-5528dbf6a1a3 req-1317e7af-3c10-44c2-95ff-bdf79a5b8916 service nova] Releasing lock "refresh_cache-21ac5dda-cff9-4da5-a19d-49b74491f007" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:10:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:24 user nova-compute[71498]: DEBUG nova.compute.manager [req-827c87ca-b069-4e95-ab40-64a6ba55d380 req-fc807b48-2e8b-4d11-b20f-8b67b71b8176 service nova] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Received event network-vif-plugged-38b47774-08a0-4e14-a236-fcab2f3bdb06 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:10:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-827c87ca-b069-4e95-ab40-64a6ba55d380 req-fc807b48-2e8b-4d11-b20f-8b67b71b8176 service nova] Acquiring lock "21ac5dda-cff9-4da5-a19d-49b74491f007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:10:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-827c87ca-b069-4e95-ab40-64a6ba55d380 req-fc807b48-2e8b-4d11-b20f-8b67b71b8176 service nova] Lock "21ac5dda-cff9-4da5-a19d-49b74491f007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:10:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-827c87ca-b069-4e95-ab40-64a6ba55d380 req-fc807b48-2e8b-4d11-b20f-8b67b71b8176 service nova] Lock "21ac5dda-cff9-4da5-a19d-49b74491f007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:10:24 user nova-compute[71498]: DEBUG nova.compute.manager [req-827c87ca-b069-4e95-ab40-64a6ba55d380 req-fc807b48-2e8b-4d11-b20f-8b67b71b8176 service nova] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] No waiting events found dispatching network-vif-plugged-38b47774-08a0-4e14-a236-fcab2f3bdb06 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:10:24 user nova-compute[71498]: WARNING nova.compute.manager [req-827c87ca-b069-4e95-ab40-64a6ba55d380 req-fc807b48-2e8b-4d11-b20f-8b67b71b8176 service nova] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Received unexpected event network-vif-plugged-38b47774-08a0-4e14-a236-fcab2f3bdb06 for instance with vm_state building and task_state spawning.
Apr 14 02:10:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:26 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681438226.5801234, 21ac5dda-cff9-4da5-a19d-49b74491f007 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:10:26 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] VM Resumed (Lifecycle Event)
Apr 14 02:10:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 02:10:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 02:10:26 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Instance spawned successfully.
Apr 14 02:10:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 02:10:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:10:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 02:10:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:10:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:10:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:10:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:10:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:10:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:10:26 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 02:10:26 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681438226.582071, 21ac5dda-cff9-4da5-a19d-49b74491f007 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:10:26 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] VM Started (Lifecycle Event)
Apr 14 02:10:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:10:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 02:10:26 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 02:10:26 user nova-compute[71498]: INFO nova.compute.manager [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Took 5.93 seconds to spawn the instance on the hypervisor.
Apr 14 02:10:26 user nova-compute[71498]: DEBUG nova.compute.manager [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:10:26 user nova-compute[71498]: INFO nova.compute.manager [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Took 6.45 seconds to build instance.
Apr 14 02:10:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-724d9722-8670-432f-bfe4-e8c5c9d8ead6 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "21ac5dda-cff9-4da5-a19d-49b74491f007" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.549s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:10:27 user nova-compute[71498]: DEBUG nova.compute.manager [req-f57f49d5-c8bf-447b-bfc6-7ba3985a2f0c req-83ebbf8c-907f-49f0-bd05-cd8f6b95b3fd service nova] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Received event network-vif-plugged-38b47774-08a0-4e14-a236-fcab2f3bdb06 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:10:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f57f49d5-c8bf-447b-bfc6-7ba3985a2f0c req-83ebbf8c-907f-49f0-bd05-cd8f6b95b3fd service nova] Acquiring lock "21ac5dda-cff9-4da5-a19d-49b74491f007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:10:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f57f49d5-c8bf-447b-bfc6-7ba3985a2f0c req-83ebbf8c-907f-49f0-bd05-cd8f6b95b3fd service nova] Lock "21ac5dda-cff9-4da5-a19d-49b74491f007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:10:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f57f49d5-c8bf-447b-bfc6-7ba3985a2f0c req-83ebbf8c-907f-49f0-bd05-cd8f6b95b3fd service nova] Lock "21ac5dda-cff9-4da5-a19d-49b74491f007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:10:27 user nova-compute[71498]: DEBUG nova.compute.manager [req-f57f49d5-c8bf-447b-bfc6-7ba3985a2f0c req-83ebbf8c-907f-49f0-bd05-cd8f6b95b3fd service nova] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] No waiting events found dispatching network-vif-plugged-38b47774-08a0-4e14-a236-fcab2f3bdb06 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:10:27 user nova-compute[71498]: WARNING nova.compute.manager [req-f57f49d5-c8bf-447b-bfc6-7ba3985a2f0c req-83ebbf8c-907f-49f0-bd05-cd8f6b95b3fd service nova] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Received unexpected event network-vif-plugged-38b47774-08a0-4e14-a236-fcab2f3bdb06 for instance with vm_state active and task_state None.
Apr 14 02:10:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:10:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:10:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:10:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:10:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:52 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:10:52 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 02:10:52 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Rebuilding the list of instances to heal {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 02:10:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-9b29ba99-4234-4bbc-80a2-ad49127e8c9a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:10:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-9b29ba99-4234-4bbc-80a2-ad49127e8c9a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:10:52 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 02:10:52 user nova-compute[71498]: DEBUG nova.objects.instance [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lazy-loading 'info_cache' on Instance uuid 9b29ba99-4234-4bbc-80a2-ad49127e8c9a {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:10:52 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Updating instance_info_cache with network_info: [{"id": "e204d7f5-314e-43ce-8772-e2f288f1858f", "address": "fa:16:3e:30:bf:7a", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape204d7f5-31", "ovs_interfaceid": "e204d7f5-314e-43ce-8772-e2f288f1858f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:10:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-9b29ba99-4234-4bbc-80a2-ad49127e8c9a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:10:52 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 02:10:52 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:10:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:54 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:10:56 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:10:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:10:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:10:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:10:56 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 02:10:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ac5dda-cff9-4da5-a19d-49b74491f007/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:10:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ac5dda-cff9-4da5-a19d-49b74491f007/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:10:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ac5dda-cff9-4da5-a19d-49b74491f007/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:10:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ac5dda-cff9-4da5-a19d-49b74491f007/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:10:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:10:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:10:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:10:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:10:57 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:10:57 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:10:57 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=8620MB free_disk=26.163841247558594GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 02:10:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:10:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:10:57 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:10:57 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 21ac5dda-cff9-4da5-a19d-49b74491f007 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:10:57 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 02:10:57 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 02:10:57 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:10:57 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:10:57 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 02:10:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.411s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:10:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:10:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:01 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:11:01 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:11:02 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:11:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:03 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:11:03 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:11:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:08 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:11:08 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 02:11:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:11:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:11:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:11:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:11:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:11:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:11:21 user nova-compute[71498]: DEBUG nova.objects.instance [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lazy-loading 'flavor' on Instance uuid 9b29ba99-4234-4bbc-80a2-ad49127e8c9a {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:11:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:11:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:11:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:11:22 user nova-compute[71498]: INFO nova.compute.manager [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Attaching volume 9f12b47d-8b55-4650-9f88-e50281b67877 to /dev/vdb
Apr 14 02:11:22 user nova-compute[71498]: DEBUG os_brick.utils [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:11:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:22 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87fd984-5fbf-4ef5-9a3d-67d4d1a9cd3a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:22 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f17906-4976-47e8-96b6-8d841a4e5f48]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:22 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b7e117-e257-4d1c-926d-fcaf699ea0c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:22 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6131ddd-cd4b-41cc-824e-758d089a029e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 02:11:22 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 02:11:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:22 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 02:11:22 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 02:11:22 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a924dd6d-b6a3-4141-b34d-55b3d8bcdd6f]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:22 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 02:11:22 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 02:11:22 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 02:11:22 user nova-compute[71498]: DEBUG os_brick.utils [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:11:22 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Updating existing volume attachment record: 143a641e-673a-4f82-8951-21729a3f8809 {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 02:11:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:11:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xPHDCKoL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:11:26 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:11:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:11:26 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:11:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:11:26 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 02:11:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[95935f8c-4b47-473c-990e-16a1c2424a3d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 02:11:26 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54ed572-9ba6-4125-a7c1-f4da4c57d72c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877] added
Apr 14 02:11:26 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea8e271-8c7d-46df-b59c-0a7479ba244e]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abd1374-f36b-4d40-a143-e9a0921e2d60]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xPHDCKoL {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xPHDCKoL" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[79911a0d-78da-4d0c-8e9f-d5e836f75c85]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xPHDCKoL'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d5a22a-ac76-4170-9802-6d9407f8b250]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01ea45a-7aa4-46b4-aa77-c9ba7bc52df4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 02:11:26 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 02:11:26 user nova-compute[71498]:  {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:11:26 user nova-compute[71498]: WARNING os_brick.initiator.connectors.iscsi [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 02:11:26 user nova-compute[71498]: 
Apr 14 02:11:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e06e2f1-6b82-4545-8290-b4d483e36053]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877, portal: 172.16.0.220,3260]
Apr 14 02:11:26 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877, portal: 172.16.0.220,3260] successful.
Apr 14 02:11:26 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[da21ea85-b56c-4188-8571-923b44bef273]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e5830a-028c-4cef-88a6-04ee133222bc]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 (non-flash)
Apr 14 02:11:26 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 (non-flash)
Apr 14 02:11:26 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f486536a-ac07-47ae-9d30-912227ab6219]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 02:11:26 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xPHDCKoL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 02:11:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:11:27 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23962633464393162', 'path': '/dev/sdb'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:11:27 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962633464393162', 'path': '/dev/sdb'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 02:11:27 user nova-compute[71498]: DEBUG nova.objects.instance [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lazy-loading 'flavor' on Instance uuid 9b29ba99-4234-4bbc-80a2-ad49127e8c9a {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:11:27 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 02:11:27 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:11:27 user nova-compute[71498]:   <source dev="/dev/sdb"/>
Apr 14 02:11:27 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 02:11:27 user nova-compute[71498]:   <serial>9f12b47d-8b55-4650-9f88-e50281b67877</serial>
Apr 14 02:11:27 user nova-compute[71498]: </disk>
Apr 14 02:11:27 user nova-compute[71498]:  {{(pid=71498) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 02:11:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:28 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:11:28 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:11:28 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] No VIF found with MAC fa:16:3e:30:bf:7a, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 02:11:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-427934b0-4a23-4a88-854a-7ad6f2b06935 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.298s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:11:32 user nova-compute[71498]: DEBUG nova.compute.manager [req-22d5ac1a-9fb8-4d69-a74c-54d1b0bd314a req-e296533f-7413-4a54-9f28-f17148ae415e service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Received event network-changed-e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:11:32 user nova-compute[71498]: DEBUG nova.compute.manager [req-22d5ac1a-9fb8-4d69-a74c-54d1b0bd314a req-e296533f-7413-4a54-9f28-f17148ae415e service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Refreshing instance network info cache due to event network-changed-e204d7f5-314e-43ce-8772-e2f288f1858f. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 02:11:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-22d5ac1a-9fb8-4d69-a74c-54d1b0bd314a req-e296533f-7413-4a54-9f28-f17148ae415e service nova] Acquiring lock "refresh_cache-9b29ba99-4234-4bbc-80a2-ad49127e8c9a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:11:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-22d5ac1a-9fb8-4d69-a74c-54d1b0bd314a req-e296533f-7413-4a54-9f28-f17148ae415e service nova] Acquired lock "refresh_cache-9b29ba99-4234-4bbc-80a2-ad49127e8c9a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:11:32 user nova-compute[71498]: DEBUG nova.network.neutron [req-22d5ac1a-9fb8-4d69-a74c-54d1b0bd314a req-e296533f-7413-4a54-9f28-f17148ae415e service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Refreshing network info cache for port e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 02:11:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:11:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5006 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:11:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:11:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:11:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:33 user nova-compute[71498]: DEBUG nova.network.neutron [req-22d5ac1a-9fb8-4d69-a74c-54d1b0bd314a req-e296533f-7413-4a54-9f28-f17148ae415e service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Updated VIF entry in instance network info cache for port e204d7f5-314e-43ce-8772-e2f288f1858f. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 02:11:33 user nova-compute[71498]: DEBUG nova.network.neutron [req-22d5ac1a-9fb8-4d69-a74c-54d1b0bd314a req-e296533f-7413-4a54-9f28-f17148ae415e service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Updating instance_info_cache with network_info: [{"id": "e204d7f5-314e-43ce-8772-e2f288f1858f", "address": "fa:16:3e:30:bf:7a", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape204d7f5-31", "ovs_interfaceid": "e204d7f5-314e-43ce-8772-e2f288f1858f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:11:33 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-22d5ac1a-9fb8-4d69-a74c-54d1b0bd314a req-e296533f-7413-4a54-9f28-f17148ae415e service nova] Releasing lock "refresh_cache-9b29ba99-4234-4bbc-80a2-ad49127e8c9a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:11:35 user nova-compute[71498]: DEBUG nova.compute.manager [req-0c8dd165-9dd2-4ea1-977a-4e8885bae2df req-e12b64cc-64db-4aba-a92c-c350a6a48aab service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Received event network-changed-e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:11:35 user nova-compute[71498]: DEBUG nova.compute.manager [req-0c8dd165-9dd2-4ea1-977a-4e8885bae2df req-e12b64cc-64db-4aba-a92c-c350a6a48aab service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Refreshing instance network info cache due to event network-changed-e204d7f5-314e-43ce-8772-e2f288f1858f. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 02:11:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0c8dd165-9dd2-4ea1-977a-4e8885bae2df req-e12b64cc-64db-4aba-a92c-c350a6a48aab service nova] Acquiring lock "refresh_cache-9b29ba99-4234-4bbc-80a2-ad49127e8c9a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:11:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0c8dd165-9dd2-4ea1-977a-4e8885bae2df req-e12b64cc-64db-4aba-a92c-c350a6a48aab service nova] Acquired lock "refresh_cache-9b29ba99-4234-4bbc-80a2-ad49127e8c9a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:11:35 user nova-compute[71498]: DEBUG nova.network.neutron [req-0c8dd165-9dd2-4ea1-977a-4e8885bae2df req-e12b64cc-64db-4aba-a92c-c350a6a48aab service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Refreshing network info cache for port e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 02:11:35 user nova-compute[71498]: DEBUG nova.network.neutron [req-0c8dd165-9dd2-4ea1-977a-4e8885bae2df req-e12b64cc-64db-4aba-a92c-c350a6a48aab service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Updated VIF entry in instance network info cache for port e204d7f5-314e-43ce-8772-e2f288f1858f. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 02:11:35 user nova-compute[71498]: DEBUG nova.network.neutron [req-0c8dd165-9dd2-4ea1-977a-4e8885bae2df req-e12b64cc-64db-4aba-a92c-c350a6a48aab service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Updating instance_info_cache with network_info: [{"id": "e204d7f5-314e-43ce-8772-e2f288f1858f", "address": "fa:16:3e:30:bf:7a", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape204d7f5-31", "ovs_interfaceid": "e204d7f5-314e-43ce-8772-e2f288f1858f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:11:35 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0c8dd165-9dd2-4ea1-977a-4e8885bae2df req-e12b64cc-64db-4aba-a92c-c350a6a48aab service nova] Releasing lock "refresh_cache-9b29ba99-4234-4bbc-80a2-ad49127e8c9a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:11:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:11:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:11:38 user nova-compute[71498]: INFO nova.compute.manager [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Rebooting instance
Apr 14 02:11:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "refresh_cache-9b29ba99-4234-4bbc-80a2-ad49127e8c9a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:11:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquired lock "refresh_cache-9b29ba99-4234-4bbc-80a2-ad49127e8c9a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:11:38 user nova-compute[71498]: DEBUG nova.network.neutron [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 02:11:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:38 user nova-compute[71498]: DEBUG nova.network.neutron [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Updating instance_info_cache with network_info: [{"id": "e204d7f5-314e-43ce-8772-e2f288f1858f", "address": "fa:16:3e:30:bf:7a", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape204d7f5-31", "ovs_interfaceid": "e204d7f5-314e-43ce-8772-e2f288f1858f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:11:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Releasing lock "refresh_cache-9b29ba99-4234-4bbc-80a2-ad49127e8c9a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:11:38 user nova-compute[71498]: DEBUG nova.compute.manager [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:11:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:38 user nova-compute[71498]: DEBUG nova.compute.manager [req-8151a724-d052-4dd1-9353-e827642fe265 req-105f41ce-1e24-4a17-b636-f89041c29e09 service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Received event network-vif-unplugged-e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:11:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8151a724-d052-4dd1-9353-e827642fe265 req-105f41ce-1e24-4a17-b636-f89041c29e09 service nova] Acquiring lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:11:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8151a724-d052-4dd1-9353-e827642fe265 req-105f41ce-1e24-4a17-b636-f89041c29e09 service nova] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:11:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8151a724-d052-4dd1-9353-e827642fe265 req-105f41ce-1e24-4a17-b636-f89041c29e09 service nova] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:11:38 user nova-compute[71498]: DEBUG nova.compute.manager [req-8151a724-d052-4dd1-9353-e827642fe265 req-105f41ce-1e24-4a17-b636-f89041c29e09 service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] No waiting events found dispatching network-vif-unplugged-e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:11:38 user nova-compute[71498]: WARNING nova.compute.manager [req-8151a724-d052-4dd1-9353-e827642fe265 req-105f41ce-1e24-4a17-b636-f89041c29e09 service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Received unexpected event network-vif-unplugged-e204d7f5-314e-43ce-8772-e2f288f1858f for instance with vm_state active and task_state reboot_started_hard.
Apr 14 02:11:39 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Instance destroyed successfully.
Apr 14 02:11:39 user nova-compute[71498]: DEBUG nova.objects.instance [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lazy-loading 'resources' on Instance uuid 9b29ba99-4234-4bbc-80a2-ad49127e8c9a {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:09:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-435405212',display_name='tempest-TestMinimumBasicScenario-server-435405212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-435405212',id=42,image_ref='b0ff2602-d4a4-4cb3-95c3-5e9dfd3c74c5',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtEzsPoBbdFHW/OauW1N2nA3eHApzo9P+avktVZiY+BDznrsT5FrpFSwKh0+oQn87dy12kX9i8d8dwF2rJqPbbOiawNN4AoRze6n/YxMVSWae21mhWOZtM+ldYOp4zong==',key_name='tempest-TestMinimumBasicScenario-1668215586',keypairs=<?>,launch_index=0,launched_at=2023-04-14T02:09:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20723e8ba2f5480b8c17e6c4fc8fff9f',ramdisk_id='',reservation_id='r-cbhvzk20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b0ff2602-d4a4-4cb3-95c3-5e9dfd3c74c5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1976287714',owner_user_name='tempest-TestMinimumBasicScenario-1976287714-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T02:11:39Z,user_data=None,user_id='19633f8d769c4e50b5e6c9a75497b510',uuid=9b29ba99-4234-4bbc-80a2-ad49127e8c9a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e204d7f5-314e-43ce-8772-e2f288f1858f", "address": "fa:16:3e:30:bf:7a", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape204d7f5-31", "ovs_interfaceid": "e204d7f5-314e-43ce-8772-e2f288f1858f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Converting VIF {"id": "e204d7f5-314e-43ce-8772-e2f288f1858f", "address": "fa:16:3e:30:bf:7a", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape204d7f5-31", "ovs_interfaceid": "e204d7f5-314e-43ce-8772-e2f288f1858f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:bf:7a,bridge_name='br-int',has_traffic_filtering=True,id=e204d7f5-314e-43ce-8772-e2f288f1858f,network=Network(6a2a0716-97e3-42a7-bdf8-5f5548cf550b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape204d7f5-31') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG os_vif [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:bf:7a,bridge_name='br-int',has_traffic_filtering=True,id=e204d7f5-314e-43ce-8772-e2f288f1858f,network=Network(6a2a0716-97e3-42a7-bdf8-5f5548cf550b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape204d7f5-31') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape204d7f5-31, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:11:39 user nova-compute[71498]: INFO os_vif [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:bf:7a,bridge_name='br-int',has_traffic_filtering=True,id=e204d7f5-314e-43ce-8772-e2f288f1858f,network=Network(6a2a0716-97e3-42a7-bdf8-5f5548cf550b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape204d7f5-31')
Apr 14 02:11:39 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xPHDCKoL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:11:39 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:11:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b143a3-8998-42f2-b7c5-f580997912f3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 02:11:39 user nova-compute[71498]: No targets found.
Apr 14 02:11:39 user nova-compute[71498]: iSNS:
Apr 14 02:11:39 user nova-compute[71498]: No targets found.
Apr 14 02:11:39 user nova-compute[71498]: STATIC:
Apr 14 02:11:39 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877
Apr 14 02:11:39 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 02:11:39 user nova-compute[71498]:                 Iface Name: default
Apr 14 02:11:39 user nova-compute[71498]: FIRMWARE:
Apr 14 02:11:39 user nova-compute[71498]: No targets found.
Apr 14 02:11:39 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 02:11:39 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 02:11:39 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[09704a94-c4f8-4163-b581-9798bc1e737e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcac991f-b6db-40cf-9d5e-22c08afe706e]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 (non-flash)
Apr 14 02:11:39 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 (non-flash)
Apr 14 02:11:39 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51e4239510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877'): ({'sdb'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Removing single pathed devices sdb {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a6cbce-724c-4eb0-8ec2-dc1aa36eea04]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee50fee1-f4f5-482a-95e5-7975808b58bd]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Flushing IO for device /dev/sdb {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b46c4e-7b65-4a5d-80f5-2f6fd59cd7ad]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb86f1ab-64c4-4d22-ad78-6f108e18ccb4]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] SCSI volumes sdb have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1fb449-998c-4501-a114-516f1f8dd491]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97025d8-5561-4b3b-b025-6dc59b827713]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877, portal: 172.16.0.220,3260]
Apr 14 02:11:39 user nova-compute[71498]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877, portal: 172.16.0.220,3260] successful.
Apr 14 02:11:39 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d505dbac-d274-49fa-8e46-967b01e5755c]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] <== disconnect_volume: return (283ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Start _get_guest_xml network_info=[{"id": "e204d7f5-314e-43ce-8772-e2f288f1858f", "address": "fa:16:3e:30:bf:7a", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape204d7f5-31", "ovs_interfaceid": "e204d7f5-314e-43ce-8772-e2f288f1858f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b0ff2602-d4a4-4cb3-95c3-5e9dfd3c74c5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b0ff2602-d4a4-4cb3-95c3-5e9dfd3c74c5'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '143a641e-673a-4f82-8951-21729a3f8809', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xPHDCKoL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '9b29ba99-4234-4bbc-80a2-ad49127e8c9a', 'attached_at': '', 'detached_at': '', 'volume_id': '9f12b47d-8b55-4650-9f88-e50281b67877', 'serial': '9f12b47d-8b55-4650-9f88-e50281b67877'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 02:11:39 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:11:39 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:11:39 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b0ff2602-d4a4-4cb3-95c3-5e9dfd3c74c5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG nova.objects.instance [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9b29ba99-4234-4bbc-80a2-ad49127e8c9a {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xPHDCKoL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:11:39 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:11:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:11:39 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:11:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:11:39 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[67edf52a-0d54-43fe-9f15-5fd818f713e2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 02:11:39 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfb83e6-4b53-4c83-bf83-de89ca1af193]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877] added
Apr 14 02:11:39 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa83198-4e08-4d78-bf5b-2091152ad2bd]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c86e9e4-98bd-4f42-a880-5914f2077987]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xPHDCKoL {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xPHDCKoL" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b25490-02f1-43f2-b701-86784803086a]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xPHDCKoL'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a69bd8-b79d-4be6-9c02-eb5d930bf3e4]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1a07b9-260e-4445-ab9e-4b3076bcc3c1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 02:11:39 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:11:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 02:11:39 user nova-compute[71498]:  {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:11:39 user nova-compute[71498]: WARNING os_brick.initiator.connectors.iscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 02:11:39 user nova-compute[71498]: 
Apr 14 02:11:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:40 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6ffef8-05cd-40b4-9816-d27a5bb09a7d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:40 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877, portal: 172.16.0.220,3260]
Apr 14 02:11:40 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877, portal: 172.16.0.220,3260] successful.
Apr 14 02:11:40 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:11:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:40 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d7b4a9-b0e1-426b-bf40-95ed6801c979]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:40 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:11:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:40 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c720f03b-b0cf-419b-b91e-df4d05043b24]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:40 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 (non-flash)
Apr 14 02:11:40 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:11:40 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 (non-flash)
Apr 14 02:11:40 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:11:40 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:11:40 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 02:11:40 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 02:11:40 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 02:11:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.096s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:40 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9433babe-0da8-44a2-bec3-d37296e65b28]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:11:40 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 02:11:40 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xPHDCKoL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG nova.compute.manager [req-beb206f5-594c-46da-8900-5bf73a6bc7ef req-28c358e7-1b19-4702-abe2-93a0a5da6699 service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Received event network-vif-plugged-e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-beb206f5-594c-46da-8900-5bf73a6bc7ef req-28c358e7-1b19-4702-abe2-93a0a5da6699 service nova] Acquiring lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-beb206f5-594c-46da-8900-5bf73a6bc7ef req-28c358e7-1b19-4702-abe2-93a0a5da6699 service nova] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-beb206f5-594c-46da-8900-5bf73a6bc7ef req-28c358e7-1b19-4702-abe2-93a0a5da6699 service nova] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG nova.compute.manager [req-beb206f5-594c-46da-8900-5bf73a6bc7ef req-28c358e7-1b19-4702-abe2-93a0a5da6699 service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] No waiting events found dispatching network-vif-plugged-e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:11:41 user nova-compute[71498]: WARNING nova.compute.manager [req-beb206f5-594c-46da-8900-5bf73a6bc7ef req-28c358e7-1b19-4702-abe2-93a0a5da6699 service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Received unexpected event network-vif-plugged-e204d7f5-314e-43ce-8772-e2f288f1858f for instance with vm_state active and task_state reboot_started_hard.
Apr 14 02:11:41 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23962633464393162', 'path': '/dev/sdb'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962633464393162', 'path': '/dev/sdb'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:09:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-435405212',display_name='tempest-TestMinimumBasicScenario-server-435405212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-435405212',id=42,image_ref='b0ff2602-d4a4-4cb3-95c3-5e9dfd3c74c5',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtEzsPoBbdFHW/OauW1N2nA3eHApzo9P+avktVZiY+BDznrsT5FrpFSwKh0+oQn87dy12kX9i8d8dwF2rJqPbbOiawNN4AoRze6n/YxMVSWae21mhWOZtM+ldYOp4zong==',key_name='tempest-TestMinimumBasicScenario-1668215586',keypairs=<?>,launch_index=0,launched_at=2023-04-14T02:09:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20723e8ba2f5480b8c17e6c4fc8fff9f',ramdisk_id='',reservation_id='r-cbhvzk20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b0ff2602-d4a4-4cb3-95c3-5e9dfd3c74c5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1976287714',owner_user_name='tempest-TestMinimumBasicScenario-1976287714-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T02:11:39Z,user_data=None,user_id='19633f8d769c4e50b5e6c9a75497b510',uuid=9b29ba99-4234-4bbc-80a2-ad49127e8c9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e204d7f5-314e-43ce-8772-e2f288f1858f", "address": "fa:16:3e:30:bf:7a", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape204d7f5-31", "ovs_interfaceid": "e204d7f5-314e-43ce-8772-e2f288f1858f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Converting VIF {"id": "e204d7f5-314e-43ce-8772-e2f288f1858f", "address": "fa:16:3e:30:bf:7a", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape204d7f5-31", "ovs_interfaceid": "e204d7f5-314e-43ce-8772-e2f288f1858f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:bf:7a,bridge_name='br-int',has_traffic_filtering=True,id=e204d7f5-314e-43ce-8772-e2f288f1858f,network=Network(6a2a0716-97e3-42a7-bdf8-5f5548cf550b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape204d7f5-31') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG nova.objects.instance [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b29ba99-4234-4bbc-80a2-ad49127e8c9a {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] End _get_guest_xml xml=<domain type="kvm">
Apr 14 02:11:41 user nova-compute[71498]:   <uuid>9b29ba99-4234-4bbc-80a2-ad49127e8c9a</uuid>
Apr 14 02:11:41 user nova-compute[71498]:   <name>instance-0000002a</name>
Apr 14 02:11:41 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 02:11:41 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 02:11:41 user nova-compute[71498]:   <metadata>
Apr 14 02:11:41 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 02:11:41 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 02:11:41 user nova-compute[71498]:       <nova:name>tempest-TestMinimumBasicScenario-server-435405212</nova:name>
Apr 14 02:11:41 user nova-compute[71498]:       <nova:creationTime>2023-04-14 02:11:39</nova:creationTime>
Apr 14 02:11:41 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 02:11:41 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 02:11:41 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 02:11:41 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 02:11:41 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 02:11:41 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 02:11:41 user nova-compute[71498]:       </nova:flavor>
Apr 14 02:11:41 user nova-compute[71498]:       <nova:owner>
Apr 14 02:11:41 user nova-compute[71498]:         <nova:user uuid="19633f8d769c4e50b5e6c9a75497b510">tempest-TestMinimumBasicScenario-1976287714-project-member</nova:user>
Apr 14 02:11:41 user nova-compute[71498]:         <nova:project uuid="20723e8ba2f5480b8c17e6c4fc8fff9f">tempest-TestMinimumBasicScenario-1976287714</nova:project>
Apr 14 02:11:41 user nova-compute[71498]:       </nova:owner>
Apr 14 02:11:41 user nova-compute[71498]:       <nova:root type="image" uuid="b0ff2602-d4a4-4cb3-95c3-5e9dfd3c74c5"/>
Apr 14 02:11:41 user nova-compute[71498]:       <nova:ports>
Apr 14 02:11:41 user nova-compute[71498]:         <nova:port uuid="e204d7f5-314e-43ce-8772-e2f288f1858f">
Apr 14 02:11:41 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 02:11:41 user nova-compute[71498]:         </nova:port>
Apr 14 02:11:41 user nova-compute[71498]:       </nova:ports>
Apr 14 02:11:41 user nova-compute[71498]:     </nova:instance>
Apr 14 02:11:41 user nova-compute[71498]:   </metadata>
Apr 14 02:11:41 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 02:11:41 user nova-compute[71498]:     <system>
Apr 14 02:11:41 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 02:11:41 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 02:11:41 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 02:11:41 user nova-compute[71498]:       <entry name="serial">9b29ba99-4234-4bbc-80a2-ad49127e8c9a</entry>
Apr 14 02:11:41 user nova-compute[71498]:       <entry name="uuid">9b29ba99-4234-4bbc-80a2-ad49127e8c9a</entry>
Apr 14 02:11:41 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 02:11:41 user nova-compute[71498]:     </system>
Apr 14 02:11:41 user nova-compute[71498]:   </sysinfo>
Apr 14 02:11:41 user nova-compute[71498]:   <os>
Apr 14 02:11:41 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 02:11:41 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 02:11:41 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 02:11:41 user nova-compute[71498]:   </os>
Apr 14 02:11:41 user nova-compute[71498]:   <features>
Apr 14 02:11:41 user nova-compute[71498]:     <acpi/>
Apr 14 02:11:41 user nova-compute[71498]:     <apic/>
Apr 14 02:11:41 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 02:11:41 user nova-compute[71498]:   </features>
Apr 14 02:11:41 user nova-compute[71498]:   <clock offset="utc">
Apr 14 02:11:41 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 02:11:41 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 02:11:41 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 02:11:41 user nova-compute[71498]:   </clock>
Apr 14 02:11:41 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 02:11:41 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 02:11:41 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 02:11:41 user nova-compute[71498]:   </cpu>
Apr 14 02:11:41 user nova-compute[71498]:   <devices>
Apr 14 02:11:41 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 02:11:41 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 02:11:41 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk"/>
Apr 14 02:11:41 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 02:11:41 user nova-compute[71498]:     </disk>
Apr 14 02:11:41 user nova-compute[71498]:     <disk type="block" device="disk">
Apr 14 02:11:41 user nova-compute[71498]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:11:41 user nova-compute[71498]:       <source dev="/dev/sdb"/>
Apr 14 02:11:41 user nova-compute[71498]:       <target dev="vdb" bus="virtio"/>
Apr 14 02:11:41 user nova-compute[71498]:       <serial>9f12b47d-8b55-4650-9f88-e50281b67877</serial>
Apr 14 02:11:41 user nova-compute[71498]:     </disk>
Apr 14 02:11:41 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 02:11:41 user nova-compute[71498]:       <mac address="fa:16:3e:30:bf:7a"/>
Apr 14 02:11:41 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 02:11:41 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 02:11:41 user nova-compute[71498]:       <target dev="tape204d7f5-31"/>
Apr 14 02:11:41 user nova-compute[71498]:     </interface>
Apr 14 02:11:41 user nova-compute[71498]:     <serial type="pty">
Apr 14 02:11:41 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/console.log" append="off"/>
Apr 14 02:11:41 user nova-compute[71498]:     </serial>
Apr 14 02:11:41 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 02:11:41 user nova-compute[71498]:     <video>
Apr 14 02:11:41 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 02:11:41 user nova-compute[71498]:     </video>
Apr 14 02:11:41 user nova-compute[71498]:     <rng model="virtio">
Apr 14 02:11:41 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 02:11:41 user nova-compute[71498]:     </rng>
Apr 14 02:11:41 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 02:11:41 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 02:11:41 user nova-compute[71498]:       <stats period="10"/>
Apr 14 02:11:41 user nova-compute[71498]:     </memballoon>
Apr 14 02:11:41 user nova-compute[71498]:   </devices>
Apr 14 02:11:41 user nova-compute[71498]: </domain>
Apr 14 02:11:41 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG nova.objects.instance [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9b29ba99-4234-4bbc-80a2-ad49127e8c9a {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d04c3460e4b72ac20f143e769721db0d5b61f406 --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d04c3460e4b72ac20f143e769721db0d5b61f406 --force-share --output=json" returned: 0 in 0.130s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Cannot resize image /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG nova.objects.instance [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lazy-loading 'migration_context' on Instance uuid 9b29ba99-4234-4bbc-80a2-ad49127e8c9a {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:09:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-435405212',display_name='tempest-TestMinimumBasicScenario-server-435405212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-435405212',id=42,image_ref='b0ff2602-d4a4-4cb3-95c3-5e9dfd3c74c5',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtEzsPoBbdFHW/OauW1N2nA3eHApzo9P+avktVZiY+BDznrsT5FrpFSwKh0+oQn87dy12kX9i8d8dwF2rJqPbbOiawNN4AoRze6n/YxMVSWae21mhWOZtM+ldYOp4zong==',key_name='tempest-TestMinimumBasicScenario-1668215586',keypairs=<?>,launch_index=0,launched_at=2023-04-14T02:09:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='20723e8ba2f5480b8c17e6c4fc8fff9f',ramdisk_id='',reservation_id='r-cbhvzk20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b0ff2602-d4a4-4cb3-95c3-5e9dfd3c74c5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1976287714',owner_user_name='tempest-TestMinimumBasicScenario-1976287714-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T02:11:39Z,user_data=None,user_id='19633f8d769c4e50b5e6c9a75497b510',uuid=9b29ba99-4234-4bbc-80a2-ad49127e8c9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e204d7f5-314e-43ce-8772-e2f288f1858f", "address": "fa:16:3e:30:bf:7a", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape204d7f5-31", "ovs_interfaceid": "e204d7f5-314e-43ce-8772-e2f288f1858f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Converting VIF {"id": "e204d7f5-314e-43ce-8772-e2f288f1858f", "address": "fa:16:3e:30:bf:7a", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape204d7f5-31", "ovs_interfaceid": "e204d7f5-314e-43ce-8772-e2f288f1858f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:bf:7a,bridge_name='br-int',has_traffic_filtering=True,id=e204d7f5-314e-43ce-8772-e2f288f1858f,network=Network(6a2a0716-97e3-42a7-bdf8-5f5548cf550b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape204d7f5-31') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG os_vif [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:bf:7a,bridge_name='br-int',has_traffic_filtering=True,id=e204d7f5-314e-43ce-8772-e2f288f1858f,network=Network(6a2a0716-97e3-42a7-bdf8-5f5548cf550b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape204d7f5-31') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape204d7f5-31, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape204d7f5-31, col_values=(('external_ids', {'iface-id': 'e204d7f5-314e-43ce-8772-e2f288f1858f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:bf:7a', 'vm-uuid': '9b29ba99-4234-4bbc-80a2-ad49127e8c9a'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:11:41 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:41 user nova-compute[71498]: INFO os_vif [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:bf:7a,bridge_name='br-int',has_traffic_filtering=True,id=e204d7f5-314e-43ce-8772-e2f288f1858f,network=Network(6a2a0716-97e3-42a7-bdf8-5f5548cf550b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape204d7f5-31')
Apr 14 02:11:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:43 user nova-compute[71498]: DEBUG nova.compute.manager [req-0878bfaa-4c31-48b1-80e0-6f1dcdf40c93 req-c02879da-5010-4868-986c-02084030d3ab service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Received event network-vif-plugged-e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:11:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0878bfaa-4c31-48b1-80e0-6f1dcdf40c93 req-c02879da-5010-4868-986c-02084030d3ab service nova] Acquiring lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:11:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0878bfaa-4c31-48b1-80e0-6f1dcdf40c93 req-c02879da-5010-4868-986c-02084030d3ab service nova] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:11:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-0878bfaa-4c31-48b1-80e0-6f1dcdf40c93 req-c02879da-5010-4868-986c-02084030d3ab service nova] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:11:43 user nova-compute[71498]: DEBUG nova.compute.manager [req-0878bfaa-4c31-48b1-80e0-6f1dcdf40c93 req-c02879da-5010-4868-986c-02084030d3ab service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] No waiting events found dispatching network-vif-plugged-e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:11:43 user nova-compute[71498]: WARNING nova.compute.manager [req-0878bfaa-4c31-48b1-80e0-6f1dcdf40c93 req-c02879da-5010-4868-986c-02084030d3ab service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Received unexpected event network-vif-plugged-e204d7f5-314e-43ce-8772-e2f288f1858f for instance with vm_state active and task_state reboot_started_hard.
Apr 14 02:11:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:45 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Removed pending event for 9b29ba99-4234-4bbc-80a2-ad49127e8c9a due to event {{(pid=71498) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 02:11:45 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681438305.158349, 9b29ba99-4234-4bbc-80a2-ad49127e8c9a => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:11:45 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] VM Resumed (Lifecycle Event)
Apr 14 02:11:45 user nova-compute[71498]: DEBUG nova.compute.manager [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 02:11:45 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Instance rebooted successfully.
Apr 14 02:11:45 user nova-compute[71498]: DEBUG nova.compute.manager [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:11:45 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:11:45 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 02:11:45 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Apr 14 02:11:45 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681438305.159839, 9b29ba99-4234-4bbc-80a2-ad49127e8c9a => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:11:45 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] VM Started (Lifecycle Event)
Apr 14 02:11:45 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:11:45 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 02:11:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-7c2db672-dbbf-46fc-864c-3b95e341bc53 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.228s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:11:45 user nova-compute[71498]: DEBUG nova.compute.manager [req-788e5162-f8de-4972-901c-b30274296241 req-59a95704-98c5-4202-b148-49c5e6f160a4 service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Received event network-vif-plugged-e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:11:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-788e5162-f8de-4972-901c-b30274296241 req-59a95704-98c5-4202-b148-49c5e6f160a4 service nova] Acquiring lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:11:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-788e5162-f8de-4972-901c-b30274296241 req-59a95704-98c5-4202-b148-49c5e6f160a4 service nova] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:11:45 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-788e5162-f8de-4972-901c-b30274296241 req-59a95704-98c5-4202-b148-49c5e6f160a4 service nova] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:11:45 user nova-compute[71498]: DEBUG nova.compute.manager [req-788e5162-f8de-4972-901c-b30274296241 req-59a95704-98c5-4202-b148-49c5e6f160a4 service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] No waiting events found dispatching network-vif-plugged-e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:11:45 user nova-compute[71498]: WARNING nova.compute.manager [req-788e5162-f8de-4972-901c-b30274296241 req-59a95704-98c5-4202-b148-49c5e6f160a4 service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Received unexpected event network-vif-plugged-e204d7f5-314e-43ce-8772-e2f288f1858f for instance with vm_state active and task_state None.
Apr 14 02:11:46 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:51 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:52 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:11:52 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 02:11:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-21ac5dda-cff9-4da5-a19d-49b74491f007" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:11:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-21ac5dda-cff9-4da5-a19d-49b74491f007" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:11:52 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 02:11:52 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Updating instance_info_cache with network_info: [{"id": "38b47774-08a0-4e14-a236-fcab2f3bdb06", "address": "fa:16:3e:b9:1d:89", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b47774-08", "ovs_interfaceid": "38b47774-08a0-4e14-a236-fcab2f3bdb06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:11:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-21ac5dda-cff9-4da5-a19d-49b74491f007" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:11:52 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 02:11:52 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:11:53 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:11:53 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Cleaning up deleted instances {{(pid=71498) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 02:11:53 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] There are 0 instances to clean {{(pid=71498) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 02:11:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:54 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:11:56 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:11:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:11:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:11:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:11:56 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 02:11:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ac5dda-cff9-4da5-a19d-49b74491f007/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ac5dda-cff9-4da5-a19d-49b74491f007/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ac5dda-cff9-4da5-a19d-49b74491f007/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ac5dda-cff9-4da5-a19d-49b74491f007/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:11:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:11:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:11:57 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 02:11:57 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:11:57 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:11:57 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=8636MB free_disk=26.160640716552734GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 02:11:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:11:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:11:57 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:11:57 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 21ac5dda-cff9-4da5-a19d-49b74491f007 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:11:57 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 02:11:57 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 02:11:57 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:11:57 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:11:57 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 02:11:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:11:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:12:01 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:12:02 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:12:02 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:12:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:12:04 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:12:04 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:12:04 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:12:04 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Cleaning up deleted instances with incomplete migration  {{(pid=71498) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 02:12:06 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:12:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:12:10 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:12:10 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 02:12:11 user nova-compute[71498]: DEBUG nova.compute.manager [req-b0585f65-c56a-4d5b-b7bf-f239143ad7ae req-f7629995-5bbf-4980-916c-b1653831e95c service nova] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Received event network-changed-38b47774-08a0-4e14-a236-fcab2f3bdb06 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:12:11 user nova-compute[71498]: DEBUG nova.compute.manager [req-b0585f65-c56a-4d5b-b7bf-f239143ad7ae req-f7629995-5bbf-4980-916c-b1653831e95c service nova] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Refreshing instance network info cache due to event network-changed-38b47774-08a0-4e14-a236-fcab2f3bdb06. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 02:12:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b0585f65-c56a-4d5b-b7bf-f239143ad7ae req-f7629995-5bbf-4980-916c-b1653831e95c service nova] Acquiring lock "refresh_cache-21ac5dda-cff9-4da5-a19d-49b74491f007" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:12:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b0585f65-c56a-4d5b-b7bf-f239143ad7ae req-f7629995-5bbf-4980-916c-b1653831e95c service nova] Acquired lock "refresh_cache-21ac5dda-cff9-4da5-a19d-49b74491f007" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:12:11 user nova-compute[71498]: DEBUG nova.network.neutron [req-b0585f65-c56a-4d5b-b7bf-f239143ad7ae req-f7629995-5bbf-4980-916c-b1653831e95c service nova] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Refreshing network info cache for port 38b47774-08a0-4e14-a236-fcab2f3bdb06 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 02:12:11 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:12:11 user nova-compute[71498]: DEBUG nova.network.neutron [req-b0585f65-c56a-4d5b-b7bf-f239143ad7ae req-f7629995-5bbf-4980-916c-b1653831e95c service nova] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Updated VIF entry in instance network info cache for port 38b47774-08a0-4e14-a236-fcab2f3bdb06. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 02:12:11 user nova-compute[71498]: DEBUG nova.network.neutron [req-b0585f65-c56a-4d5b-b7bf-f239143ad7ae req-f7629995-5bbf-4980-916c-b1653831e95c service nova] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Updating instance_info_cache with network_info: [{"id": "38b47774-08a0-4e14-a236-fcab2f3bdb06", "address": "fa:16:3e:b9:1d:89", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b47774-08", "ovs_interfaceid": "38b47774-08a0-4e14-a236-fcab2f3bdb06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:12:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b0585f65-c56a-4d5b-b7bf-f239143ad7ae req-f7629995-5bbf-4980-916c-b1653831e95c service nova] Releasing lock "refresh_cache-21ac5dda-cff9-4da5-a19d-49b74491f007" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:12:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:12:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "21ac5dda-cff9-4da5-a19d-49b74491f007" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:12:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "21ac5dda-cff9-4da5-a19d-49b74491f007" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:12:14 user nova-compute[71498]: DEBUG nova.objects.instance [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lazy-loading 'flavor' on Instance uuid 21ac5dda-cff9-4da5-a19d-49b74491f007 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:12:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "21ac5dda-cff9-4da5-a19d-49b74491f007" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:12:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "21ac5dda-cff9-4da5-a19d-49b74491f007" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:12:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "21ac5dda-cff9-4da5-a19d-49b74491f007" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:12:14 user nova-compute[71498]: INFO nova.compute.manager [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Attaching volume 061ecf8a-30b1-466a-8a33-59b6281720bf to /dev/vdb
Apr 14 02:12:14 user nova-compute[71498]: DEBUG os_brick.utils [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:12:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:12:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:12:14 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3041d906-5e4c-4976-9e69-b92e9c23a302]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:12:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:12:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:12:14 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45dd48d-c86d-46dc-b344-36bb24da2906]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:12:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:12:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:12:14 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[95df275a-c0b9-4bb9-84e2-9410921e7882]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:12:14 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[295c1351-d000-4f24-ac53-2f2cb7210b1e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:12:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:12:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 02:12:14 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 02:12:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:12:14 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 02:12:14 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 02:12:14 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf8d07b-d7d9-42ac-9b24-a9a575e7c640]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:12:14 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 02:12:14 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 02:12:14 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 02:12:14 user nova-compute[71498]: DEBUG os_brick.utils [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:12:14 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Updating existing volume attachment record: a8929e11-86ac-4174-b3d8-da26d40e24e3 {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 02:12:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:12:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:12:18 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 02:12:18 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWGmUfrk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:12:18 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:12:18 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:12:18 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:12:18 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:12:18 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:12:18 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:12:18 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 02:12:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:12:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:12:18 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a77084-1fe3-431c-9a76-0b29039a8a96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:12:18 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 02:12:18 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:12:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:12:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:12:18 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a607f131-fb26-4128-8bc9-04ec7fab4ade]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:12:18 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf] added
Apr 14 02:12:18 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:12:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:12:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:12:18 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[359fad2e-ce69-4878-ba51-a6b372f6f9c5]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:12:18 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:12:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:12:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:12:18 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ac630c-65b4-4f40-854f-70d9b5cdc108]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:12:18 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:12:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LWGmUfrk {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:12:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LWGmUfrk" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:12:18 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd990a6c-02b1-4e47-a329-c91a49a5f278]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:12:18 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LWGmUfrk'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:12:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:12:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:12:18 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fda96ca-36c1-4c69-95b1-858d3d75b8dd]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:12:18 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:12:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:12:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:12:18 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e6ac16-4fc5-4c68-9c54-6878cc1fc627]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:12:18 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 (non-flash)
Apr 14 02:12:18 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:12:18 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 (non-flash)
Apr 14 02:12:18 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:12:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:12:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:12:19 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b475c3-7531-4085-956a-034f3eb9a0de]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:12:19 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf, portal: 172.16.0.220,3260]
Apr 14 02:12:19 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf, portal: 172.16.0.220,3260] successful.
Apr 14 02:12:19 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:12:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:12:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:12:19 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[80131b16-be55-4702-bc0c-d1d348b51b6d]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:12:19 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:12:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:12:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:12:19 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6421b79-3336-4ffb-929a-68f42f4c61ba]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:12:19 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 (non-flash)
Apr 14 02:12:19 user nova-compute[71498]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf (non-flash)
Apr 14 02:12:19 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:12:19 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 (non-flash)
Apr 14 02:12:19 user nova-compute[71498]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf (non-flash)
Apr 14 02:12:19 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:12:19 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:12:19 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 02:12:19 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 02:12:19 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 02:12:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:12:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:12:19 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d145d24-d779-4075-9a73-d9086547a326]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:12:19 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: None {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 02:12:20 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 02:12:20 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWGmUfrk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 02:12:20 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:12:20 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26565366365623838', 'path': '/dev/sdc'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:12:20 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565366365623838', 'path': '/dev/sdc'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 02:12:20 user nova-compute[71498]: DEBUG nova.objects.instance [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lazy-loading 'flavor' on Instance uuid 21ac5dda-cff9-4da5-a19d-49b74491f007 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:12:20 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 02:12:20 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:12:20 user nova-compute[71498]:   <source dev="/dev/sdc"/>
Apr 14 02:12:20 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 02:12:20 user nova-compute[71498]:   <serial>061ecf8a-30b1-466a-8a33-59b6281720bf</serial>
Apr 14 02:12:20 user nova-compute[71498]: </disk>
Apr 14 02:12:20 user nova-compute[71498]:  {{(pid=71498) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 02:12:20 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:12:20 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:12:20 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] No VIF found with MAC fa:16:3e:b9:1d:89, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 02:12:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-4484903e-e380-44a2-98bf-d533cefe1edf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "21ac5dda-cff9-4da5-a19d-49b74491f007" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.412s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:12:21 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:12:23 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:12:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "5728d5fc-4f3a-43af-b7a3-16c359bfd589" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:12:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "5728d5fc-4f3a-43af-b7a3-16c359bfd589" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:12:24 user nova-compute[71498]: DEBUG nova.compute.manager [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 02:12:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:12:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:12:24 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 02:12:24 user nova-compute[71498]: INFO nova.compute.claims [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Claim successful on node user
Apr 14 02:12:24 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:12:24 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:12:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.267s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:12:24 user nova-compute[71498]: DEBUG nova.compute.manager [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 02:12:24 user nova-compute[71498]: DEBUG nova.compute.manager [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 02:12:24 user nova-compute[71498]: DEBUG nova.network.neutron [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 02:12:24 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 02:12:24 user nova-compute[71498]: DEBUG nova.compute.manager [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 02:12:25 user nova-compute[71498]: DEBUG nova.policy [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '168a0142cf984aacb1f087adcaa96468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcde6e918d64d70b69d2d81e1bdbe79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 02:12:25 user nova-compute[71498]: DEBUG nova.compute.manager [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 02:12:25 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 02:12:25 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Creating image(s)
Apr 14 02:12:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "/opt/stack/data/nova/instances/5728d5fc-4f3a-43af-b7a3-16c359bfd589/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:12:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "/opt/stack/data/nova/instances/5728d5fc-4f3a-43af-b7a3-16c359bfd589/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:12:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "/opt/stack/data/nova/instances/5728d5fc-4f3a-43af-b7a3-16c359bfd589/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:12:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:12:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.132s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:12:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:12:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:12:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:12:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.139s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:12:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/5728d5fc-4f3a-43af-b7a3-16c359bfd589/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:12:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/5728d5fc-4f3a-43af-b7a3-16c359bfd589/disk 1073741824" returned: 0 in 0.048s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:12:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:12:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:12:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.135s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:12:25 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5728d5fc-4f3a-43af-b7a3-16c359bfd589/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 02:12:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5728d5fc-4f3a-43af-b7a3-16c359bfd589/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:12:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:12:25 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5728d5fc-4f3a-43af-b7a3-16c359bfd589/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:12:25 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Cannot resize image /opt/stack/data/nova/instances/5728d5fc-4f3a-43af-b7a3-16c359bfd589/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 02:12:25 user nova-compute[71498]: DEBUG nova.objects.instance [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lazy-loading 'migration_context' on Instance uuid 5728d5fc-4f3a-43af-b7a3-16c359bfd589 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:12:25 user nova-compute[71498]: DEBUG nova.network.neutron [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Successfully created port: c1285a44-0822-432f-8dc7-2d66454343e1 {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 02:12:25 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 02:12:25 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Ensure instance console log exists: /opt/stack/data/nova/instances/5728d5fc-4f3a-43af-b7a3-16c359bfd589/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 02:12:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:12:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:12:25 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:12:26 user nova-compute[71498]: DEBUG nova.network.neutron [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Successfully updated port: c1285a44-0822-432f-8dc7-2d66454343e1 {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 02:12:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "refresh_cache-5728d5fc-4f3a-43af-b7a3-16c359bfd589" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:12:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquired lock "refresh_cache-5728d5fc-4f3a-43af-b7a3-16c359bfd589" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:12:26 user nova-compute[71498]: DEBUG nova.network.neutron [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 02:12:26 user nova-compute[71498]: DEBUG nova.compute.manager [req-8170807f-2c55-42d7-8d98-9355b599fdce req-fa092e9b-9430-442d-afa5-f61c206250dd service nova] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Received event network-changed-c1285a44-0822-432f-8dc7-2d66454343e1 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:12:26 user nova-compute[71498]: DEBUG nova.compute.manager [req-8170807f-2c55-42d7-8d98-9355b599fdce req-fa092e9b-9430-442d-afa5-f61c206250dd service nova] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Refreshing instance network info cache due to event network-changed-c1285a44-0822-432f-8dc7-2d66454343e1. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 02:12:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8170807f-2c55-42d7-8d98-9355b599fdce req-fa092e9b-9430-442d-afa5-f61c206250dd service nova] Acquiring lock "refresh_cache-5728d5fc-4f3a-43af-b7a3-16c359bfd589" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:12:26 user nova-compute[71498]: DEBUG nova.network.neutron [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 02:12:26 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG nova.network.neutron [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Updating instance_info_cache with network_info: [{"id": "c1285a44-0822-432f-8dc7-2d66454343e1", "address": "fa:16:3e:cc:0a:92", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1285a44-08", "ovs_interfaceid": "c1285a44-0822-432f-8dc7-2d66454343e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Releasing lock "refresh_cache-5728d5fc-4f3a-43af-b7a3-16c359bfd589" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG nova.compute.manager [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Instance network_info: |[{"id": "c1285a44-0822-432f-8dc7-2d66454343e1", "address": "fa:16:3e:cc:0a:92", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1285a44-08", "ovs_interfaceid": "c1285a44-0822-432f-8dc7-2d66454343e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8170807f-2c55-42d7-8d98-9355b599fdce req-fa092e9b-9430-442d-afa5-f61c206250dd service nova] Acquired lock "refresh_cache-5728d5fc-4f3a-43af-b7a3-16c359bfd589" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG nova.network.neutron [req-8170807f-2c55-42d7-8d98-9355b599fdce req-fa092e9b-9430-442d-afa5-f61c206250dd service nova] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Refreshing network info cache for port c1285a44-0822-432f-8dc7-2d66454343e1 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Start _get_guest_xml network_info=[{"id": "c1285a44-0822-432f-8dc7-2d66454343e1", "address": "fa:16:3e:cc:0a:92", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1285a44-08", "ovs_interfaceid": "c1285a44-0822-432f-8dc7-2d66454343e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 02:12:27 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:12:27 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:12:27 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:12:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1112547716',display_name='tempest-AttachVolumeNegativeTest-server-1112547716',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1112547716',id=44,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJ4+1NCGI4tO0qfZ3R3Yoir5lSAMAMYO7EvxVjFGyu7gkgkkS/5jPuiDpqaoGxpbJiQZ2rscS94x5JCsuyDgjwaj4zCFezyKrr0EYSh2AlxgB2Zs09bnBWxE8HV+moyjw==',key_name='tempest-keypair-1199811974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0dcde6e918d64d70b69d2d81e1bdbe79',ramdisk_id='',reservation_id='r-m4qxc6us',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1854704348',owner_user_name='tempest-AttachVolumeNegativeTest-1854704348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T02:12:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='168a0142cf984aacb1f087adcaa96468',uuid=5728d5fc-4f3a-43af-b7a3-16c359bfd589,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1285a44-0822-432f-8dc7-2d66454343e1", "address": "fa:16:3e:cc:0a:92", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1285a44-08", "ovs_interfaceid": "c1285a44-0822-432f-8dc7-2d66454343e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Converting VIF {"id": "c1285a44-0822-432f-8dc7-2d66454343e1", "address": "fa:16:3e:cc:0a:92", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1285a44-08", "ovs_interfaceid": "c1285a44-0822-432f-8dc7-2d66454343e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:0a:92,bridge_name='br-int',has_traffic_filtering=True,id=c1285a44-0822-432f-8dc7-2d66454343e1,network=Network(981c880a-2147-4da6-8021-a03d0aee3f3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1285a44-08') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG nova.objects.instance [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lazy-loading 'pci_devices' on Instance uuid 5728d5fc-4f3a-43af-b7a3-16c359bfd589 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] End _get_guest_xml xml=<domain type="kvm">
Apr 14 02:12:27 user nova-compute[71498]:   <uuid>5728d5fc-4f3a-43af-b7a3-16c359bfd589</uuid>
Apr 14 02:12:27 user nova-compute[71498]:   <name>instance-0000002c</name>
Apr 14 02:12:27 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 02:12:27 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 02:12:27 user nova-compute[71498]:   <metadata>
Apr 14 02:12:27 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 02:12:27 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 02:12:27 user nova-compute[71498]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1112547716</nova:name>
Apr 14 02:12:27 user nova-compute[71498]:       <nova:creationTime>2023-04-14 02:12:27</nova:creationTime>
Apr 14 02:12:27 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 02:12:27 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 02:12:27 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 02:12:27 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 02:12:27 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 02:12:27 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 02:12:27 user nova-compute[71498]:       </nova:flavor>
Apr 14 02:12:27 user nova-compute[71498]:       <nova:owner>
Apr 14 02:12:27 user nova-compute[71498]:         <nova:user uuid="168a0142cf984aacb1f087adcaa96468">tempest-AttachVolumeNegativeTest-1854704348-project-member</nova:user>
Apr 14 02:12:27 user nova-compute[71498]:         <nova:project uuid="0dcde6e918d64d70b69d2d81e1bdbe79">tempest-AttachVolumeNegativeTest-1854704348</nova:project>
Apr 14 02:12:27 user nova-compute[71498]:       </nova:owner>
Apr 14 02:12:27 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 02:12:27 user nova-compute[71498]:       <nova:ports>
Apr 14 02:12:27 user nova-compute[71498]:         <nova:port uuid="c1285a44-0822-432f-8dc7-2d66454343e1">
Apr 14 02:12:27 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 14 02:12:27 user nova-compute[71498]:         </nova:port>
Apr 14 02:12:27 user nova-compute[71498]:       </nova:ports>
Apr 14 02:12:27 user nova-compute[71498]:     </nova:instance>
Apr 14 02:12:27 user nova-compute[71498]:   </metadata>
Apr 14 02:12:27 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 02:12:27 user nova-compute[71498]:     <system>
Apr 14 02:12:27 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 02:12:27 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 02:12:27 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 02:12:27 user nova-compute[71498]:       <entry name="serial">5728d5fc-4f3a-43af-b7a3-16c359bfd589</entry>
Apr 14 02:12:27 user nova-compute[71498]:       <entry name="uuid">5728d5fc-4f3a-43af-b7a3-16c359bfd589</entry>
Apr 14 02:12:27 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 02:12:27 user nova-compute[71498]:     </system>
Apr 14 02:12:27 user nova-compute[71498]:   </sysinfo>
Apr 14 02:12:27 user nova-compute[71498]:   <os>
Apr 14 02:12:27 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 02:12:27 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 02:12:27 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 02:12:27 user nova-compute[71498]:   </os>
Apr 14 02:12:27 user nova-compute[71498]:   <features>
Apr 14 02:12:27 user nova-compute[71498]:     <acpi/>
Apr 14 02:12:27 user nova-compute[71498]:     <apic/>
Apr 14 02:12:27 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 02:12:27 user nova-compute[71498]:   </features>
Apr 14 02:12:27 user nova-compute[71498]:   <clock offset="utc">
Apr 14 02:12:27 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 02:12:27 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 02:12:27 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 02:12:27 user nova-compute[71498]:   </clock>
Apr 14 02:12:27 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 02:12:27 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 02:12:27 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 02:12:27 user nova-compute[71498]:   </cpu>
Apr 14 02:12:27 user nova-compute[71498]:   <devices>
Apr 14 02:12:27 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 02:12:27 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 02:12:27 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/5728d5fc-4f3a-43af-b7a3-16c359bfd589/disk"/>
Apr 14 02:12:27 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 02:12:27 user nova-compute[71498]:     </disk>
Apr 14 02:12:27 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 02:12:27 user nova-compute[71498]:       <mac address="fa:16:3e:cc:0a:92"/>
Apr 14 02:12:27 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 02:12:27 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 02:12:27 user nova-compute[71498]:       <target dev="tapc1285a44-08"/>
Apr 14 02:12:27 user nova-compute[71498]:     </interface>
Apr 14 02:12:27 user nova-compute[71498]:     <serial type="pty">
Apr 14 02:12:27 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/5728d5fc-4f3a-43af-b7a3-16c359bfd589/console.log" append="off"/>
Apr 14 02:12:27 user nova-compute[71498]:     </serial>
Apr 14 02:12:27 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 02:12:27 user nova-compute[71498]:     <video>
Apr 14 02:12:27 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 02:12:27 user nova-compute[71498]:     </video>
Apr 14 02:12:27 user nova-compute[71498]:     <rng model="virtio">
Apr 14 02:12:27 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 02:12:27 user nova-compute[71498]:     </rng>
Apr 14 02:12:27 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 02:12:27 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 02:12:27 user nova-compute[71498]:       <stats period="10"/>
Apr 14 02:12:27 user nova-compute[71498]:     </memballoon>
Apr 14 02:12:27 user nova-compute[71498]:   </devices>
Apr 14 02:12:27 user nova-compute[71498]: </domain>
Apr 14 02:12:27 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:12:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1112547716',display_name='tempest-AttachVolumeNegativeTest-server-1112547716',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1112547716',id=44,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJ4+1NCGI4tO0qfZ3R3Yoir5lSAMAMYO7EvxVjFGyu7gkgkkS/5jPuiDpqaoGxpbJiQZ2rscS94x5JCsuyDgjwaj4zCFezyKrr0EYSh2AlxgB2Zs09bnBWxE8HV+moyjw==',key_name='tempest-keypair-1199811974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0dcde6e918d64d70b69d2d81e1bdbe79',ramdisk_id='',reservation_id='r-m4qxc6us',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1854704348',owner_user_name='tempest-AttachVolumeNegativeTest-1854704348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T02:12:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='168a0142cf984aacb1f087adcaa96468',uuid=5728d5fc-4f3a-43af-b7a3-16c359bfd589,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1285a44-0822-432f-8dc7-2d66454343e1", "address": "fa:16:3e:cc:0a:92", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1285a44-08", "ovs_interfaceid": "c1285a44-0822-432f-8dc7-2d66454343e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Converting VIF {"id": "c1285a44-0822-432f-8dc7-2d66454343e1", "address": "fa:16:3e:cc:0a:92", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1285a44-08", "ovs_interfaceid": "c1285a44-0822-432f-8dc7-2d66454343e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:0a:92,bridge_name='br-int',has_traffic_filtering=True,id=c1285a44-0822-432f-8dc7-2d66454343e1,network=Network(981c880a-2147-4da6-8021-a03d0aee3f3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1285a44-08') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG os_vif [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:0a:92,bridge_name='br-int',has_traffic_filtering=True,id=c1285a44-0822-432f-8dc7-2d66454343e1,network=Network(981c880a-2147-4da6-8021-a03d0aee3f3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1285a44-08') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1285a44-08, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc1285a44-08, col_values=(('external_ids', {'iface-id': 'c1285a44-0822-432f-8dc7-2d66454343e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:0a:92', 'vm-uuid': '5728d5fc-4f3a-43af-b7a3-16c359bfd589'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:12:27 user nova-compute[71498]: INFO os_vif [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:0a:92,bridge_name='br-int',has_traffic_filtering=True,id=c1285a44-0822-432f-8dc7-2d66454343e1,network=Network(981c880a-2147-4da6-8021-a03d0aee3f3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1285a44-08')
Apr 14 02:12:27 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] No VIF found with MAC fa:16:3e:cc:0a:92, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG nova.network.neutron [req-8170807f-2c55-42d7-8d98-9355b599fdce req-fa092e9b-9430-442d-afa5-f61c206250dd service nova] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Updated VIF entry in instance network info cache for port c1285a44-0822-432f-8dc7-2d66454343e1. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG nova.network.neutron [req-8170807f-2c55-42d7-8d98-9355b599fdce req-fa092e9b-9430-442d-afa5-f61c206250dd service nova] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Updating instance_info_cache with network_info: [{"id": "c1285a44-0822-432f-8dc7-2d66454343e1", "address": "fa:16:3e:cc:0a:92", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1285a44-08", "ovs_interfaceid": "c1285a44-0822-432f-8dc7-2d66454343e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:12:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8170807f-2c55-42d7-8d98-9355b599fdce req-fa092e9b-9430-442d-afa5-f61c206250dd service nova] Releasing lock "refresh_cache-5728d5fc-4f3a-43af-b7a3-16c359bfd589" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:12:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:12:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:12:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:12:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:12:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:12:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:12:28 user nova-compute[71498]: DEBUG nova.compute.manager [req-3aba93df-dd63-482e-be54-e8ce3ac65d05 req-c15eaa26-39fa-4085-9710-94d02fdeddbe service nova] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Received event network-vif-plugged-c1285a44-0822-432f-8dc7-2d66454343e1 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:12:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3aba93df-dd63-482e-be54-e8ce3ac65d05 req-c15eaa26-39fa-4085-9710-94d02fdeddbe service nova] Acquiring lock "5728d5fc-4f3a-43af-b7a3-16c359bfd589-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:12:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3aba93df-dd63-482e-be54-e8ce3ac65d05 req-c15eaa26-39fa-4085-9710-94d02fdeddbe service nova] Lock "5728d5fc-4f3a-43af-b7a3-16c359bfd589-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:12:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-3aba93df-dd63-482e-be54-e8ce3ac65d05 req-c15eaa26-39fa-4085-9710-94d02fdeddbe service nova] Lock "5728d5fc-4f3a-43af-b7a3-16c359bfd589-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:12:28 user nova-compute[71498]: DEBUG nova.compute.manager [req-3aba93df-dd63-482e-be54-e8ce3ac65d05 req-c15eaa26-39fa-4085-9710-94d02fdeddbe service nova] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] No waiting events found dispatching network-vif-plugged-c1285a44-0822-432f-8dc7-2d66454343e1 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:12:28 user nova-compute[71498]: WARNING nova.compute.manager [req-3aba93df-dd63-482e-be54-e8ce3ac65d05 req-c15eaa26-39fa-4085-9710-94d02fdeddbe service nova] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Received unexpected event network-vif-plugged-c1285a44-0822-432f-8dc7-2d66454343e1 for instance with vm_state building and task_state spawning.
Apr 14 02:12:30 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681438350.5565696, 5728d5fc-4f3a-43af-b7a3-16c359bfd589 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:12:30 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] VM Resumed (Lifecycle Event)
Apr 14 02:12:30 user nova-compute[71498]: DEBUG nova.compute.manager [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 02:12:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 02:12:30 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Instance spawned successfully.
Apr 14 02:12:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 02:12:30 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:12:30 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 02:12:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:12:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:12:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:12:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:12:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:12:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:12:30 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 02:12:30 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681438350.5597885, 5728d5fc-4f3a-43af-b7a3-16c359bfd589 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:12:30 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] VM Started (Lifecycle Event)
Apr 14 02:12:30 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:12:30 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 02:12:30 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 02:12:30 user nova-compute[71498]: INFO nova.compute.manager [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Took 5.57 seconds to spawn the instance on the hypervisor.
Apr 14 02:12:30 user nova-compute[71498]: DEBUG nova.compute.manager [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:12:30 user nova-compute[71498]: INFO nova.compute.manager [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Took 6.16 seconds to build instance.
Apr 14 02:12:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-e9a40395-f232-463c-be67-467c4a895b52 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "5728d5fc-4f3a-43af-b7a3-16c359bfd589" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.267s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:12:30 user nova-compute[71498]: DEBUG nova.compute.manager [req-8a1a0de0-db08-4ef3-89e9-5d36f47bdbc2 req-520593e4-bc49-42d4-ab17-b8510d2bc2ab service nova] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Received event network-vif-plugged-c1285a44-0822-432f-8dc7-2d66454343e1 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:12:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8a1a0de0-db08-4ef3-89e9-5d36f47bdbc2 req-520593e4-bc49-42d4-ab17-b8510d2bc2ab service nova] Acquiring lock "5728d5fc-4f3a-43af-b7a3-16c359bfd589-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:12:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8a1a0de0-db08-4ef3-89e9-5d36f47bdbc2 req-520593e4-bc49-42d4-ab17-b8510d2bc2ab service nova] Lock "5728d5fc-4f3a-43af-b7a3-16c359bfd589-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:12:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-8a1a0de0-db08-4ef3-89e9-5d36f47bdbc2 req-520593e4-bc49-42d4-ab17-b8510d2bc2ab service nova] Lock "5728d5fc-4f3a-43af-b7a3-16c359bfd589-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:12:30 user nova-compute[71498]: DEBUG nova.compute.manager [req-8a1a0de0-db08-4ef3-89e9-5d36f47bdbc2 req-520593e4-bc49-42d4-ab17-b8510d2bc2ab service nova] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] No waiting events found dispatching network-vif-plugged-c1285a44-0822-432f-8dc7-2d66454343e1 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:12:30 user nova-compute[71498]: WARNING nova.compute.manager [req-8a1a0de0-db08-4ef3-89e9-5d36f47bdbc2 req-520593e4-bc49-42d4-ab17-b8510d2bc2ab service nova] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Received unexpected event network-vif-plugged-c1285a44-0822-432f-8dc7-2d66454343e1 for instance with vm_state active and task_state None.
Apr 14 02:12:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:12:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:12:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:12:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:12:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:12:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:12:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:12:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:12:52 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:12:53 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:12:53 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 02:12:53 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Rebuilding the list of instances to heal {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 02:12:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-9b29ba99-4234-4bbc-80a2-ad49127e8c9a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:12:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-9b29ba99-4234-4bbc-80a2-ad49127e8c9a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:12:53 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 02:12:53 user nova-compute[71498]: DEBUG nova.objects.instance [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lazy-loading 'info_cache' on Instance uuid 9b29ba99-4234-4bbc-80a2-ad49127e8c9a {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:12:53 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Updating instance_info_cache with network_info: [{"id": "e204d7f5-314e-43ce-8772-e2f288f1858f", "address": "fa:16:3e:30:bf:7a", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape204d7f5-31", "ovs_interfaceid": "e204d7f5-314e-43ce-8772-e2f288f1858f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:12:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-9b29ba99-4234-4bbc-80a2-ad49127e8c9a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:12:53 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 02:12:56 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:12:56 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:12:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:12:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:12:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:12:56 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 02:12:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ac5dda-cff9-4da5-a19d-49b74491f007/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:12:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ac5dda-cff9-4da5-a19d-49b74491f007/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:12:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ac5dda-cff9-4da5-a19d-49b74491f007/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:12:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ac5dda-cff9-4da5-a19d-49b74491f007/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:12:56 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 02:12:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5728d5fc-4f3a-43af-b7a3-16c359bfd589/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:12:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5728d5fc-4f3a-43af-b7a3-16c359bfd589/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:12:56 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5728d5fc-4f3a-43af-b7a3-16c359bfd589/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:12:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5728d5fc-4f3a-43af-b7a3-16c359bfd589/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:12:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:12:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:12:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:12:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:12:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:12:57 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 02:12:57 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:12:57 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:12:57 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=8658MB free_disk=26.13082504272461GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 02:12:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:12:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:12:58 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:12:58 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 21ac5dda-cff9-4da5-a19d-49b74491f007 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:12:58 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 5728d5fc-4f3a-43af-b7a3-16c359bfd589 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:12:58 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 02:12:58 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 02:12:58 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Refreshing inventories for resource provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 02:12:58 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Updating ProviderTree inventory for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 02:12:58 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Updating inventory in ProviderTree for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 02:12:58 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Refreshing aggregate associations for resource provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4, aggregates: None {{(pid=71498) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 02:12:58 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Refreshing trait associations for resource provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,HW_CPU_X86_SSE2 {{(pid=71498) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 02:12:58 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:12:58 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:12:58 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 02:12:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.521s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:12:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:13:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:13:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:13:05 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:13:05 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:13:05 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:13:06 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:13:06 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:13:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:13:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:13:11 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:13:11 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 02:13:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:13:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:13:17 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:13:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:13:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:13:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:13:29 user nova-compute[71498]: DEBUG nova.compute.manager [req-39c2429b-f96c-4050-acda-2edd61a0fc7c req-5e592f9b-0847-4d6b-92e9-b43d0784bd0b service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Received event network-changed-e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:13:29 user nova-compute[71498]: DEBUG nova.compute.manager [req-39c2429b-f96c-4050-acda-2edd61a0fc7c req-5e592f9b-0847-4d6b-92e9-b43d0784bd0b service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Refreshing instance network info cache due to event network-changed-e204d7f5-314e-43ce-8772-e2f288f1858f. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 02:13:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-39c2429b-f96c-4050-acda-2edd61a0fc7c req-5e592f9b-0847-4d6b-92e9-b43d0784bd0b service nova] Acquiring lock "refresh_cache-9b29ba99-4234-4bbc-80a2-ad49127e8c9a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:13:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-39c2429b-f96c-4050-acda-2edd61a0fc7c req-5e592f9b-0847-4d6b-92e9-b43d0784bd0b service nova] Acquired lock "refresh_cache-9b29ba99-4234-4bbc-80a2-ad49127e8c9a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:13:29 user nova-compute[71498]: DEBUG nova.network.neutron [req-39c2429b-f96c-4050-acda-2edd61a0fc7c req-5e592f9b-0847-4d6b-92e9-b43d0784bd0b service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Refreshing network info cache for port e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 02:13:30 user nova-compute[71498]: DEBUG nova.network.neutron [req-39c2429b-f96c-4050-acda-2edd61a0fc7c req-5e592f9b-0847-4d6b-92e9-b43d0784bd0b service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Updated VIF entry in instance network info cache for port e204d7f5-314e-43ce-8772-e2f288f1858f. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 02:13:30 user nova-compute[71498]: DEBUG nova.network.neutron [req-39c2429b-f96c-4050-acda-2edd61a0fc7c req-5e592f9b-0847-4d6b-92e9-b43d0784bd0b service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Updating instance_info_cache with network_info: [{"id": "e204d7f5-314e-43ce-8772-e2f288f1858f", "address": "fa:16:3e:30:bf:7a", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape204d7f5-31", "ovs_interfaceid": "e204d7f5-314e-43ce-8772-e2f288f1858f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:13:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-39c2429b-f96c-4050-acda-2edd61a0fc7c req-5e592f9b-0847-4d6b-92e9-b43d0784bd0b service nova] Releasing lock "refresh_cache-9b29ba99-4234-4bbc-80a2-ad49127e8c9a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:13:30 user nova-compute[71498]: DEBUG nova.compute.manager [req-cab1dca7-9280-47ee-9d4b-8793ae764aea req-77f45c40-cc49-49ea-8bf1-a96204b1594f service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Received event network-changed-e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:13:30 user nova-compute[71498]: DEBUG nova.compute.manager [req-cab1dca7-9280-47ee-9d4b-8793ae764aea req-77f45c40-cc49-49ea-8bf1-a96204b1594f service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Refreshing instance network info cache due to event network-changed-e204d7f5-314e-43ce-8772-e2f288f1858f. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 02:13:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-cab1dca7-9280-47ee-9d4b-8793ae764aea req-77f45c40-cc49-49ea-8bf1-a96204b1594f service nova] Acquiring lock "refresh_cache-9b29ba99-4234-4bbc-80a2-ad49127e8c9a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:13:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-cab1dca7-9280-47ee-9d4b-8793ae764aea req-77f45c40-cc49-49ea-8bf1-a96204b1594f service nova] Acquired lock "refresh_cache-9b29ba99-4234-4bbc-80a2-ad49127e8c9a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:13:30 user nova-compute[71498]: DEBUG nova.network.neutron [req-cab1dca7-9280-47ee-9d4b-8793ae764aea req-77f45c40-cc49-49ea-8bf1-a96204b1594f service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Refreshing network info cache for port e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 02:13:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:13:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:13:30 user nova-compute[71498]: INFO nova.compute.manager [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Detaching volume 9f12b47d-8b55-4650-9f88-e50281b67877
Apr 14 02:13:30 user nova-compute[71498]: INFO nova.virt.block_device [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Attempting to driver detach volume 9f12b47d-8b55-4650-9f88-e50281b67877 from mountpoint /dev/vdb
Apr 14 02:13:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Attempting to detach device vdb from instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a from the persistent domain config. {{(pid=71498) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 02:13:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 02:13:30 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:13:30 user nova-compute[71498]:   <source dev="/dev/sdb"/>
Apr 14 02:13:30 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 02:13:30 user nova-compute[71498]:   <serial>9f12b47d-8b55-4650-9f88-e50281b67877</serial>
Apr 14 02:13:30 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 02:13:30 user nova-compute[71498]: </disk>
Apr 14 02:13:30 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 02:13:30 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Successfully detached device vdb from instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a from the persistent domain config.
Apr 14 02:13:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a from the live domain config. {{(pid=71498) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 02:13:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 02:13:30 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:13:30 user nova-compute[71498]:   <source dev="/dev/sdb"/>
Apr 14 02:13:30 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 02:13:30 user nova-compute[71498]:   <serial>9f12b47d-8b55-4650-9f88-e50281b67877</serial>
Apr 14 02:13:30 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 02:13:30 user nova-compute[71498]: </disk>
Apr 14 02:13:30 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG nova.network.neutron [req-cab1dca7-9280-47ee-9d4b-8793ae764aea req-77f45c40-cc49-49ea-8bf1-a96204b1594f service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Updated VIF entry in instance network info cache for port e204d7f5-314e-43ce-8772-e2f288f1858f. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG nova.network.neutron [req-cab1dca7-9280-47ee-9d4b-8793ae764aea req-77f45c40-cc49-49ea-8bf1-a96204b1594f service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Updating instance_info_cache with network_info: [{"id": "e204d7f5-314e-43ce-8772-e2f288f1858f", "address": "fa:16:3e:30:bf:7a", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape204d7f5-31", "ovs_interfaceid": "e204d7f5-314e-43ce-8772-e2f288f1858f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-cab1dca7-9280-47ee-9d4b-8793ae764aea req-77f45c40-cc49-49ea-8bf1-a96204b1594f service nova] Releasing lock "refresh_cache-9b29ba99-4234-4bbc-80a2-ad49127e8c9a" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Received event <DeviceRemovedEvent: 1681438411.4285278, 9b29ba99-4234-4bbc-80a2-ad49127e8c9a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71498) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a {{(pid=71498) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 02:13:31 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Successfully detached device vdb from instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a from the live domain config.
Apr 14 02:13:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xPHDCKoL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:13:31 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:13:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d670eec-f156-420d-abe3-5f1d4871694e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 02:13:31 user nova-compute[71498]: No targets found.
Apr 14 02:13:31 user nova-compute[71498]: iSNS:
Apr 14 02:13:31 user nova-compute[71498]: No targets found.
Apr 14 02:13:31 user nova-compute[71498]: STATIC:
Apr 14 02:13:31 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877
Apr 14 02:13:31 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 02:13:31 user nova-compute[71498]:                 Iface Name: default
Apr 14 02:13:31 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf
Apr 14 02:13:31 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 02:13:31 user nova-compute[71498]:                 Iface Name: default
Apr 14 02:13:31 user nova-compute[71498]: FIRMWARE:
Apr 14 02:13:31 user nova-compute[71498]: No targets found.
Apr 14 02:13:31 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 02:13:31 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 02:13:31 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[20aa24cf-e0ea-46d3-9004-96f4e456313a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c120ae11-5b21-401e-8dfd-2b76f86cb34d]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 (non-flash)
Apr 14 02:13:31 user nova-compute[71498]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf (non-flash)
Apr 14 02:13:31 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 (non-flash)
Apr 14 02:13:31 user nova-compute[71498]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf (non-flash)
Apr 14 02:13:31 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f520136bc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877'): ({'sdb'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Removing single pathed devices sdb {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2217284-64fd-47a6-b2c6-89fe211fa302]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c4a78b-2f8d-4cdd-95d5-391307799382]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Flushing IO for device /dev/sdb {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[396501ac-fd08-4d02-b38e-a81ba2dca08f]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bba6e1-0be5-40df-8f9d-5d830421b5c0]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] SCSI volumes sdb have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d32ef4-2f70-4bc5-8c45-303ea5afb794]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[854cddf7-aa64-48e4-ac1f-574c3431938e]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877, portal: 172.16.0.220,3260]
Apr 14 02:13:31 user nova-compute[71498]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877, portal: 172.16.0.220,3260] successful.
Apr 14 02:13:31 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f12b47d-8b55-4650-9f88-e50281b67877 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e9e89d-f79e-4338-9261-663b72546f95]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] <== disconnect_volume: return (310ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:13:31 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 02:13:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:13:32 user nova-compute[71498]: DEBUG nova.objects.instance [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lazy-loading 'flavor' on Instance uuid 9b29ba99-4234-4bbc-80a2-ad49127e8c9a {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:13:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-28a60013-ab5b-4a6e-bb7b-b157b58459e7 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.957s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:13:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:13:37 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:13:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:13:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:13:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:13:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:13:53 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:13:54 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:13:54 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 02:13:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-21ac5dda-cff9-4da5-a19d-49b74491f007" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:13:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-21ac5dda-cff9-4da5-a19d-49b74491f007" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:13:54 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 02:13:54 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Updating instance_info_cache with network_info: [{"id": "38b47774-08a0-4e14-a236-fcab2f3bdb06", "address": "fa:16:3e:b9:1d:89", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b47774-08", "ovs_interfaceid": "38b47774-08a0-4e14-a236-fcab2f3bdb06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:13:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-21ac5dda-cff9-4da5-a19d-49b74491f007" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:13:54 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 02:13:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:13:57 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:13:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:13:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:13:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:13:57 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 02:13:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ac5dda-cff9-4da5-a19d-49b74491f007/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:13:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ac5dda-cff9-4da5-a19d-49b74491f007/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:13:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ac5dda-cff9-4da5-a19d-49b74491f007/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:13:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ac5dda-cff9-4da5-a19d-49b74491f007/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:13:57 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 02:13:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5728d5fc-4f3a-43af-b7a3-16c359bfd589/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:13:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5728d5fc-4f3a-43af-b7a3-16c359bfd589/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:13:57 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5728d5fc-4f3a-43af-b7a3-16c359bfd589/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:13:58 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5728d5fc-4f3a-43af-b7a3-16c359bfd589/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:13:58 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:13:58 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:13:58 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:13:58 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:13:58 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:13:58 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:13:58 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=8651MB free_disk=26.129989624023438GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 02:13:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:13:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:13:58 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:13:58 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 21ac5dda-cff9-4da5-a19d-49b74491f007 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:13:58 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 5728d5fc-4f3a-43af-b7a3-16c359bfd589 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:13:58 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 02:13:58 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 02:13:59 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:13:59 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:13:59 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 02:13:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:14:00 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:14:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:14:03 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:14:04 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:14:06 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:14:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:14:08 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:14:11 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:14:11 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 02:14:12 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:14:15 user nova-compute[71498]: DEBUG nova.compute.manager [req-a0a4b7a3-b888-48c6-bac9-795f78b84807 req-99baadf8-f44e-438e-a9ad-1c1b82bf7c8a service nova] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Received event network-changed-c1285a44-0822-432f-8dc7-2d66454343e1 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:14:15 user nova-compute[71498]: DEBUG nova.compute.manager [req-a0a4b7a3-b888-48c6-bac9-795f78b84807 req-99baadf8-f44e-438e-a9ad-1c1b82bf7c8a service nova] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Refreshing instance network info cache due to event network-changed-c1285a44-0822-432f-8dc7-2d66454343e1. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 02:14:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a0a4b7a3-b888-48c6-bac9-795f78b84807 req-99baadf8-f44e-438e-a9ad-1c1b82bf7c8a service nova] Acquiring lock "refresh_cache-5728d5fc-4f3a-43af-b7a3-16c359bfd589" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:14:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a0a4b7a3-b888-48c6-bac9-795f78b84807 req-99baadf8-f44e-438e-a9ad-1c1b82bf7c8a service nova] Acquired lock "refresh_cache-5728d5fc-4f3a-43af-b7a3-16c359bfd589" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:14:15 user nova-compute[71498]: DEBUG nova.network.neutron [req-a0a4b7a3-b888-48c6-bac9-795f78b84807 req-99baadf8-f44e-438e-a9ad-1c1b82bf7c8a service nova] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Refreshing network info cache for port c1285a44-0822-432f-8dc7-2d66454343e1 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 02:14:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-01d657e6-faa6-4351-b52e-40baf42bb40d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "5728d5fc-4f3a-43af-b7a3-16c359bfd589" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:14:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-01d657e6-faa6-4351-b52e-40baf42bb40d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "5728d5fc-4f3a-43af-b7a3-16c359bfd589" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:14:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-01d657e6-faa6-4351-b52e-40baf42bb40d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "5728d5fc-4f3a-43af-b7a3-16c359bfd589-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:14:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-01d657e6-faa6-4351-b52e-40baf42bb40d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "5728d5fc-4f3a-43af-b7a3-16c359bfd589-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:14:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-01d657e6-faa6-4351-b52e-40baf42bb40d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "5728d5fc-4f3a-43af-b7a3-16c359bfd589-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:14:15 user nova-compute[71498]: INFO nova.compute.manager [None req-01d657e6-faa6-4351-b52e-40baf42bb40d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Terminating instance
Apr 14 02:14:15 user nova-compute[71498]: DEBUG nova.compute.manager [None req-01d657e6-faa6-4351-b52e-40baf42bb40d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 02:14:15 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:14:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:14:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:14:16 user nova-compute[71498]: DEBUG nova.compute.manager [req-e39a2e9d-1629-4464-b262-d0fbb191ef32 req-79095fb2-7c38-465a-8463-e11bb676ab3a service nova] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Received event network-vif-unplugged-c1285a44-0822-432f-8dc7-2d66454343e1 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:14:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e39a2e9d-1629-4464-b262-d0fbb191ef32 req-79095fb2-7c38-465a-8463-e11bb676ab3a service nova] Acquiring lock "5728d5fc-4f3a-43af-b7a3-16c359bfd589-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:14:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e39a2e9d-1629-4464-b262-d0fbb191ef32 req-79095fb2-7c38-465a-8463-e11bb676ab3a service nova] Lock "5728d5fc-4f3a-43af-b7a3-16c359bfd589-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:14:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-e39a2e9d-1629-4464-b262-d0fbb191ef32 req-79095fb2-7c38-465a-8463-e11bb676ab3a service nova] Lock "5728d5fc-4f3a-43af-b7a3-16c359bfd589-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:14:16 user nova-compute[71498]: DEBUG nova.compute.manager [req-e39a2e9d-1629-4464-b262-d0fbb191ef32 req-79095fb2-7c38-465a-8463-e11bb676ab3a service nova] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] No waiting events found dispatching network-vif-unplugged-c1285a44-0822-432f-8dc7-2d66454343e1 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:14:16 user nova-compute[71498]: DEBUG nova.compute.manager [req-e39a2e9d-1629-4464-b262-d0fbb191ef32 req-79095fb2-7c38-465a-8463-e11bb676ab3a service nova] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Received event network-vif-unplugged-c1285a44-0822-432f-8dc7-2d66454343e1 for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 02:14:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:14:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:14:16 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Instance destroyed successfully.
Apr 14 02:14:16 user nova-compute[71498]: DEBUG nova.objects.instance [None req-01d657e6-faa6-4351-b52e-40baf42bb40d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lazy-loading 'resources' on Instance uuid 5728d5fc-4f3a-43af-b7a3-16c359bfd589 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:14:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-01d657e6-faa6-4351-b52e-40baf42bb40d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:12:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1112547716',display_name='tempest-AttachVolumeNegativeTest-server-1112547716',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1112547716',id=44,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJ4+1NCGI4tO0qfZ3R3Yoir5lSAMAMYO7EvxVjFGyu7gkgkkS/5jPuiDpqaoGxpbJiQZ2rscS94x5JCsuyDgjwaj4zCFezyKrr0EYSh2AlxgB2Zs09bnBWxE8HV+moyjw==',key_name='tempest-keypair-1199811974',keypairs=<?>,launch_index=0,launched_at=2023-04-14T02:12:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0dcde6e918d64d70b69d2d81e1bdbe79',ramdisk_id='',reservation_id='r-m4qxc6us',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1854704348',owner_user_name='tempest-AttachVolumeNegativeTest-1854704348-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T02:12:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='168a0142cf984aacb1f087adcaa96468',uuid=5728d5fc-4f3a-43af-b7a3-16c359bfd589,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1285a44-0822-432f-8dc7-2d66454343e1", "address": "fa:16:3e:cc:0a:92", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1285a44-08", "ovs_interfaceid": "c1285a44-0822-432f-8dc7-2d66454343e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 02:14:16 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-01d657e6-faa6-4351-b52e-40baf42bb40d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Converting VIF {"id": "c1285a44-0822-432f-8dc7-2d66454343e1", "address": "fa:16:3e:cc:0a:92", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1285a44-08", "ovs_interfaceid": "c1285a44-0822-432f-8dc7-2d66454343e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:14:16 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-01d657e6-faa6-4351-b52e-40baf42bb40d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:0a:92,bridge_name='br-int',has_traffic_filtering=True,id=c1285a44-0822-432f-8dc7-2d66454343e1,network=Network(981c880a-2147-4da6-8021-a03d0aee3f3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1285a44-08') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:14:16 user nova-compute[71498]: DEBUG os_vif [None req-01d657e6-faa6-4351-b52e-40baf42bb40d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:0a:92,bridge_name='br-int',has_traffic_filtering=True,id=c1285a44-0822-432f-8dc7-2d66454343e1,network=Network(981c880a-2147-4da6-8021-a03d0aee3f3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1285a44-08') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 02:14:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:14:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1285a44-08, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:14:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:14:16 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:14:16 user nova-compute[71498]: INFO os_vif [None req-01d657e6-faa6-4351-b52e-40baf42bb40d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:0a:92,bridge_name='br-int',has_traffic_filtering=True,id=c1285a44-0822-432f-8dc7-2d66454343e1,network=Network(981c880a-2147-4da6-8021-a03d0aee3f3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1285a44-08')
Apr 14 02:14:16 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-01d657e6-faa6-4351-b52e-40baf42bb40d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Deleting instance files /opt/stack/data/nova/instances/5728d5fc-4f3a-43af-b7a3-16c359bfd589_del
Apr 14 02:14:16 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-01d657e6-faa6-4351-b52e-40baf42bb40d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Deletion of /opt/stack/data/nova/instances/5728d5fc-4f3a-43af-b7a3-16c359bfd589_del complete
Apr 14 02:14:16 user nova-compute[71498]: DEBUG nova.network.neutron [req-a0a4b7a3-b888-48c6-bac9-795f78b84807 req-99baadf8-f44e-438e-a9ad-1c1b82bf7c8a service nova] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Updated VIF entry in instance network info cache for port c1285a44-0822-432f-8dc7-2d66454343e1. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 02:14:16 user nova-compute[71498]: DEBUG nova.network.neutron [req-a0a4b7a3-b888-48c6-bac9-795f78b84807 req-99baadf8-f44e-438e-a9ad-1c1b82bf7c8a service nova] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Updating instance_info_cache with network_info: [{"id": "c1285a44-0822-432f-8dc7-2d66454343e1", "address": "fa:16:3e:cc:0a:92", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1285a44-08", "ovs_interfaceid": "c1285a44-0822-432f-8dc7-2d66454343e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:14:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-a0a4b7a3-b888-48c6-bac9-795f78b84807 req-99baadf8-f44e-438e-a9ad-1c1b82bf7c8a service nova] Releasing lock "refresh_cache-5728d5fc-4f3a-43af-b7a3-16c359bfd589" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:14:16 user nova-compute[71498]: INFO nova.compute.manager [None req-01d657e6-faa6-4351-b52e-40baf42bb40d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Took 0.64 seconds to destroy the instance on the hypervisor.
Apr 14 02:14:16 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-01d657e6-faa6-4351-b52e-40baf42bb40d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 02:14:16 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 02:14:16 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 02:14:17 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:14:17 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Took 0.77 seconds to deallocate network for instance.
Apr 14 02:14:17 user nova-compute[71498]: DEBUG nova.compute.manager [req-babc2f5b-f7aa-4855-9795-7f3eb5ba36af req-ae23a64e-7113-4fa2-92b0-a369020850f7 service nova] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Received event network-vif-deleted-c1285a44-0822-432f-8dc7-2d66454343e1 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:14:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-01d657e6-faa6-4351-b52e-40baf42bb40d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:14:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-01d657e6-faa6-4351-b52e-40baf42bb40d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:14:17 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-01d657e6-faa6-4351-b52e-40baf42bb40d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:14:17 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-01d657e6-faa6-4351-b52e-40baf42bb40d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:14:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-01d657e6-faa6-4351-b52e-40baf42bb40d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.146s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:14:17 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-01d657e6-faa6-4351-b52e-40baf42bb40d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Deleted allocations for instance 5728d5fc-4f3a-43af-b7a3-16c359bfd589
Apr 14 02:14:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-01d657e6-faa6-4351-b52e-40baf42bb40d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "5728d5fc-4f3a-43af-b7a3-16c359bfd589" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.729s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:14:18 user nova-compute[71498]: DEBUG nova.compute.manager [req-87291894-3d68-48e0-ae49-4857576ae6a4 req-4d193657-f4e9-48e8-b3e9-6cd02c65f46d service nova] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Received event network-vif-plugged-c1285a44-0822-432f-8dc7-2d66454343e1 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:14:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-87291894-3d68-48e0-ae49-4857576ae6a4 req-4d193657-f4e9-48e8-b3e9-6cd02c65f46d service nova] Acquiring lock "5728d5fc-4f3a-43af-b7a3-16c359bfd589-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:14:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-87291894-3d68-48e0-ae49-4857576ae6a4 req-4d193657-f4e9-48e8-b3e9-6cd02c65f46d service nova] Lock "5728d5fc-4f3a-43af-b7a3-16c359bfd589-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:14:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-87291894-3d68-48e0-ae49-4857576ae6a4 req-4d193657-f4e9-48e8-b3e9-6cd02c65f46d service nova] Lock "5728d5fc-4f3a-43af-b7a3-16c359bfd589-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:14:18 user nova-compute[71498]: DEBUG nova.compute.manager [req-87291894-3d68-48e0-ae49-4857576ae6a4 req-4d193657-f4e9-48e8-b3e9-6cd02c65f46d service nova] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] No waiting events found dispatching network-vif-plugged-c1285a44-0822-432f-8dc7-2d66454343e1 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:14:18 user nova-compute[71498]: WARNING nova.compute.manager [req-87291894-3d68-48e0-ae49-4857576ae6a4 req-4d193657-f4e9-48e8-b3e9-6cd02c65f46d service nova] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Received unexpected event network-vif-plugged-c1285a44-0822-432f-8dc7-2d66454343e1 for instance with vm_state deleted and task_state None.
Apr 14 02:14:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:14:21 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:14:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:14:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c7fe9031-7d52-454c-b64b-3a34e17a8044 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:14:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c7fe9031-7d52-454c-b64b-3a34e17a8044 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:14:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c7fe9031-7d52-454c-b64b-3a34e17a8044 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:14:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c7fe9031-7d52-454c-b64b-3a34e17a8044 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:14:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c7fe9031-7d52-454c-b64b-3a34e17a8044 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:14:24 user nova-compute[71498]: INFO nova.compute.manager [None req-c7fe9031-7d52-454c-b64b-3a34e17a8044 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Terminating instance
Apr 14 02:14:24 user nova-compute[71498]: DEBUG nova.compute.manager [None req-c7fe9031-7d52-454c-b64b-3a34e17a8044 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 02:14:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:14:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:14:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:14:24 user nova-compute[71498]: DEBUG nova.compute.manager [req-09ed36ca-881e-4da0-877e-9cce9cb1f8f2 req-97433d2a-c341-4bd1-810a-2170135aad39 service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Received event network-vif-unplugged-e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:14:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-09ed36ca-881e-4da0-877e-9cce9cb1f8f2 req-97433d2a-c341-4bd1-810a-2170135aad39 service nova] Acquiring lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:14:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-09ed36ca-881e-4da0-877e-9cce9cb1f8f2 req-97433d2a-c341-4bd1-810a-2170135aad39 service nova] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:14:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-09ed36ca-881e-4da0-877e-9cce9cb1f8f2 req-97433d2a-c341-4bd1-810a-2170135aad39 service nova] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:14:24 user nova-compute[71498]: DEBUG nova.compute.manager [req-09ed36ca-881e-4da0-877e-9cce9cb1f8f2 req-97433d2a-c341-4bd1-810a-2170135aad39 service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] No waiting events found dispatching network-vif-unplugged-e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:14:24 user nova-compute[71498]: DEBUG nova.compute.manager [req-09ed36ca-881e-4da0-877e-9cce9cb1f8f2 req-97433d2a-c341-4bd1-810a-2170135aad39 service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Received event network-vif-unplugged-e204d7f5-314e-43ce-8772-e2f288f1858f for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 02:14:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:14:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:14:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:14:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:14:25 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Instance destroyed successfully.
Apr 14 02:14:25 user nova-compute[71498]: DEBUG nova.objects.instance [None req-c7fe9031-7d52-454c-b64b-3a34e17a8044 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lazy-loading 'resources' on Instance uuid 9b29ba99-4234-4bbc-80a2-ad49127e8c9a {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:14:25 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-c7fe9031-7d52-454c-b64b-3a34e17a8044 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:09:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-435405212',display_name='tempest-TestMinimumBasicScenario-server-435405212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-435405212',id=42,image_ref='b0ff2602-d4a4-4cb3-95c3-5e9dfd3c74c5',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtEzsPoBbdFHW/OauW1N2nA3eHApzo9P+avktVZiY+BDznrsT5FrpFSwKh0+oQn87dy12kX9i8d8dwF2rJqPbbOiawNN4AoRze6n/YxMVSWae21mhWOZtM+ldYOp4zong==',key_name='tempest-TestMinimumBasicScenario-1668215586',keypairs=<?>,launch_index=0,launched_at=2023-04-14T02:09:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20723e8ba2f5480b8c17e6c4fc8fff9f',ramdisk_id='',reservation_id='r-cbhvzk20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b0ff2602-d4a4-4cb3-95c3-5e9dfd3c74c5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1976287714',owner_user_name='tempest-TestMinimumBasicScenario-1976287714-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T02:11:45Z,user_data=None,user_id='19633f8d769c4e50b5e6c9a75497b510',uuid=9b29ba99-4234-4bbc-80a2-ad49127e8c9a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e204d7f5-314e-43ce-8772-e2f288f1858f", "address": "fa:16:3e:30:bf:7a", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape204d7f5-31", "ovs_interfaceid": "e204d7f5-314e-43ce-8772-e2f288f1858f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 02:14:25 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-c7fe9031-7d52-454c-b64b-3a34e17a8044 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Converting VIF {"id": "e204d7f5-314e-43ce-8772-e2f288f1858f", "address": "fa:16:3e:30:bf:7a", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape204d7f5-31", "ovs_interfaceid": "e204d7f5-314e-43ce-8772-e2f288f1858f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:14:25 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-c7fe9031-7d52-454c-b64b-3a34e17a8044 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:bf:7a,bridge_name='br-int',has_traffic_filtering=True,id=e204d7f5-314e-43ce-8772-e2f288f1858f,network=Network(6a2a0716-97e3-42a7-bdf8-5f5548cf550b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape204d7f5-31') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:14:25 user nova-compute[71498]: DEBUG os_vif [None req-c7fe9031-7d52-454c-b64b-3a34e17a8044 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:bf:7a,bridge_name='br-int',has_traffic_filtering=True,id=e204d7f5-314e-43ce-8772-e2f288f1858f,network=Network(6a2a0716-97e3-42a7-bdf8-5f5548cf550b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape204d7f5-31') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 02:14:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:14:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape204d7f5-31, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:14:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:14:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:14:25 user nova-compute[71498]: INFO os_vif [None req-c7fe9031-7d52-454c-b64b-3a34e17a8044 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:bf:7a,bridge_name='br-int',has_traffic_filtering=True,id=e204d7f5-314e-43ce-8772-e2f288f1858f,network=Network(6a2a0716-97e3-42a7-bdf8-5f5548cf550b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape204d7f5-31')
Apr 14 02:14:25 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-c7fe9031-7d52-454c-b64b-3a34e17a8044 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Deleting instance files /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a_del
Apr 14 02:14:25 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-c7fe9031-7d52-454c-b64b-3a34e17a8044 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Deletion of /opt/stack/data/nova/instances/9b29ba99-4234-4bbc-80a2-ad49127e8c9a_del complete
Apr 14 02:14:25 user nova-compute[71498]: INFO nova.compute.manager [None req-c7fe9031-7d52-454c-b64b-3a34e17a8044 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 14 02:14:25 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-c7fe9031-7d52-454c-b64b-3a34e17a8044 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 02:14:25 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 02:14:25 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 02:14:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:14:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:14:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:14:26 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:14:26 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Took 0.93 seconds to deallocate network for instance.
Apr 14 02:14:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c7fe9031-7d52-454c-b64b-3a34e17a8044 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:14:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c7fe9031-7d52-454c-b64b-3a34e17a8044 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:14:26 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-c7fe9031-7d52-454c-b64b-3a34e17a8044 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:14:26 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-c7fe9031-7d52-454c-b64b-3a34e17a8044 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:14:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c7fe9031-7d52-454c-b64b-3a34e17a8044 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:14:26 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-c7fe9031-7d52-454c-b64b-3a34e17a8044 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Deleted allocations for instance 9b29ba99-4234-4bbc-80a2-ad49127e8c9a
Apr 14 02:14:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-c7fe9031-7d52-454c-b64b-3a34e17a8044 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.138s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:14:26 user nova-compute[71498]: DEBUG nova.compute.manager [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Received event network-vif-plugged-e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:14:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] Acquiring lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:14:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:14:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:14:26 user nova-compute[71498]: DEBUG nova.compute.manager [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] No waiting events found dispatching network-vif-plugged-e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:14:26 user nova-compute[71498]: WARNING nova.compute.manager [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Received unexpected event network-vif-plugged-e204d7f5-314e-43ce-8772-e2f288f1858f for instance with vm_state deleted and task_state None.
Apr 14 02:14:26 user nova-compute[71498]: DEBUG nova.compute.manager [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Received event network-vif-plugged-e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:14:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] Acquiring lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:14:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:14:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:14:26 user nova-compute[71498]: DEBUG nova.compute.manager [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] No waiting events found dispatching network-vif-plugged-e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:14:26 user nova-compute[71498]: WARNING nova.compute.manager [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Received unexpected event network-vif-plugged-e204d7f5-314e-43ce-8772-e2f288f1858f for instance with vm_state deleted and task_state None.
Apr 14 02:14:26 user nova-compute[71498]: DEBUG nova.compute.manager [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Received event network-vif-plugged-e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:14:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] Acquiring lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:14:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:14:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:14:26 user nova-compute[71498]: DEBUG nova.compute.manager [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] No waiting events found dispatching network-vif-plugged-e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:14:26 user nova-compute[71498]: WARNING nova.compute.manager [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Received unexpected event network-vif-plugged-e204d7f5-314e-43ce-8772-e2f288f1858f for instance with vm_state deleted and task_state None.
Apr 14 02:14:26 user nova-compute[71498]: DEBUG nova.compute.manager [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Received event network-vif-unplugged-e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:14:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] Acquiring lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:14:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:14:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:14:26 user nova-compute[71498]: DEBUG nova.compute.manager [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] No waiting events found dispatching network-vif-unplugged-e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:14:26 user nova-compute[71498]: WARNING nova.compute.manager [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Received unexpected event network-vif-unplugged-e204d7f5-314e-43ce-8772-e2f288f1858f for instance with vm_state deleted and task_state None.
Apr 14 02:14:26 user nova-compute[71498]: DEBUG nova.compute.manager [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Received event network-vif-plugged-e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:14:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] Acquiring lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:14:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:14:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] Lock "9b29ba99-4234-4bbc-80a2-ad49127e8c9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:14:26 user nova-compute[71498]: DEBUG nova.compute.manager [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] No waiting events found dispatching network-vif-plugged-e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:14:26 user nova-compute[71498]: WARNING nova.compute.manager [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Received unexpected event network-vif-plugged-e204d7f5-314e-43ce-8772-e2f288f1858f for instance with vm_state deleted and task_state None.
Apr 14 02:14:26 user nova-compute[71498]: DEBUG nova.compute.manager [req-36428ab7-52fc-48c1-b2e9-43fdeb10f4fc req-561c7368-5eee-4d68-a8e2-60b1ba6ed9ab service nova] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Received event network-vif-deleted-e204d7f5-314e-43ce-8772-e2f288f1858f {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:14:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:14:31 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681438456.2655988, 5728d5fc-4f3a-43af-b7a3-16c359bfd589 => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:14:31 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] VM Stopped (Lifecycle Event)
Apr 14 02:14:31 user nova-compute[71498]: DEBUG nova.compute.manager [None req-9d2a75ce-1669-4260-a611-94d23c689b02 None None] [instance: 5728d5fc-4f3a-43af-b7a3-16c359bfd589] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:14:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:14:40 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681438465.2412257, 9b29ba99-4234-4bbc-80a2-ad49127e8c9a => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:14:40 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] VM Stopped (Lifecycle Event)
Apr 14 02:14:40 user nova-compute[71498]: DEBUG nova.compute.manager [None req-4ae4309e-158b-4f9c-a690-1b1a111c7ed2 None None] [instance: 9b29ba99-4234-4bbc-80a2-ad49127e8c9a] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:14:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:14:45 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:14:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:14:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:14:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:14:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:14:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:14:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:14:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:14:55 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:14:56 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:14:56 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 02:14:56 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Didn't find any instances for network info cache update. {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 02:14:59 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:14:59 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:14:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:14:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:14:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:14:59 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 02:14:59 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ac5dda-cff9-4da5-a19d-49b74491f007/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:14:59 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ac5dda-cff9-4da5-a19d-49b74491f007/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:14:59 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ac5dda-cff9-4da5-a19d-49b74491f007/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:14:59 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21ac5dda-cff9-4da5-a19d-49b74491f007/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:14:59 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 02:15:00 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:15:00 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:15:00 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=8758MB free_disk=26.168521881103516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 02:15:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:15:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:15:00 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 21ac5dda-cff9-4da5-a19d-49b74491f007 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:15:00 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 02:15:00 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 02:15:00 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:15:00 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:15:00 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:15:00 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 02:15:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:15:04 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:15:05 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:15:05 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:15:06 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:15:07 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:15:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "21ac5dda-cff9-4da5-a19d-49b74491f007" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:15:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "21ac5dda-cff9-4da5-a19d-49b74491f007" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:15:07 user nova-compute[71498]: INFO nova.compute.manager [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Detaching volume 061ecf8a-30b1-466a-8a33-59b6281720bf
Apr 14 02:15:07 user nova-compute[71498]: INFO nova.virt.block_device [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Attempting to driver detach volume 061ecf8a-30b1-466a-8a33-59b6281720bf from mountpoint /dev/vdb
Apr 14 02:15:07 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Attempting to detach device vdb from instance 21ac5dda-cff9-4da5-a19d-49b74491f007 from the persistent domain config. {{(pid=71498) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 02:15:07 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 02:15:07 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:15:07 user nova-compute[71498]:   <source dev="/dev/sdc"/>
Apr 14 02:15:07 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 02:15:07 user nova-compute[71498]:   <serial>061ecf8a-30b1-466a-8a33-59b6281720bf</serial>
Apr 14 02:15:07 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 02:15:07 user nova-compute[71498]: </disk>
Apr 14 02:15:07 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 02:15:07 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Successfully detached device vdb from instance 21ac5dda-cff9-4da5-a19d-49b74491f007 from the persistent domain config.
Apr 14 02:15:07 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 21ac5dda-cff9-4da5-a19d-49b74491f007 from the live domain config. {{(pid=71498) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 02:15:07 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 02:15:07 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:15:07 user nova-compute[71498]:   <source dev="/dev/sdc"/>
Apr 14 02:15:07 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 02:15:07 user nova-compute[71498]:   <serial>061ecf8a-30b1-466a-8a33-59b6281720bf</serial>
Apr 14 02:15:07 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 02:15:07 user nova-compute[71498]: </disk>
Apr 14 02:15:07 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 02:15:07 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Received event <DeviceRemovedEvent: 1681438507.8986816, 21ac5dda-cff9-4da5-a19d-49b74491f007 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71498) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 02:15:07 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 21ac5dda-cff9-4da5-a19d-49b74491f007 {{(pid=71498) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 02:15:07 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Successfully detached device vdb from instance 21ac5dda-cff9-4da5-a19d-49b74491f007 from the live domain config.
Apr 14 02:15:07 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 02:15:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWGmUfrk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:15:07 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:15:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:15:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:15:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:15:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:15:07 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[10602e12-671a-4928-9826-b890872d52a7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:15:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 02:15:07 user nova-compute[71498]: No targets found.
Apr 14 02:15:07 user nova-compute[71498]: iSNS:
Apr 14 02:15:07 user nova-compute[71498]: No targets found.
Apr 14 02:15:07 user nova-compute[71498]: STATIC:
Apr 14 02:15:07 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf
Apr 14 02:15:07 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 02:15:07 user nova-compute[71498]:                 Iface Name: default
Apr 14 02:15:07 user nova-compute[71498]: FIRMWARE:
Apr 14 02:15:07 user nova-compute[71498]: No targets found.
Apr 14 02:15:07 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:15:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 02:15:07 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 02:15:07 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 02:15:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 02:15:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:15:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:15:07 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[419de630-6a23-44e6-ba4f-a1cc48ecaddf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:15:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:15:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:15:07 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b0fab4-c935-418b-a9bc-0f018b191389]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:15:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf (non-flash)
Apr 14 02:15:07 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:15:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf (non-flash)
Apr 14 02:15:07 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:15:07 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52014664d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf'): ({'sdc'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 02:15:07 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Removing single pathed devices sdc {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 02:15:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:15:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:15:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7259f561-4237-49a7-8dcd-46b73a2984bf]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:15:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:15:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:15:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d8dbec-e02c-47af-b72e-370316b817bc]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:15:08 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Flushing IO for device /dev/sdc {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 02:15:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:15:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:15:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[146be59a-515b-467b-a591-ad8d40db6253]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:15:08 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 02:15:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:15:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:15:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd211fe5-0386-42c5-bc69-0e44383ad0c7]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:15:08 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 02:15:08 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] SCSI volumes sdc have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 02:15:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 02:15:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:15:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:15:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[04264b85-cab8-4fc0-8309-50d2af770a89]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:15:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:15:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:15:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:15:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba400b93-3390-45e8-9f81-162e6826ed46]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:15:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf, portal: 172.16.0.220,3260]
Apr 14 02:15:08 user nova-compute[71498]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf, portal: 172.16.0.220,3260] successful.
Apr 14 02:15:08 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:15:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:15:08 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:061ecf8a-30b1-466a-8a33-59b6281720bf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:15:08 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f50e97e-0bd3-4c01-825f-3f83dbd37812]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:15:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:15:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:15:08 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] <== disconnect_volume: return (277ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:15:08 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 02:15:08 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:15:09 user nova-compute[71498]: DEBUG nova.objects.instance [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lazy-loading 'flavor' on Instance uuid 21ac5dda-cff9-4da5-a19d-49b74491f007 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:15:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adb238e5-b979-472e-9f8e-bd30e07c0489 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "21ac5dda-cff9-4da5-a19d-49b74491f007" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.684s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:15:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:15:10 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:15:11 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:15:11 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 02:15:15 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:15:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:15:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:15:18 user nova-compute[71498]: DEBUG nova.compute.manager [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 02:15:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:15:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:15:18 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 02:15:18 user nova-compute[71498]: INFO nova.compute.claims [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Claim successful on node user
Apr 14 02:15:18 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:15:18 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:15:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.200s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:15:18 user nova-compute[71498]: DEBUG nova.compute.manager [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 02:15:18 user nova-compute[71498]: DEBUG nova.compute.manager [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 02:15:18 user nova-compute[71498]: DEBUG nova.network.neutron [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 02:15:18 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 02:15:18 user nova-compute[71498]: DEBUG nova.compute.manager [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 02:15:18 user nova-compute[71498]: DEBUG nova.policy [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19633f8d769c4e50b5e6c9a75497b510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20723e8ba2f5480b8c17e6c4fc8fff9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 02:15:18 user nova-compute[71498]: DEBUG nova.compute.manager [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 02:15:18 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 02:15:18 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Creating image(s)
Apr 14 02:15:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:15:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "/opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:15:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "/opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:15:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "14474fb8994c33577d739fefccc70bcc41322b1b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:15:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "14474fb8994c33577d739fefccc70bcc41322b1b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:15:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:15:18 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14474fb8994c33577d739fefccc70bcc41322b1b.part --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:15:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14474fb8994c33577d739fefccc70bcc41322b1b.part --force-share --output=json" returned: 0 in 0.147s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:15:19 user nova-compute[71498]: DEBUG nova.virt.images [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 0f1079ad-d248-4167-b5fd-2792d9e7c59f was qcow2, converting to raw {{(pid=71498) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 02:15:19 user nova-compute[71498]: DEBUG nova.privsep.utils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71498) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 02:15:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/14474fb8994c33577d739fefccc70bcc41322b1b.part /opt/stack/data/nova/instances/_base/14474fb8994c33577d739fefccc70bcc41322b1b.converted {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:15:19 user nova-compute[71498]: DEBUG nova.network.neutron [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Successfully created port: 658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 02:15:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/14474fb8994c33577d739fefccc70bcc41322b1b.part /opt/stack/data/nova/instances/_base/14474fb8994c33577d739fefccc70bcc41322b1b.converted" returned: 0 in 0.223s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:15:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14474fb8994c33577d739fefccc70bcc41322b1b.converted --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:15:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14474fb8994c33577d739fefccc70bcc41322b1b.converted --force-share --output=json" returned: 0 in 0.133s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:15:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "14474fb8994c33577d739fefccc70bcc41322b1b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.859s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:15:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14474fb8994c33577d739fefccc70bcc41322b1b --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:15:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14474fb8994c33577d739fefccc70bcc41322b1b --force-share --output=json" returned: 0 in 0.144s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:15:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "14474fb8994c33577d739fefccc70bcc41322b1b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:15:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "14474fb8994c33577d739fefccc70bcc41322b1b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:15:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14474fb8994c33577d739fefccc70bcc41322b1b --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:15:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14474fb8994c33577d739fefccc70bcc41322b1b --force-share --output=json" returned: 0 in 0.139s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:15:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/14474fb8994c33577d739fefccc70bcc41322b1b,backing_fmt=raw /opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:15:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/14474fb8994c33577d739fefccc70bcc41322b1b,backing_fmt=raw /opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/disk 1073741824" returned: 0 in 0.053s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:15:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "14474fb8994c33577d739fefccc70bcc41322b1b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:15:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14474fb8994c33577d739fefccc70bcc41322b1b --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:15:19 user nova-compute[71498]: DEBUG nova.network.neutron [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Successfully updated port: 658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 02:15:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "refresh_cache-3f1e74ea-fe8b-4c37-aa30-21f7e17db259" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:15:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquired lock "refresh_cache-3f1e74ea-fe8b-4c37-aa30-21f7e17db259" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:15:19 user nova-compute[71498]: DEBUG nova.network.neutron [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 02:15:19 user nova-compute[71498]: DEBUG nova.compute.manager [req-c55962ed-a68e-4766-b9ff-fe4103e5c2d5 req-cfa37784-ea2b-403e-9bba-27b81a97d76f service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Received event network-changed-658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:15:19 user nova-compute[71498]: DEBUG nova.compute.manager [req-c55962ed-a68e-4766-b9ff-fe4103e5c2d5 req-cfa37784-ea2b-403e-9bba-27b81a97d76f service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Refreshing instance network info cache due to event network-changed-658d7098-ff69-45ed-8875-15a23a6bdb98. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 02:15:19 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c55962ed-a68e-4766-b9ff-fe4103e5c2d5 req-cfa37784-ea2b-403e-9bba-27b81a97d76f service nova] Acquiring lock "refresh_cache-3f1e74ea-fe8b-4c37-aa30-21f7e17db259" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:15:19 user nova-compute[71498]: DEBUG nova.network.neutron [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 02:15:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14474fb8994c33577d739fefccc70bcc41322b1b --force-share --output=json" returned: 0 in 0.140s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:15:19 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 02:15:19 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Cannot resize image /opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG nova.objects.instance [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lazy-loading 'migration_context' on Instance uuid 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Ensure instance console log exists: /opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG nova.network.neutron [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Updating instance_info_cache with network_info: [{"id": "658d7098-ff69-45ed-8875-15a23a6bdb98", "address": "fa:16:3e:3f:d1:37", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap658d7098-ff", "ovs_interfaceid": "658d7098-ff69-45ed-8875-15a23a6bdb98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Releasing lock "refresh_cache-3f1e74ea-fe8b-4c37-aa30-21f7e17db259" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG nova.compute.manager [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Instance network_info: |[{"id": "658d7098-ff69-45ed-8875-15a23a6bdb98", "address": "fa:16:3e:3f:d1:37", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap658d7098-ff", "ovs_interfaceid": "658d7098-ff69-45ed-8875-15a23a6bdb98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c55962ed-a68e-4766-b9ff-fe4103e5c2d5 req-cfa37784-ea2b-403e-9bba-27b81a97d76f service nova] Acquired lock "refresh_cache-3f1e74ea-fe8b-4c37-aa30-21f7e17db259" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG nova.network.neutron [req-c55962ed-a68e-4766-b9ff-fe4103e5c2d5 req-cfa37784-ea2b-403e-9bba-27b81a97d76f service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Refreshing network info cache for port 658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Start _get_guest_xml network_info=[{"id": "658d7098-ff69-45ed-8875-15a23a6bdb98", "address": "fa:16:3e:3f:d1:37", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap658d7098-ff", "ovs_interfaceid": "658d7098-ff69-45ed-8875-15a23a6bdb98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T02:15:16Z,direct_url=<?>,disk_format='qcow2',id=0f1079ad-d248-4167-b5fd-2792d9e7c59f,min_disk=0,min_ram=0,name='tempest-scenario-img--1521893591',owner='20723e8ba2f5480b8c17e6c4fc8fff9f',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T02:15:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': '0f1079ad-d248-4167-b5fd-2792d9e7c59f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 02:15:20 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:15:20 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:15:20 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T02:15:16Z,direct_url=<?>,disk_format='qcow2',id=0f1079ad-d248-4167-b5fd-2792d9e7c59f,min_disk=0,min_ram=0,name='tempest-scenario-img--1521893591',owner='20723e8ba2f5480b8c17e6c4fc8fff9f',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T02:15:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:15:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-684753578',display_name='tempest-TestMinimumBasicScenario-server-684753578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-684753578',id=45,image_ref='0f1079ad-d248-4167-b5fd-2792d9e7c59f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/8dDuRjCJcjSWFSlIIQBjaCQYsWY9jcPIgqBXOlo6NSNyeF/zqlrB4m5QH/AVXVYI5JCwYqy+IR/fGoWCXNpPwugqxmAh3nJdTZo0B2P/965Ah2uH7rPja1jX0NXwcFQ==',key_name='tempest-TestMinimumBasicScenario-232131221',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20723e8ba2f5480b8c17e6c4fc8fff9f',ramdisk_id='',reservation_id='r-ef0gwdn3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0f1079ad-d248-4167-b5fd-2792d9e7c59f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1976287714',owner_user_name='tempest-TestMinimumBasicScenario-1976287714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T02:15:19Z,user_data=None,user_id='19633f8d769c4e50b5e6c9a75497b510',uuid=3f1e74ea-fe8b-4c37-aa30-21f7e17db259,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "658d7098-ff69-45ed-8875-15a23a6bdb98", "address": "fa:16:3e:3f:d1:37", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap658d7098-ff", "ovs_interfaceid": "658d7098-ff69-45ed-8875-15a23a6bdb98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Converting VIF {"id": "658d7098-ff69-45ed-8875-15a23a6bdb98", "address": "fa:16:3e:3f:d1:37", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap658d7098-ff", "ovs_interfaceid": "658d7098-ff69-45ed-8875-15a23a6bdb98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:d1:37,bridge_name='br-int',has_traffic_filtering=True,id=658d7098-ff69-45ed-8875-15a23a6bdb98,network=Network(6a2a0716-97e3-42a7-bdf8-5f5548cf550b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap658d7098-ff') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG nova.objects.instance [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] End _get_guest_xml xml=<domain type="kvm">
Apr 14 02:15:20 user nova-compute[71498]:   <uuid>3f1e74ea-fe8b-4c37-aa30-21f7e17db259</uuid>
Apr 14 02:15:20 user nova-compute[71498]:   <name>instance-0000002d</name>
Apr 14 02:15:20 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 02:15:20 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 02:15:20 user nova-compute[71498]:   <metadata>
Apr 14 02:15:20 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 02:15:20 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 02:15:20 user nova-compute[71498]:       <nova:name>tempest-TestMinimumBasicScenario-server-684753578</nova:name>
Apr 14 02:15:20 user nova-compute[71498]:       <nova:creationTime>2023-04-14 02:15:20</nova:creationTime>
Apr 14 02:15:20 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 02:15:20 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 02:15:20 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 02:15:20 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 02:15:20 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 02:15:20 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 02:15:20 user nova-compute[71498]:       </nova:flavor>
Apr 14 02:15:20 user nova-compute[71498]:       <nova:owner>
Apr 14 02:15:20 user nova-compute[71498]:         <nova:user uuid="19633f8d769c4e50b5e6c9a75497b510">tempest-TestMinimumBasicScenario-1976287714-project-member</nova:user>
Apr 14 02:15:20 user nova-compute[71498]:         <nova:project uuid="20723e8ba2f5480b8c17e6c4fc8fff9f">tempest-TestMinimumBasicScenario-1976287714</nova:project>
Apr 14 02:15:20 user nova-compute[71498]:       </nova:owner>
Apr 14 02:15:20 user nova-compute[71498]:       <nova:root type="image" uuid="0f1079ad-d248-4167-b5fd-2792d9e7c59f"/>
Apr 14 02:15:20 user nova-compute[71498]:       <nova:ports>
Apr 14 02:15:20 user nova-compute[71498]:         <nova:port uuid="658d7098-ff69-45ed-8875-15a23a6bdb98">
Apr 14 02:15:20 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 02:15:20 user nova-compute[71498]:         </nova:port>
Apr 14 02:15:20 user nova-compute[71498]:       </nova:ports>
Apr 14 02:15:20 user nova-compute[71498]:     </nova:instance>
Apr 14 02:15:20 user nova-compute[71498]:   </metadata>
Apr 14 02:15:20 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 02:15:20 user nova-compute[71498]:     <system>
Apr 14 02:15:20 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 02:15:20 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 02:15:20 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 02:15:20 user nova-compute[71498]:       <entry name="serial">3f1e74ea-fe8b-4c37-aa30-21f7e17db259</entry>
Apr 14 02:15:20 user nova-compute[71498]:       <entry name="uuid">3f1e74ea-fe8b-4c37-aa30-21f7e17db259</entry>
Apr 14 02:15:20 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 02:15:20 user nova-compute[71498]:     </system>
Apr 14 02:15:20 user nova-compute[71498]:   </sysinfo>
Apr 14 02:15:20 user nova-compute[71498]:   <os>
Apr 14 02:15:20 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 02:15:20 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 02:15:20 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 02:15:20 user nova-compute[71498]:   </os>
Apr 14 02:15:20 user nova-compute[71498]:   <features>
Apr 14 02:15:20 user nova-compute[71498]:     <acpi/>
Apr 14 02:15:20 user nova-compute[71498]:     <apic/>
Apr 14 02:15:20 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 02:15:20 user nova-compute[71498]:   </features>
Apr 14 02:15:20 user nova-compute[71498]:   <clock offset="utc">
Apr 14 02:15:20 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 02:15:20 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 02:15:20 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 02:15:20 user nova-compute[71498]:   </clock>
Apr 14 02:15:20 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 02:15:20 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 02:15:20 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 02:15:20 user nova-compute[71498]:   </cpu>
Apr 14 02:15:20 user nova-compute[71498]:   <devices>
Apr 14 02:15:20 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 02:15:20 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 02:15:20 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/disk"/>
Apr 14 02:15:20 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 02:15:20 user nova-compute[71498]:     </disk>
Apr 14 02:15:20 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 02:15:20 user nova-compute[71498]:       <mac address="fa:16:3e:3f:d1:37"/>
Apr 14 02:15:20 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 02:15:20 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 02:15:20 user nova-compute[71498]:       <target dev="tap658d7098-ff"/>
Apr 14 02:15:20 user nova-compute[71498]:     </interface>
Apr 14 02:15:20 user nova-compute[71498]:     <serial type="pty">
Apr 14 02:15:20 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/console.log" append="off"/>
Apr 14 02:15:20 user nova-compute[71498]:     </serial>
Apr 14 02:15:20 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 02:15:20 user nova-compute[71498]:     <video>
Apr 14 02:15:20 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 02:15:20 user nova-compute[71498]:     </video>
Apr 14 02:15:20 user nova-compute[71498]:     <rng model="virtio">
Apr 14 02:15:20 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 02:15:20 user nova-compute[71498]:     </rng>
Apr 14 02:15:20 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 02:15:20 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 02:15:20 user nova-compute[71498]:       <stats period="10"/>
Apr 14 02:15:20 user nova-compute[71498]:     </memballoon>
Apr 14 02:15:20 user nova-compute[71498]:   </devices>
Apr 14 02:15:20 user nova-compute[71498]: </domain>
Apr 14 02:15:20 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:15:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-684753578',display_name='tempest-TestMinimumBasicScenario-server-684753578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-684753578',id=45,image_ref='0f1079ad-d248-4167-b5fd-2792d9e7c59f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/8dDuRjCJcjSWFSlIIQBjaCQYsWY9jcPIgqBXOlo6NSNyeF/zqlrB4m5QH/AVXVYI5JCwYqy+IR/fGoWCXNpPwugqxmAh3nJdTZo0B2P/965Ah2uH7rPja1jX0NXwcFQ==',key_name='tempest-TestMinimumBasicScenario-232131221',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20723e8ba2f5480b8c17e6c4fc8fff9f',ramdisk_id='',reservation_id='r-ef0gwdn3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0f1079ad-d248-4167-b5fd-2792d9e7c59f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1976287714',owner_user_name='tempest-TestMinimumBasicScenario-1976287714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T02:15:19Z,user_data=None,user_id='19633f8d769c4e50b5e6c9a75497b510',uuid=3f1e74ea-fe8b-4c37-aa30-21f7e17db259,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "658d7098-ff69-45ed-8875-15a23a6bdb98", "address": "fa:16:3e:3f:d1:37", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap658d7098-ff", "ovs_interfaceid": "658d7098-ff69-45ed-8875-15a23a6bdb98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Converting VIF {"id": "658d7098-ff69-45ed-8875-15a23a6bdb98", "address": "fa:16:3e:3f:d1:37", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap658d7098-ff", "ovs_interfaceid": "658d7098-ff69-45ed-8875-15a23a6bdb98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:d1:37,bridge_name='br-int',has_traffic_filtering=True,id=658d7098-ff69-45ed-8875-15a23a6bdb98,network=Network(6a2a0716-97e3-42a7-bdf8-5f5548cf550b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap658d7098-ff') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG os_vif [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:d1:37,bridge_name='br-int',has_traffic_filtering=True,id=658d7098-ff69-45ed-8875-15a23a6bdb98,network=Network(6a2a0716-97e3-42a7-bdf8-5f5548cf550b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap658d7098-ff') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap658d7098-ff, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap658d7098-ff, col_values=(('external_ids', {'iface-id': '658d7098-ff69-45ed-8875-15a23a6bdb98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:d1:37', 'vm-uuid': '3f1e74ea-fe8b-4c37-aa30-21f7e17db259'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:15:20 user nova-compute[71498]: INFO os_vif [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:d1:37,bridge_name='br-int',has_traffic_filtering=True,id=658d7098-ff69-45ed-8875-15a23a6bdb98,network=Network(6a2a0716-97e3-42a7-bdf8-5f5548cf550b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap658d7098-ff')
Apr 14 02:15:20 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] No VIF found with MAC fa:16:3e:3f:d1:37, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG nova.network.neutron [req-c55962ed-a68e-4766-b9ff-fe4103e5c2d5 req-cfa37784-ea2b-403e-9bba-27b81a97d76f service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Updated VIF entry in instance network info cache for port 658d7098-ff69-45ed-8875-15a23a6bdb98. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG nova.network.neutron [req-c55962ed-a68e-4766-b9ff-fe4103e5c2d5 req-cfa37784-ea2b-403e-9bba-27b81a97d76f service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Updating instance_info_cache with network_info: [{"id": "658d7098-ff69-45ed-8875-15a23a6bdb98", "address": "fa:16:3e:3f:d1:37", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap658d7098-ff", "ovs_interfaceid": "658d7098-ff69-45ed-8875-15a23a6bdb98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:15:20 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c55962ed-a68e-4766-b9ff-fe4103e5c2d5 req-cfa37784-ea2b-403e-9bba-27b81a97d76f service nova] Releasing lock "refresh_cache-3f1e74ea-fe8b-4c37-aa30-21f7e17db259" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:15:21 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:15:21 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:15:21 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:15:22 user nova-compute[71498]: DEBUG nova.compute.manager [req-251c2ffb-0526-4e28-97eb-252620f5c40a req-c2e70619-7782-4c80-aa6f-efbd8f71c433 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Received event network-vif-plugged-658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:15:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-251c2ffb-0526-4e28-97eb-252620f5c40a req-c2e70619-7782-4c80-aa6f-efbd8f71c433 service nova] Acquiring lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:15:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-251c2ffb-0526-4e28-97eb-252620f5c40a req-c2e70619-7782-4c80-aa6f-efbd8f71c433 service nova] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:15:22 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-251c2ffb-0526-4e28-97eb-252620f5c40a req-c2e70619-7782-4c80-aa6f-efbd8f71c433 service nova] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:15:22 user nova-compute[71498]: DEBUG nova.compute.manager [req-251c2ffb-0526-4e28-97eb-252620f5c40a req-c2e70619-7782-4c80-aa6f-efbd8f71c433 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] No waiting events found dispatching network-vif-plugged-658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:15:22 user nova-compute[71498]: WARNING nova.compute.manager [req-251c2ffb-0526-4e28-97eb-252620f5c40a req-c2e70619-7782-4c80-aa6f-efbd8f71c433 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Received unexpected event network-vif-plugged-658d7098-ff69-45ed-8875-15a23a6bdb98 for instance with vm_state building and task_state spawning.
Apr 14 02:15:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:15:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:15:22 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:15:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:15:23 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681438523.725177, 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:15:23 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] VM Resumed (Lifecycle Event)
Apr 14 02:15:23 user nova-compute[71498]: DEBUG nova.compute.manager [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 02:15:23 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 02:15:23 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Instance spawned successfully.
Apr 14 02:15:23 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 02:15:23 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:15:23 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 02:15:23 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:15:23 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:15:23 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:15:23 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:15:23 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:15:23 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:15:23 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 02:15:23 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681438523.7263558, 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:15:23 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] VM Started (Lifecycle Event)
Apr 14 02:15:23 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:15:23 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 02:15:23 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 02:15:23 user nova-compute[71498]: INFO nova.compute.manager [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Took 5.22 seconds to spawn the instance on the hypervisor.
Apr 14 02:15:23 user nova-compute[71498]: DEBUG nova.compute.manager [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:15:23 user nova-compute[71498]: INFO nova.compute.manager [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Took 5.71 seconds to build instance.
Apr 14 02:15:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-8b0ae25e-4db4-4367-a936-a126ed5cbe7b tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.807s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:15:24 user nova-compute[71498]: DEBUG nova.compute.manager [req-cfdb8b84-f40c-4953-b59d-a732e1b44d10 req-59212bf7-dfc8-4947-82d3-e528a0e2a595 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Received event network-vif-plugged-658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:15:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-cfdb8b84-f40c-4953-b59d-a732e1b44d10 req-59212bf7-dfc8-4947-82d3-e528a0e2a595 service nova] Acquiring lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:15:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-cfdb8b84-f40c-4953-b59d-a732e1b44d10 req-59212bf7-dfc8-4947-82d3-e528a0e2a595 service nova] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:15:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-cfdb8b84-f40c-4953-b59d-a732e1b44d10 req-59212bf7-dfc8-4947-82d3-e528a0e2a595 service nova] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:15:24 user nova-compute[71498]: DEBUG nova.compute.manager [req-cfdb8b84-f40c-4953-b59d-a732e1b44d10 req-59212bf7-dfc8-4947-82d3-e528a0e2a595 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] No waiting events found dispatching network-vif-plugged-658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:15:24 user nova-compute[71498]: WARNING nova.compute.manager [req-cfdb8b84-f40c-4953-b59d-a732e1b44d10 req-59212bf7-dfc8-4947-82d3-e528a0e2a595 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Received unexpected event network-vif-plugged-658d7098-ff69-45ed-8875-15a23a6bdb98 for instance with vm_state active and task_state None.
Apr 14 02:15:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:15:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:15:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:15:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:15:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:15:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:15:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:15:45 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:15:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:15:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:15:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:15:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:15:57 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:15:57 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 02:15:57 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Rebuilding the list of instances to heal {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 02:15:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-21ac5dda-cff9-4da5-a19d-49b74491f007" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:15:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-21ac5dda-cff9-4da5-a19d-49b74491f007" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:15:57 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 02:15:57 user nova-compute[71498]: DEBUG nova.objects.instance [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lazy-loading 'info_cache' on Instance uuid 21ac5dda-cff9-4da5-a19d-49b74491f007 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:15:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-09e34507-aade-4f2e-b685-f17f084e18c7 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "21ac5dda-cff9-4da5-a19d-49b74491f007" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:15:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-09e34507-aade-4f2e-b685-f17f084e18c7 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "21ac5dda-cff9-4da5-a19d-49b74491f007" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:15:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-09e34507-aade-4f2e-b685-f17f084e18c7 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "21ac5dda-cff9-4da5-a19d-49b74491f007-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:15:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-09e34507-aade-4f2e-b685-f17f084e18c7 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "21ac5dda-cff9-4da5-a19d-49b74491f007-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:15:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-09e34507-aade-4f2e-b685-f17f084e18c7 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "21ac5dda-cff9-4da5-a19d-49b74491f007-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:15:57 user nova-compute[71498]: INFO nova.compute.manager [None req-09e34507-aade-4f2e-b685-f17f084e18c7 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Terminating instance
Apr 14 02:15:57 user nova-compute[71498]: DEBUG nova.compute.manager [None req-09e34507-aade-4f2e-b685-f17f084e18c7 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 02:15:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:15:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:15:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:15:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:15:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:15:57 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Updating instance_info_cache with network_info: [{"id": "38b47774-08a0-4e14-a236-fcab2f3bdb06", "address": "fa:16:3e:b9:1d:89", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b47774-08", "ovs_interfaceid": "38b47774-08a0-4e14-a236-fcab2f3bdb06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:15:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-21ac5dda-cff9-4da5-a19d-49b74491f007" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:15:58 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 02:15:58 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:15:58 user nova-compute[71498]: DEBUG nova.compute.manager [req-6e339903-ec31-47a0-911f-f138ff979d72 req-bc995a43-989e-44a1-b93d-79f5064369a1 service nova] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Received event network-vif-unplugged-38b47774-08a0-4e14-a236-fcab2f3bdb06 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:15:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6e339903-ec31-47a0-911f-f138ff979d72 req-bc995a43-989e-44a1-b93d-79f5064369a1 service nova] Acquiring lock "21ac5dda-cff9-4da5-a19d-49b74491f007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:15:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6e339903-ec31-47a0-911f-f138ff979d72 req-bc995a43-989e-44a1-b93d-79f5064369a1 service nova] Lock "21ac5dda-cff9-4da5-a19d-49b74491f007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:15:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-6e339903-ec31-47a0-911f-f138ff979d72 req-bc995a43-989e-44a1-b93d-79f5064369a1 service nova] Lock "21ac5dda-cff9-4da5-a19d-49b74491f007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:15:58 user nova-compute[71498]: DEBUG nova.compute.manager [req-6e339903-ec31-47a0-911f-f138ff979d72 req-bc995a43-989e-44a1-b93d-79f5064369a1 service nova] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] No waiting events found dispatching network-vif-unplugged-38b47774-08a0-4e14-a236-fcab2f3bdb06 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:15:58 user nova-compute[71498]: DEBUG nova.compute.manager [req-6e339903-ec31-47a0-911f-f138ff979d72 req-bc995a43-989e-44a1-b93d-79f5064369a1 service nova] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Received event network-vif-unplugged-38b47774-08a0-4e14-a236-fcab2f3bdb06 for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 02:15:58 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Instance destroyed successfully.
Apr 14 02:15:58 user nova-compute[71498]: DEBUG nova.objects.instance [None req-09e34507-aade-4f2e-b685-f17f084e18c7 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lazy-loading 'resources' on Instance uuid 21ac5dda-cff9-4da5-a19d-49b74491f007 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:15:58 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-09e34507-aade-4f2e-b685-f17f084e18c7 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1446254601',display_name='tempest-AttachVolumeNegativeTest-server-1446254601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1446254601',id=43,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIV4Y4FLi2GXegSJpwzJ9Ks60PPN72JDpmIKogBiE9qPz09L2D+DrHUUiWU4bmSP6spYC9uqMNwovh5BE5nQXgHNE0RBRiSaKwEcuLeVhSC3e8O/srH8F+vT0QL+25dXIg==',key_name='tempest-keypair-867176451',keypairs=<?>,launch_index=0,launched_at=2023-04-14T02:10:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0dcde6e918d64d70b69d2d81e1bdbe79',ramdisk_id='',reservation_id='r-2vyargm9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1854704348',owner_user_name='tempest-AttachVolumeNegativeTest-1854704348-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T02:10:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='168a0142cf984aacb1f087adcaa96468',uuid=21ac5dda-cff9-4da5-a19d-49b74491f007,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38b47774-08a0-4e14-a236-fcab2f3bdb06", "address": "fa:16:3e:b9:1d:89", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b47774-08", "ovs_interfaceid": "38b47774-08a0-4e14-a236-fcab2f3bdb06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 02:15:58 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-09e34507-aade-4f2e-b685-f17f084e18c7 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Converting VIF {"id": "38b47774-08a0-4e14-a236-fcab2f3bdb06", "address": "fa:16:3e:b9:1d:89", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b47774-08", "ovs_interfaceid": "38b47774-08a0-4e14-a236-fcab2f3bdb06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:15:58 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-09e34507-aade-4f2e-b685-f17f084e18c7 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:1d:89,bridge_name='br-int',has_traffic_filtering=True,id=38b47774-08a0-4e14-a236-fcab2f3bdb06,network=Network(981c880a-2147-4da6-8021-a03d0aee3f3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38b47774-08') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:15:58 user nova-compute[71498]: DEBUG os_vif [None req-09e34507-aade-4f2e-b685-f17f084e18c7 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:1d:89,bridge_name='br-int',has_traffic_filtering=True,id=38b47774-08a0-4e14-a236-fcab2f3bdb06,network=Network(981c880a-2147-4da6-8021-a03d0aee3f3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38b47774-08') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 02:15:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:15:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38b47774-08, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:15:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:15:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:15:58 user nova-compute[71498]: INFO os_vif [None req-09e34507-aade-4f2e-b685-f17f084e18c7 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:1d:89,bridge_name='br-int',has_traffic_filtering=True,id=38b47774-08a0-4e14-a236-fcab2f3bdb06,network=Network(981c880a-2147-4da6-8021-a03d0aee3f3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38b47774-08')
Apr 14 02:15:58 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-09e34507-aade-4f2e-b685-f17f084e18c7 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Deleting instance files /opt/stack/data/nova/instances/21ac5dda-cff9-4da5-a19d-49b74491f007_del
Apr 14 02:15:58 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-09e34507-aade-4f2e-b685-f17f084e18c7 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Deletion of /opt/stack/data/nova/instances/21ac5dda-cff9-4da5-a19d-49b74491f007_del complete
Apr 14 02:15:58 user nova-compute[71498]: INFO nova.compute.manager [None req-09e34507-aade-4f2e-b685-f17f084e18c7 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 14 02:15:58 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-09e34507-aade-4f2e-b685-f17f084e18c7 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 02:15:58 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 02:15:58 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 02:15:59 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:15:59 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Took 0.79 seconds to deallocate network for instance.
Apr 14 02:15:59 user nova-compute[71498]: DEBUG nova.compute.manager [req-9bdb1e12-8be9-4826-af7d-0dc879edf8ed req-a9ea189f-e71c-4e27-9f77-8087207bd5be service nova] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Received event network-vif-deleted-38b47774-08a0-4e14-a236-fcab2f3bdb06 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:15:59 user nova-compute[71498]: INFO nova.compute.manager [req-9bdb1e12-8be9-4826-af7d-0dc879edf8ed req-a9ea189f-e71c-4e27-9f77-8087207bd5be service nova] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Neutron deleted interface 38b47774-08a0-4e14-a236-fcab2f3bdb06; detaching it from the instance and deleting it from the info cache
Apr 14 02:15:59 user nova-compute[71498]: DEBUG nova.network.neutron [req-9bdb1e12-8be9-4826-af7d-0dc879edf8ed req-a9ea189f-e71c-4e27-9f77-8087207bd5be service nova] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:15:59 user nova-compute[71498]: DEBUG nova.compute.manager [req-9bdb1e12-8be9-4826-af7d-0dc879edf8ed req-a9ea189f-e71c-4e27-9f77-8087207bd5be service nova] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Detach interface failed, port_id=38b47774-08a0-4e14-a236-fcab2f3bdb06, reason: Instance 21ac5dda-cff9-4da5-a19d-49b74491f007 could not be found. {{(pid=71498) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 02:15:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-09e34507-aade-4f2e-b685-f17f084e18c7 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:15:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-09e34507-aade-4f2e-b685-f17f084e18c7 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:15:59 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-09e34507-aade-4f2e-b685-f17f084e18c7 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:15:59 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-09e34507-aade-4f2e-b685-f17f084e18c7 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:15:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-09e34507-aade-4f2e-b685-f17f084e18c7 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:15:59 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-09e34507-aade-4f2e-b685-f17f084e18c7 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Deleted allocations for instance 21ac5dda-cff9-4da5-a19d-49b74491f007
Apr 14 02:15:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-09e34507-aade-4f2e-b685-f17f084e18c7 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "21ac5dda-cff9-4da5-a19d-49b74491f007" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.926s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:16:00 user nova-compute[71498]: DEBUG nova.compute.manager [req-243e3a1b-9f4b-478d-8c6f-b78d45a67015 req-c1347639-92a4-42f3-ba0d-4d65390f9f93 service nova] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Received event network-vif-plugged-38b47774-08a0-4e14-a236-fcab2f3bdb06 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:16:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-243e3a1b-9f4b-478d-8c6f-b78d45a67015 req-c1347639-92a4-42f3-ba0d-4d65390f9f93 service nova] Acquiring lock "21ac5dda-cff9-4da5-a19d-49b74491f007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:16:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-243e3a1b-9f4b-478d-8c6f-b78d45a67015 req-c1347639-92a4-42f3-ba0d-4d65390f9f93 service nova] Lock "21ac5dda-cff9-4da5-a19d-49b74491f007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:16:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-243e3a1b-9f4b-478d-8c6f-b78d45a67015 req-c1347639-92a4-42f3-ba0d-4d65390f9f93 service nova] Lock "21ac5dda-cff9-4da5-a19d-49b74491f007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:16:00 user nova-compute[71498]: DEBUG nova.compute.manager [req-243e3a1b-9f4b-478d-8c6f-b78d45a67015 req-c1347639-92a4-42f3-ba0d-4d65390f9f93 service nova] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] No waiting events found dispatching network-vif-plugged-38b47774-08a0-4e14-a236-fcab2f3bdb06 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:16:00 user nova-compute[71498]: WARNING nova.compute.manager [req-243e3a1b-9f4b-478d-8c6f-b78d45a67015 req-c1347639-92a4-42f3-ba0d-4d65390f9f93 service nova] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Received unexpected event network-vif-plugged-38b47774-08a0-4e14-a236-fcab2f3bdb06 for instance with vm_state deleted and task_state None.
Apr 14 02:16:01 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:16:01 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:16:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:16:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:16:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:16:01 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 02:16:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:16:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:16:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:16:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:16:02 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:16:02 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:16:02 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=8766MB free_disk=26.150550842285156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 02:16:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:16:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:16:02 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:16:02 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 02:16:02 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 02:16:02 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:16:02 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:16:02 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 02:16:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:16:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:16:06 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:16:06 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:16:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:16:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:16:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:16:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:16:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:16:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:16:09 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:16:12 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:16:13 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:16:13 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 02:16:13 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681438558.5338914, 21ac5dda-cff9-4da5-a19d-49b74491f007 => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:16:13 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] VM Stopped (Lifecycle Event)
Apr 14 02:16:13 user nova-compute[71498]: DEBUG nova.compute.manager [None req-9fdcd2d9-3338-4e6a-9dac-1fbdee6395a1 None None] [instance: 21ac5dda-cff9-4da5-a19d-49b74491f007] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:16:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:16:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:16:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:16:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:16:26 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:16:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:16:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:16:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:16:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:16:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:16:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:16:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.imagecache [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Verify base images {{(pid=71498) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Apr 14 02:16:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.imagecache [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Image id 0f1079ad-d248-4167-b5fd-2792d9e7c59f yields fingerprint 14474fb8994c33577d739fefccc70bcc41322b1b {{(pid=71498) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 14 02:16:26 user nova-compute[71498]: INFO nova.virt.libvirt.imagecache [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] image 0f1079ad-d248-4167-b5fd-2792d9e7c59f at (/opt/stack/data/nova/instances/_base/14474fb8994c33577d739fefccc70bcc41322b1b): checking
Apr 14 02:16:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.imagecache [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] image 0f1079ad-d248-4167-b5fd-2792d9e7c59f at (/opt/stack/data/nova/instances/_base/14474fb8994c33577d739fefccc70bcc41322b1b): image is in use {{(pid=71498) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Apr 14 02:16:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.imagecache [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=71498) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 14 02:16:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.imagecache [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 is a valid instance name {{(pid=71498) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 14 02:16:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.imagecache [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 has a disk file {{(pid=71498) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 14 02:16:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:16:26 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:16:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.imagecache [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 is backed by 14474fb8994c33577d739fefccc70bcc41322b1b {{(pid=71498) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 14 02:16:26 user nova-compute[71498]: WARNING nova.virt.libvirt.imagecache [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Unknown base file: /opt/stack/data/nova/instances/_base/d04c3460e4b72ac20f143e769721db0d5b61f406
Apr 14 02:16:26 user nova-compute[71498]: WARNING nova.virt.libvirt.imagecache [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Unknown base file: /opt/stack/data/nova/instances/_base/f55ebe4b754373f46f480f3d9fb54b297d881114
Apr 14 02:16:26 user nova-compute[71498]: WARNING nova.virt.libvirt.imagecache [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Unknown base file: /opt/stack/data/nova/instances/_base/785d099e7e7a771ffb63981c950f57d8802827a2
Apr 14 02:16:26 user nova-compute[71498]: WARNING nova.virt.libvirt.imagecache [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Unknown base file: /opt/stack/data/nova/instances/_base/d7a9b6b150e0e5b3bd47306d86b4756a569d8294
Apr 14 02:16:26 user nova-compute[71498]: WARNING nova.virt.libvirt.imagecache [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Unknown base file: /opt/stack/data/nova/instances/_base/185d0af0a4fc3ecdcd6252deaf13b6b7d8f5eb85
Apr 14 02:16:26 user nova-compute[71498]: WARNING nova.virt.libvirt.imagecache [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Unknown base file: /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab
Apr 14 02:16:26 user nova-compute[71498]: WARNING nova.virt.libvirt.imagecache [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Unknown base file: /opt/stack/data/nova/instances/_base/787dbab95fe72633643288c6e5cea6cb33e34252
Apr 14 02:16:26 user nova-compute[71498]: WARNING nova.virt.libvirt.imagecache [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Unknown base file: /opt/stack/data/nova/instances/_base/2eef28a082da4c6b84a85500a0218354691e6469
Apr 14 02:16:26 user nova-compute[71498]: WARNING nova.virt.libvirt.imagecache [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Unknown base file: /opt/stack/data/nova/instances/_base/f5278a41abeb9d8af10193ebab47e6963b5e7faa
Apr 14 02:16:26 user nova-compute[71498]: INFO nova.virt.libvirt.imagecache [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Active base files: /opt/stack/data/nova/instances/_base/14474fb8994c33577d739fefccc70bcc41322b1b
Apr 14 02:16:26 user nova-compute[71498]: INFO nova.virt.libvirt.imagecache [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Removable base files: /opt/stack/data/nova/instances/_base/d04c3460e4b72ac20f143e769721db0d5b61f406 /opt/stack/data/nova/instances/_base/f55ebe4b754373f46f480f3d9fb54b297d881114 /opt/stack/data/nova/instances/_base/785d099e7e7a771ffb63981c950f57d8802827a2 /opt/stack/data/nova/instances/_base/d7a9b6b150e0e5b3bd47306d86b4756a569d8294 /opt/stack/data/nova/instances/_base/185d0af0a4fc3ecdcd6252deaf13b6b7d8f5eb85 /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab /opt/stack/data/nova/instances/_base/787dbab95fe72633643288c6e5cea6cb33e34252 /opt/stack/data/nova/instances/_base/2eef28a082da4c6b84a85500a0218354691e6469 /opt/stack/data/nova/instances/_base/f5278a41abeb9d8af10193ebab47e6963b5e7faa
Apr 14 02:16:26 user nova-compute[71498]: INFO nova.virt.libvirt.imagecache [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d04c3460e4b72ac20f143e769721db0d5b61f406
Apr 14 02:16:26 user nova-compute[71498]: INFO nova.virt.libvirt.imagecache [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f55ebe4b754373f46f480f3d9fb54b297d881114
Apr 14 02:16:26 user nova-compute[71498]: INFO nova.virt.libvirt.imagecache [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/785d099e7e7a771ffb63981c950f57d8802827a2
Apr 14 02:16:26 user nova-compute[71498]: INFO nova.virt.libvirt.imagecache [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d7a9b6b150e0e5b3bd47306d86b4756a569d8294
Apr 14 02:16:26 user nova-compute[71498]: INFO nova.virt.libvirt.imagecache [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/185d0af0a4fc3ecdcd6252deaf13b6b7d8f5eb85
Apr 14 02:16:26 user nova-compute[71498]: INFO nova.virt.libvirt.imagecache [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab
Apr 14 02:16:26 user nova-compute[71498]: INFO nova.virt.libvirt.imagecache [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/787dbab95fe72633643288c6e5cea6cb33e34252
Apr 14 02:16:26 user nova-compute[71498]: INFO nova.virt.libvirt.imagecache [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2eef28a082da4c6b84a85500a0218354691e6469
Apr 14 02:16:26 user nova-compute[71498]: INFO nova.virt.libvirt.imagecache [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f5278a41abeb9d8af10193ebab47e6963b5e7faa
Apr 14 02:16:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.imagecache [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Verification complete {{(pid=71498) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Apr 14 02:16:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.imagecache [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Verify swap images {{(pid=71498) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Apr 14 02:16:26 user nova-compute[71498]: DEBUG nova.virt.libvirt.imagecache [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Verify ephemeral images {{(pid=71498) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Apr 14 02:16:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:16:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:16:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:16:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:16:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:16:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:16:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:16:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:16:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:16:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:16:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:16:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:16:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:16:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:16:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:16:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:16:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:16:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "5b243a71-802b-40f4-a374-16ecc2bae0f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:16:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "5b243a71-802b-40f4-a374-16ecc2bae0f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:16:51 user nova-compute[71498]: DEBUG nova.compute.manager [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 02:16:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:16:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:16:52 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 02:16:52 user nova-compute[71498]: INFO nova.compute.claims [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Claim successful on node user
Apr 14 02:16:52 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:16:52 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:16:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.223s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:16:52 user nova-compute[71498]: DEBUG nova.compute.manager [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 02:16:52 user nova-compute[71498]: DEBUG nova.compute.manager [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 02:16:52 user nova-compute[71498]: DEBUG nova.network.neutron [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 02:16:52 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 02:16:52 user nova-compute[71498]: DEBUG nova.compute.manager [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 02:16:52 user nova-compute[71498]: DEBUG nova.policy [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '168a0142cf984aacb1f087adcaa96468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcde6e918d64d70b69d2d81e1bdbe79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 02:16:52 user nova-compute[71498]: DEBUG nova.compute.manager [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 02:16:52 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 02:16:52 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Creating image(s)
Apr 14 02:16:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "/opt/stack/data/nova/instances/5b243a71-802b-40f4-a374-16ecc2bae0f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:16:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "/opt/stack/data/nova/instances/5b243a71-802b-40f4-a374-16ecc2bae0f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:16:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "/opt/stack/data/nova/instances/5b243a71-802b-40f4-a374-16ecc2bae0f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:16:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:16:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.139s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:16:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:16:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:16:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:16:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.132s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:16:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/5b243a71-802b-40f4-a374-16ecc2bae0f2/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:16:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/5b243a71-802b-40f4-a374-16ecc2bae0f2/disk 1073741824" returned: 0 in 0.047s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:16:52 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.186s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:16:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:16:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.141s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:16:52 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5b243a71-802b-40f4-a374-16ecc2bae0f2/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 02:16:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b243a71-802b-40f4-a374-16ecc2bae0f2/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:16:53 user nova-compute[71498]: DEBUG nova.network.neutron [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Successfully created port: ac234ca2-fa32-4f28-bcab-47b552c9b02e {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 02:16:53 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b243a71-802b-40f4-a374-16ecc2bae0f2/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:16:53 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Cannot resize image /opt/stack/data/nova/instances/5b243a71-802b-40f4-a374-16ecc2bae0f2/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 02:16:53 user nova-compute[71498]: DEBUG nova.objects.instance [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lazy-loading 'migration_context' on Instance uuid 5b243a71-802b-40f4-a374-16ecc2bae0f2 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:16:53 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 02:16:53 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Ensure instance console log exists: /opt/stack/data/nova/instances/5b243a71-802b-40f4-a374-16ecc2bae0f2/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 02:16:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:16:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:16:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:16:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:16:53 user nova-compute[71498]: DEBUG nova.network.neutron [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Successfully updated port: ac234ca2-fa32-4f28-bcab-47b552c9b02e {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 02:16:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "refresh_cache-5b243a71-802b-40f4-a374-16ecc2bae0f2" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:16:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquired lock "refresh_cache-5b243a71-802b-40f4-a374-16ecc2bae0f2" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:16:53 user nova-compute[71498]: DEBUG nova.network.neutron [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 02:16:53 user nova-compute[71498]: DEBUG nova.network.neutron [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 02:16:53 user nova-compute[71498]: DEBUG nova.compute.manager [req-eed322fe-76fd-478b-9c22-ef28fc5b2818 req-e876e74f-8005-434f-a5da-374ae09cabfa service nova] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Received event network-changed-ac234ca2-fa32-4f28-bcab-47b552c9b02e {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:16:53 user nova-compute[71498]: DEBUG nova.compute.manager [req-eed322fe-76fd-478b-9c22-ef28fc5b2818 req-e876e74f-8005-434f-a5da-374ae09cabfa service nova] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Refreshing instance network info cache due to event network-changed-ac234ca2-fa32-4f28-bcab-47b552c9b02e. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 02:16:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-eed322fe-76fd-478b-9c22-ef28fc5b2818 req-e876e74f-8005-434f-a5da-374ae09cabfa service nova] Acquiring lock "refresh_cache-5b243a71-802b-40f4-a374-16ecc2bae0f2" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG nova.network.neutron [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Updating instance_info_cache with network_info: [{"id": "ac234ca2-fa32-4f28-bcab-47b552c9b02e", "address": "fa:16:3e:e8:72:72", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac234ca2-fa", "ovs_interfaceid": "ac234ca2-fa32-4f28-bcab-47b552c9b02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Releasing lock "refresh_cache-5b243a71-802b-40f4-a374-16ecc2bae0f2" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG nova.compute.manager [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Instance network_info: |[{"id": "ac234ca2-fa32-4f28-bcab-47b552c9b02e", "address": "fa:16:3e:e8:72:72", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac234ca2-fa", "ovs_interfaceid": "ac234ca2-fa32-4f28-bcab-47b552c9b02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-eed322fe-76fd-478b-9c22-ef28fc5b2818 req-e876e74f-8005-434f-a5da-374ae09cabfa service nova] Acquired lock "refresh_cache-5b243a71-802b-40f4-a374-16ecc2bae0f2" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG nova.network.neutron [req-eed322fe-76fd-478b-9c22-ef28fc5b2818 req-e876e74f-8005-434f-a5da-374ae09cabfa service nova] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Refreshing network info cache for port ac234ca2-fa32-4f28-bcab-47b552c9b02e {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Start _get_guest_xml network_info=[{"id": "ac234ca2-fa32-4f28-bcab-47b552c9b02e", "address": "fa:16:3e:e8:72:72", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac234ca2-fa", "ovs_interfaceid": "ac234ca2-fa32-4f28-bcab-47b552c9b02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 02:16:54 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:16:54 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:16:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:16:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-872821442',display_name='tempest-AttachVolumeNegativeTest-server-872821442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-872821442',id=46,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsISeJYcsQzj300xI0rFprFbRIr/LQtgaSqSbXJ1Pr6kf8uYfeXju7g2gvvzsDVFTZUYIhmhRe5xZaNG1dr1NLOQ1SqimNbr3mSTWJJiZg26iWZwNGUe2i7uw8Bs59tSQ==',key_name='tempest-keypair-192458830',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0dcde6e918d64d70b69d2d81e1bdbe79',ramdisk_id='',reservation_id='r-zhonkx70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1854704348',owner_user_name='tempest-AttachVolumeNegativeTest-1854704348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T02:16:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='168a0142cf984aacb1f087adcaa96468',uuid=5b243a71-802b-40f4-a374-16ecc2bae0f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac234ca2-fa32-4f28-bcab-47b552c9b02e", "address": "fa:16:3e:e8:72:72", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac234ca2-fa", "ovs_interfaceid": "ac234ca2-fa32-4f28-bcab-47b552c9b02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Converting VIF {"id": "ac234ca2-fa32-4f28-bcab-47b552c9b02e", "address": "fa:16:3e:e8:72:72", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac234ca2-fa", "ovs_interfaceid": "ac234ca2-fa32-4f28-bcab-47b552c9b02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:72:72,bridge_name='br-int',has_traffic_filtering=True,id=ac234ca2-fa32-4f28-bcab-47b552c9b02e,network=Network(981c880a-2147-4da6-8021-a03d0aee3f3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac234ca2-fa') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG nova.objects.instance [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b243a71-802b-40f4-a374-16ecc2bae0f2 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] End _get_guest_xml xml=<domain type="kvm">
Apr 14 02:16:54 user nova-compute[71498]:   <uuid>5b243a71-802b-40f4-a374-16ecc2bae0f2</uuid>
Apr 14 02:16:54 user nova-compute[71498]:   <name>instance-0000002e</name>
Apr 14 02:16:54 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 02:16:54 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 02:16:54 user nova-compute[71498]:   <metadata>
Apr 14 02:16:54 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 02:16:54 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 02:16:54 user nova-compute[71498]:       <nova:name>tempest-AttachVolumeNegativeTest-server-872821442</nova:name>
Apr 14 02:16:54 user nova-compute[71498]:       <nova:creationTime>2023-04-14 02:16:54</nova:creationTime>
Apr 14 02:16:54 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 02:16:54 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 02:16:54 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 02:16:54 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 02:16:54 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 02:16:54 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 02:16:54 user nova-compute[71498]:       </nova:flavor>
Apr 14 02:16:54 user nova-compute[71498]:       <nova:owner>
Apr 14 02:16:54 user nova-compute[71498]:         <nova:user uuid="168a0142cf984aacb1f087adcaa96468">tempest-AttachVolumeNegativeTest-1854704348-project-member</nova:user>
Apr 14 02:16:54 user nova-compute[71498]:         <nova:project uuid="0dcde6e918d64d70b69d2d81e1bdbe79">tempest-AttachVolumeNegativeTest-1854704348</nova:project>
Apr 14 02:16:54 user nova-compute[71498]:       </nova:owner>
Apr 14 02:16:54 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 02:16:54 user nova-compute[71498]:       <nova:ports>
Apr 14 02:16:54 user nova-compute[71498]:         <nova:port uuid="ac234ca2-fa32-4f28-bcab-47b552c9b02e">
Apr 14 02:16:54 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 02:16:54 user nova-compute[71498]:         </nova:port>
Apr 14 02:16:54 user nova-compute[71498]:       </nova:ports>
Apr 14 02:16:54 user nova-compute[71498]:     </nova:instance>
Apr 14 02:16:54 user nova-compute[71498]:   </metadata>
Apr 14 02:16:54 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 02:16:54 user nova-compute[71498]:     <system>
Apr 14 02:16:54 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 02:16:54 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 02:16:54 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 02:16:54 user nova-compute[71498]:       <entry name="serial">5b243a71-802b-40f4-a374-16ecc2bae0f2</entry>
Apr 14 02:16:54 user nova-compute[71498]:       <entry name="uuid">5b243a71-802b-40f4-a374-16ecc2bae0f2</entry>
Apr 14 02:16:54 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 02:16:54 user nova-compute[71498]:     </system>
Apr 14 02:16:54 user nova-compute[71498]:   </sysinfo>
Apr 14 02:16:54 user nova-compute[71498]:   <os>
Apr 14 02:16:54 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 02:16:54 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 02:16:54 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 02:16:54 user nova-compute[71498]:   </os>
Apr 14 02:16:54 user nova-compute[71498]:   <features>
Apr 14 02:16:54 user nova-compute[71498]:     <acpi/>
Apr 14 02:16:54 user nova-compute[71498]:     <apic/>
Apr 14 02:16:54 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 02:16:54 user nova-compute[71498]:   </features>
Apr 14 02:16:54 user nova-compute[71498]:   <clock offset="utc">
Apr 14 02:16:54 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 02:16:54 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 02:16:54 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 02:16:54 user nova-compute[71498]:   </clock>
Apr 14 02:16:54 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 02:16:54 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 02:16:54 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 02:16:54 user nova-compute[71498]:   </cpu>
Apr 14 02:16:54 user nova-compute[71498]:   <devices>
Apr 14 02:16:54 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 02:16:54 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 02:16:54 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/5b243a71-802b-40f4-a374-16ecc2bae0f2/disk"/>
Apr 14 02:16:54 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 02:16:54 user nova-compute[71498]:     </disk>
Apr 14 02:16:54 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 02:16:54 user nova-compute[71498]:       <mac address="fa:16:3e:e8:72:72"/>
Apr 14 02:16:54 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 02:16:54 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 02:16:54 user nova-compute[71498]:       <target dev="tapac234ca2-fa"/>
Apr 14 02:16:54 user nova-compute[71498]:     </interface>
Apr 14 02:16:54 user nova-compute[71498]:     <serial type="pty">
Apr 14 02:16:54 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/5b243a71-802b-40f4-a374-16ecc2bae0f2/console.log" append="off"/>
Apr 14 02:16:54 user nova-compute[71498]:     </serial>
Apr 14 02:16:54 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 02:16:54 user nova-compute[71498]:     <video>
Apr 14 02:16:54 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 02:16:54 user nova-compute[71498]:     </video>
Apr 14 02:16:54 user nova-compute[71498]:     <rng model="virtio">
Apr 14 02:16:54 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 02:16:54 user nova-compute[71498]:     </rng>
Apr 14 02:16:54 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 02:16:54 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 02:16:54 user nova-compute[71498]:       <stats period="10"/>
Apr 14 02:16:54 user nova-compute[71498]:     </memballoon>
Apr 14 02:16:54 user nova-compute[71498]:   </devices>
Apr 14 02:16:54 user nova-compute[71498]: </domain>
Apr 14 02:16:54 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:16:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-872821442',display_name='tempest-AttachVolumeNegativeTest-server-872821442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-872821442',id=46,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsISeJYcsQzj300xI0rFprFbRIr/LQtgaSqSbXJ1Pr6kf8uYfeXju7g2gvvzsDVFTZUYIhmhRe5xZaNG1dr1NLOQ1SqimNbr3mSTWJJiZg26iWZwNGUe2i7uw8Bs59tSQ==',key_name='tempest-keypair-192458830',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0dcde6e918d64d70b69d2d81e1bdbe79',ramdisk_id='',reservation_id='r-zhonkx70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1854704348',owner_user_name='tempest-AttachVolumeNegativeTest-1854704348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T02:16:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='168a0142cf984aacb1f087adcaa96468',uuid=5b243a71-802b-40f4-a374-16ecc2bae0f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac234ca2-fa32-4f28-bcab-47b552c9b02e", "address": "fa:16:3e:e8:72:72", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac234ca2-fa", "ovs_interfaceid": "ac234ca2-fa32-4f28-bcab-47b552c9b02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Converting VIF {"id": "ac234ca2-fa32-4f28-bcab-47b552c9b02e", "address": "fa:16:3e:e8:72:72", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac234ca2-fa", "ovs_interfaceid": "ac234ca2-fa32-4f28-bcab-47b552c9b02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:72:72,bridge_name='br-int',has_traffic_filtering=True,id=ac234ca2-fa32-4f28-bcab-47b552c9b02e,network=Network(981c880a-2147-4da6-8021-a03d0aee3f3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac234ca2-fa') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG os_vif [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:72:72,bridge_name='br-int',has_traffic_filtering=True,id=ac234ca2-fa32-4f28-bcab-47b552c9b02e,network=Network(981c880a-2147-4da6-8021-a03d0aee3f3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac234ca2-fa') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac234ca2-fa, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapac234ca2-fa, col_values=(('external_ids', {'iface-id': 'ac234ca2-fa32-4f28-bcab-47b552c9b02e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:72:72', 'vm-uuid': '5b243a71-802b-40f4-a374-16ecc2bae0f2'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:16:54 user nova-compute[71498]: INFO os_vif [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:72:72,bridge_name='br-int',has_traffic_filtering=True,id=ac234ca2-fa32-4f28-bcab-47b552c9b02e,network=Network(981c880a-2147-4da6-8021-a03d0aee3f3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac234ca2-fa')
Apr 14 02:16:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] No VIF found with MAC fa:16:3e:e8:72:72, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG nova.network.neutron [req-eed322fe-76fd-478b-9c22-ef28fc5b2818 req-e876e74f-8005-434f-a5da-374ae09cabfa service nova] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Updated VIF entry in instance network info cache for port ac234ca2-fa32-4f28-bcab-47b552c9b02e. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG nova.network.neutron [req-eed322fe-76fd-478b-9c22-ef28fc5b2818 req-e876e74f-8005-434f-a5da-374ae09cabfa service nova] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Updating instance_info_cache with network_info: [{"id": "ac234ca2-fa32-4f28-bcab-47b552c9b02e", "address": "fa:16:3e:e8:72:72", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac234ca2-fa", "ovs_interfaceid": "ac234ca2-fa32-4f28-bcab-47b552c9b02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:16:54 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-eed322fe-76fd-478b-9c22-ef28fc5b2818 req-e876e74f-8005-434f-a5da-374ae09cabfa service nova] Releasing lock "refresh_cache-5b243a71-802b-40f4-a374-16ecc2bae0f2" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:16:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:16:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:16:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:16:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:16:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:16:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:16:56 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:16:56 user nova-compute[71498]: DEBUG nova.compute.manager [req-1e128242-db66-4891-bf0d-a1875ec38e37 req-9c472797-c331-4e2a-a54d-9cda1ff861dc service nova] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Received event network-vif-plugged-ac234ca2-fa32-4f28-bcab-47b552c9b02e {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:16:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1e128242-db66-4891-bf0d-a1875ec38e37 req-9c472797-c331-4e2a-a54d-9cda1ff861dc service nova] Acquiring lock "5b243a71-802b-40f4-a374-16ecc2bae0f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:16:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1e128242-db66-4891-bf0d-a1875ec38e37 req-9c472797-c331-4e2a-a54d-9cda1ff861dc service nova] Lock "5b243a71-802b-40f4-a374-16ecc2bae0f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:16:56 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-1e128242-db66-4891-bf0d-a1875ec38e37 req-9c472797-c331-4e2a-a54d-9cda1ff861dc service nova] Lock "5b243a71-802b-40f4-a374-16ecc2bae0f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:16:56 user nova-compute[71498]: DEBUG nova.compute.manager [req-1e128242-db66-4891-bf0d-a1875ec38e37 req-9c472797-c331-4e2a-a54d-9cda1ff861dc service nova] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] No waiting events found dispatching network-vif-plugged-ac234ca2-fa32-4f28-bcab-47b552c9b02e {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:16:56 user nova-compute[71498]: WARNING nova.compute.manager [req-1e128242-db66-4891-bf0d-a1875ec38e37 req-9c472797-c331-4e2a-a54d-9cda1ff861dc service nova] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Received unexpected event network-vif-plugged-ac234ca2-fa32-4f28-bcab-47b552c9b02e for instance with vm_state building and task_state spawning.
Apr 14 02:16:57 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681438617.7069867, 5b243a71-802b-40f4-a374-16ecc2bae0f2 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:16:57 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] VM Resumed (Lifecycle Event)
Apr 14 02:16:57 user nova-compute[71498]: DEBUG nova.compute.manager [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 02:16:57 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 02:16:57 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Instance spawned successfully.
Apr 14 02:16:57 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 02:16:57 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:16:57 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 02:16:57 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:16:57 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:16:57 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:16:57 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:16:57 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:16:57 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:16:57 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 02:16:57 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681438617.7085447, 5b243a71-802b-40f4-a374-16ecc2bae0f2 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:16:57 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] VM Started (Lifecycle Event)
Apr 14 02:16:57 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:16:57 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 02:16:57 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 02:16:57 user nova-compute[71498]: INFO nova.compute.manager [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Took 5.35 seconds to spawn the instance on the hypervisor.
Apr 14 02:16:57 user nova-compute[71498]: DEBUG nova.compute.manager [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:16:57 user nova-compute[71498]: INFO nova.compute.manager [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Took 5.90 seconds to build instance.
Apr 14 02:16:57 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-adfb1058-2dd2-4068-a9a5-cba126559fbf tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "5b243a71-802b-40f4-a374-16ecc2bae0f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.009s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:16:58 user nova-compute[71498]: DEBUG nova.compute.manager [req-c7687fcb-9572-4fb3-af20-06046569c4fc req-64d01fcb-0b49-4f50-a363-ba20be7e3d00 service nova] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Received event network-vif-plugged-ac234ca2-fa32-4f28-bcab-47b552c9b02e {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:16:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c7687fcb-9572-4fb3-af20-06046569c4fc req-64d01fcb-0b49-4f50-a363-ba20be7e3d00 service nova] Acquiring lock "5b243a71-802b-40f4-a374-16ecc2bae0f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:16:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c7687fcb-9572-4fb3-af20-06046569c4fc req-64d01fcb-0b49-4f50-a363-ba20be7e3d00 service nova] Lock "5b243a71-802b-40f4-a374-16ecc2bae0f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:16:58 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c7687fcb-9572-4fb3-af20-06046569c4fc req-64d01fcb-0b49-4f50-a363-ba20be7e3d00 service nova] Lock "5b243a71-802b-40f4-a374-16ecc2bae0f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:16:58 user nova-compute[71498]: DEBUG nova.compute.manager [req-c7687fcb-9572-4fb3-af20-06046569c4fc req-64d01fcb-0b49-4f50-a363-ba20be7e3d00 service nova] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] No waiting events found dispatching network-vif-plugged-ac234ca2-fa32-4f28-bcab-47b552c9b02e {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:16:58 user nova-compute[71498]: WARNING nova.compute.manager [req-c7687fcb-9572-4fb3-af20-06046569c4fc req-64d01fcb-0b49-4f50-a363-ba20be7e3d00 service nova] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Received unexpected event network-vif-plugged-ac234ca2-fa32-4f28-bcab-47b552c9b02e for instance with vm_state active and task_state None.
Apr 14 02:16:58 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:16:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:16:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:16:59 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:16:59 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 02:16:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-3f1e74ea-fe8b-4c37-aa30-21f7e17db259" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:16:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-3f1e74ea-fe8b-4c37-aa30-21f7e17db259" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:16:59 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 02:16:59 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Updating instance_info_cache with network_info: [{"id": "658d7098-ff69-45ed-8875-15a23a6bdb98", "address": "fa:16:3e:3f:d1:37", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap658d7098-ff", "ovs_interfaceid": "658d7098-ff69-45ed-8875-15a23a6bdb98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:16:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-3f1e74ea-fe8b-4c37-aa30-21f7e17db259" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:16:59 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 02:17:00 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:17:00 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Cleaning up deleted instances {{(pid=71498) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 02:17:00 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] There are 0 instances to clean {{(pid=71498) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 02:17:01 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:17:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:17:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:17:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:17:01 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 02:17:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b243a71-802b-40f4-a374-16ecc2bae0f2/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:17:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b243a71-802b-40f4-a374-16ecc2bae0f2/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:17:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b243a71-802b-40f4-a374-16ecc2bae0f2/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:17:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b243a71-802b-40f4-a374-16ecc2bae0f2/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:17:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:17:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:17:01 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:17:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:17:02 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:17:02 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:17:02 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=8710MB free_disk=26.148395538330078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 02:17:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:17:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:17:02 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:17:02 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 5b243a71-802b-40f4-a374-16ecc2bae0f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:17:02 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 02:17:02 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 02:17:02 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:17:02 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:17:02 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 02:17:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.211s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:17:04 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:17:04 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:04 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:17:04 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:17:04 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:17:04 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:04 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:17:05 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:17:08 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:17:08 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:17:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:17:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:17:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:17:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:17:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:17:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:09 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:17:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:17:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:17:11 user nova-compute[71498]: DEBUG nova.objects.instance [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lazy-loading 'flavor' on Instance uuid 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:17:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:17:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:17:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:17:11 user nova-compute[71498]: INFO nova.compute.manager [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Attaching volume 8e519936-e25f-479c-a1c3-f8fcb9f1af51 to /dev/vdb
Apr 14 02:17:11 user nova-compute[71498]: DEBUG os_brick.utils [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:17:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:17:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:17:11 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36ce2bb-7d98-4aa4-a581-1fafead6f173]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:17:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:17:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:17:11 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d11a02-ff92-4244-b497-5c9c7936d0f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:17:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:17:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:17:11 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1d937f-0d14-446f-acb6-78ab0bc9e872]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:17:11 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4310a711-54dc-4cdf-8c63-a9f6e02790eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:17:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:17:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 02:17:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 02:17:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:17:11 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 02:17:11 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 02:17:11 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48f1013-130b-423f-ae7c-e470878d1fac]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:17:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 02:17:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 02:17:11 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 02:17:11 user nova-compute[71498]: DEBUG os_brick.utils [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:17:11 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Updating existing volume attachment record: 69bb55f3-30e0-4804-9919-ddc2eefff1a6 {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 02:17:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:14 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:14 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:17:15 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:17:15 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 02:17:15 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:17:15 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Cleaning up deleted instances with incomplete migration  {{(pid=71498) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTcCjGIz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:17:16 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:17:16 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:17:16 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:17:16 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:17:16 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 02:17:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c8ee35-137b-4b7a-b43f-36d1de55f5e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 02:17:16 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad42b64-7c0a-4107-bd65-a3e5c72075ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51] added
Apr 14 02:17:16 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[104bdc42-9067-43cd-8ea4-1436b316d719]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f87ccf-259c-48b2-b661-06c57b9d331a]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UTcCjGIz {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UTcCjGIz" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[890d54b3-33dc-4ed5-927d-682480a1236c]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UTcCjGIz'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0066ae-6181-488a-bc1d-54a16af3b25b]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de072d0-b6ae-40e3-9323-6ef40a7afa8f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 02:17:16 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 02:17:16 user nova-compute[71498]:  {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:17:16 user nova-compute[71498]: WARNING os_brick.initiator.connectors.iscsi [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 02:17:16 user nova-compute[71498]: 
Apr 14 02:17:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cdde9a-b52f-4812-9de2-10a951206a8d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51, portal: 172.16.0.220,3260]
Apr 14 02:17:16 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51, portal: 172.16.0.220,3260] successful.
Apr 14 02:17:16 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62f80ff-4a47-4eca-8499-87f784366732]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fa4f14-43c0-4d5a-8212-3bfcf8940829]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 (non-flash)
Apr 14 02:17:16 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 (non-flash)
Apr 14 02:17:16 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7984a04-cff4-4028-b1c7-6c0a84107fe7]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 02:17:16 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTcCjGIz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 02:17:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:17:17 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23935653336653839', 'path': '/dev/sdb'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:17:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935653336653839', 'path': '/dev/sdb'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 02:17:17 user nova-compute[71498]: DEBUG nova.objects.instance [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lazy-loading 'flavor' on Instance uuid 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:17:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 02:17:17 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:17:17 user nova-compute[71498]:   <source dev="/dev/sdb"/>
Apr 14 02:17:17 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 02:17:17 user nova-compute[71498]:   <serial>8e519936-e25f-479c-a1c3-f8fcb9f1af51</serial>
Apr 14 02:17:17 user nova-compute[71498]: </disk>
Apr 14 02:17:17 user nova-compute[71498]:  {{(pid=71498) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 02:17:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:17:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:17:17 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] No VIF found with MAC fa:16:3e:3f:d1:37, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 02:17:18 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-b4ef0408-9ffc-4d08-86c6-dd698488b35d tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.568s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:17:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:19 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:21 user nova-compute[71498]: DEBUG nova.compute.manager [req-156ade6b-49fc-430a-9a89-6c5677cd1bcd req-b4c443ce-22b5-4b4e-9613-bbe9e0477864 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Received event network-changed-658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:17:21 user nova-compute[71498]: DEBUG nova.compute.manager [req-156ade6b-49fc-430a-9a89-6c5677cd1bcd req-b4c443ce-22b5-4b4e-9613-bbe9e0477864 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Refreshing instance network info cache due to event network-changed-658d7098-ff69-45ed-8875-15a23a6bdb98. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 02:17:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-156ade6b-49fc-430a-9a89-6c5677cd1bcd req-b4c443ce-22b5-4b4e-9613-bbe9e0477864 service nova] Acquiring lock "refresh_cache-3f1e74ea-fe8b-4c37-aa30-21f7e17db259" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:17:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-156ade6b-49fc-430a-9a89-6c5677cd1bcd req-b4c443ce-22b5-4b4e-9613-bbe9e0477864 service nova] Acquired lock "refresh_cache-3f1e74ea-fe8b-4c37-aa30-21f7e17db259" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:17:21 user nova-compute[71498]: DEBUG nova.network.neutron [req-156ade6b-49fc-430a-9a89-6c5677cd1bcd req-b4c443ce-22b5-4b4e-9613-bbe9e0477864 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Refreshing network info cache for port 658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 02:17:21 user nova-compute[71498]: DEBUG nova.network.neutron [req-156ade6b-49fc-430a-9a89-6c5677cd1bcd req-b4c443ce-22b5-4b4e-9613-bbe9e0477864 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Updated VIF entry in instance network info cache for port 658d7098-ff69-45ed-8875-15a23a6bdb98. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 02:17:21 user nova-compute[71498]: DEBUG nova.network.neutron [req-156ade6b-49fc-430a-9a89-6c5677cd1bcd req-b4c443ce-22b5-4b4e-9613-bbe9e0477864 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Updating instance_info_cache with network_info: [{"id": "658d7098-ff69-45ed-8875-15a23a6bdb98", "address": "fa:16:3e:3f:d1:37", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap658d7098-ff", "ovs_interfaceid": "658d7098-ff69-45ed-8875-15a23a6bdb98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:17:21 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-156ade6b-49fc-430a-9a89-6c5677cd1bcd req-b4c443ce-22b5-4b4e-9613-bbe9e0477864 service nova] Releasing lock "refresh_cache-3f1e74ea-fe8b-4c37-aa30-21f7e17db259" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:17:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f315ea8b-58d8-4096-8552-72371bf03f44 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:17:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f315ea8b-58d8-4096-8552-72371bf03f44 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:17:23 user nova-compute[71498]: INFO nova.compute.manager [None req-f315ea8b-58d8-4096-8552-72371bf03f44 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Rebooting instance
Apr 14 02:17:23 user nova-compute[71498]: DEBUG nova.compute.manager [req-fae77313-ea6c-4514-a38d-9b177b729947 req-fd69e90c-0f59-436a-a57c-4af342d022bf service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Received event network-changed-658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:17:23 user nova-compute[71498]: DEBUG nova.compute.manager [req-fae77313-ea6c-4514-a38d-9b177b729947 req-fd69e90c-0f59-436a-a57c-4af342d022bf service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Refreshing instance network info cache due to event network-changed-658d7098-ff69-45ed-8875-15a23a6bdb98. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 02:17:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-fae77313-ea6c-4514-a38d-9b177b729947 req-fd69e90c-0f59-436a-a57c-4af342d022bf service nova] Acquiring lock "refresh_cache-3f1e74ea-fe8b-4c37-aa30-21f7e17db259" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:17:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-fae77313-ea6c-4514-a38d-9b177b729947 req-fd69e90c-0f59-436a-a57c-4af342d022bf service nova] Acquired lock "refresh_cache-3f1e74ea-fe8b-4c37-aa30-21f7e17db259" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:17:23 user nova-compute[71498]: DEBUG nova.network.neutron [req-fae77313-ea6c-4514-a38d-9b177b729947 req-fd69e90c-0f59-436a-a57c-4af342d022bf service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Refreshing network info cache for port 658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 02:17:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f315ea8b-58d8-4096-8552-72371bf03f44 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "refresh_cache-3f1e74ea-fe8b-4c37-aa30-21f7e17db259" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:17:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:23 user nova-compute[71498]: DEBUG nova.network.neutron [req-fae77313-ea6c-4514-a38d-9b177b729947 req-fd69e90c-0f59-436a-a57c-4af342d022bf service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Updated VIF entry in instance network info cache for port 658d7098-ff69-45ed-8875-15a23a6bdb98. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 02:17:23 user nova-compute[71498]: DEBUG nova.network.neutron [req-fae77313-ea6c-4514-a38d-9b177b729947 req-fd69e90c-0f59-436a-a57c-4af342d022bf service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Updating instance_info_cache with network_info: [{"id": "658d7098-ff69-45ed-8875-15a23a6bdb98", "address": "fa:16:3e:3f:d1:37", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap658d7098-ff", "ovs_interfaceid": "658d7098-ff69-45ed-8875-15a23a6bdb98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:17:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-fae77313-ea6c-4514-a38d-9b177b729947 req-fd69e90c-0f59-436a-a57c-4af342d022bf service nova] Releasing lock "refresh_cache-3f1e74ea-fe8b-4c37-aa30-21f7e17db259" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:17:23 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f315ea8b-58d8-4096-8552-72371bf03f44 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquired lock "refresh_cache-3f1e74ea-fe8b-4c37-aa30-21f7e17db259" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:17:23 user nova-compute[71498]: DEBUG nova.network.neutron [None req-f315ea8b-58d8-4096-8552-72371bf03f44 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 02:17:24 user nova-compute[71498]: DEBUG nova.network.neutron [None req-f315ea8b-58d8-4096-8552-72371bf03f44 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Updating instance_info_cache with network_info: [{"id": "658d7098-ff69-45ed-8875-15a23a6bdb98", "address": "fa:16:3e:3f:d1:37", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap658d7098-ff", "ovs_interfaceid": "658d7098-ff69-45ed-8875-15a23a6bdb98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:17:24 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f315ea8b-58d8-4096-8552-72371bf03f44 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Releasing lock "refresh_cache-3f1e74ea-fe8b-4c37-aa30-21f7e17db259" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:17:24 user nova-compute[71498]: DEBUG nova.compute.manager [None req-f315ea8b-58d8-4096-8552-72371bf03f44 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:17:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:26 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:26 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:26 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:26 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:26 user nova-compute[71498]: DEBUG nova.compute.manager [req-680af4ed-1c09-4a0c-bde2-3b2eeba47556 req-5f569aae-21d4-454d-a01e-7c5382270277 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Received event network-vif-unplugged-658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:17:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-680af4ed-1c09-4a0c-bde2-3b2eeba47556 req-5f569aae-21d4-454d-a01e-7c5382270277 service nova] Acquiring lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:17:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-680af4ed-1c09-4a0c-bde2-3b2eeba47556 req-5f569aae-21d4-454d-a01e-7c5382270277 service nova] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:17:26 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-680af4ed-1c09-4a0c-bde2-3b2eeba47556 req-5f569aae-21d4-454d-a01e-7c5382270277 service nova] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:17:26 user nova-compute[71498]: DEBUG nova.compute.manager [req-680af4ed-1c09-4a0c-bde2-3b2eeba47556 req-5f569aae-21d4-454d-a01e-7c5382270277 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] No waiting events found dispatching network-vif-unplugged-658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:17:26 user nova-compute[71498]: WARNING nova.compute.manager [req-680af4ed-1c09-4a0c-bde2-3b2eeba47556 req-5f569aae-21d4-454d-a01e-7c5382270277 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Received unexpected event network-vif-unplugged-658d7098-ff69-45ed-8875-15a23a6bdb98 for instance with vm_state active and task_state reboot_started.
Apr 14 02:17:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:27 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-f315ea8b-58d8-4096-8552-72371bf03f44 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Instance shutdown successfully.
Apr 14 02:17:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:27 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:28 user nova-compute[71498]: DEBUG nova.compute.manager [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Received event network-vif-plugged-658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:17:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] Acquiring lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:17:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:17:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:17:28 user nova-compute[71498]: DEBUG nova.compute.manager [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] No waiting events found dispatching network-vif-plugged-658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:17:28 user nova-compute[71498]: WARNING nova.compute.manager [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Received unexpected event network-vif-plugged-658d7098-ff69-45ed-8875-15a23a6bdb98 for instance with vm_state active and task_state reboot_started.
Apr 14 02:17:28 user nova-compute[71498]: DEBUG nova.compute.manager [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Received event network-vif-plugged-658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:17:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] Acquiring lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:17:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:17:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:17:28 user nova-compute[71498]: DEBUG nova.compute.manager [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] No waiting events found dispatching network-vif-plugged-658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:17:28 user nova-compute[71498]: WARNING nova.compute.manager [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Received unexpected event network-vif-plugged-658d7098-ff69-45ed-8875-15a23a6bdb98 for instance with vm_state active and task_state reboot_started.
Apr 14 02:17:28 user nova-compute[71498]: DEBUG nova.compute.manager [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Received event network-vif-plugged-658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:17:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] Acquiring lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:17:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:17:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:17:28 user nova-compute[71498]: DEBUG nova.compute.manager [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] No waiting events found dispatching network-vif-plugged-658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:17:28 user nova-compute[71498]: WARNING nova.compute.manager [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Received unexpected event network-vif-plugged-658d7098-ff69-45ed-8875-15a23a6bdb98 for instance with vm_state active and task_state reboot_started.
Apr 14 02:17:28 user nova-compute[71498]: DEBUG nova.compute.manager [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Received event network-vif-unplugged-658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:17:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] Acquiring lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:17:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:17:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:17:28 user nova-compute[71498]: DEBUG nova.compute.manager [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] No waiting events found dispatching network-vif-unplugged-658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:17:28 user nova-compute[71498]: WARNING nova.compute.manager [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Received unexpected event network-vif-unplugged-658d7098-ff69-45ed-8875-15a23a6bdb98 for instance with vm_state active and task_state reboot_started.
Apr 14 02:17:28 user nova-compute[71498]: DEBUG nova.compute.manager [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Received event network-vif-plugged-658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:17:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] Acquiring lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:17:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:17:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:17:28 user nova-compute[71498]: DEBUG nova.compute.manager [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] No waiting events found dispatching network-vif-plugged-658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:17:28 user nova-compute[71498]: WARNING nova.compute.manager [req-b65f96fc-5eba-452e-a4eb-21eda9bdf233 req-dc2c8a9a-ac86-4363-9ba5-0923e0e8ea55 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Received unexpected event network-vif-plugged-658d7098-ff69-45ed-8875-15a23a6bdb98 for instance with vm_state active and task_state reboot_started.
Apr 14 02:17:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.host [None req-d0170308-0176-429c-b298-160fda25d12f None None] Removed pending event for 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 due to event {{(pid=71498) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 02:17:30 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681438650.6671417, 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:17:30 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] VM Resumed (Lifecycle Event)
Apr 14 02:17:30 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Instance running successfully.
Apr 14 02:17:30 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-f315ea8b-58d8-4096-8552-72371bf03f44 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Instance soft rebooted successfully.
Apr 14 02:17:30 user nova-compute[71498]: DEBUG nova.compute.manager [None req-f315ea8b-58d8-4096-8552-72371bf03f44 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:17:30 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:17:30 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 02:17:30 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] During sync_power_state the instance has a pending task (reboot_started). Skip.
Apr 14 02:17:30 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681438650.6681364, 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:17:30 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] VM Started (Lifecycle Event)
Apr 14 02:17:30 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:17:30 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 02:17:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f315ea8b-58d8-4096-8552-72371bf03f44 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.575s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:17:30 user nova-compute[71498]: DEBUG nova.compute.manager [req-401e7124-fba6-463f-9b4c-95d584f9d5f7 req-81baea76-2b7b-4a69-b477-4b7d12838b3c service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Received event network-vif-plugged-658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:17:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-401e7124-fba6-463f-9b4c-95d584f9d5f7 req-81baea76-2b7b-4a69-b477-4b7d12838b3c service nova] Acquiring lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:17:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-401e7124-fba6-463f-9b4c-95d584f9d5f7 req-81baea76-2b7b-4a69-b477-4b7d12838b3c service nova] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:17:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-401e7124-fba6-463f-9b4c-95d584f9d5f7 req-81baea76-2b7b-4a69-b477-4b7d12838b3c service nova] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:17:30 user nova-compute[71498]: DEBUG nova.compute.manager [req-401e7124-fba6-463f-9b4c-95d584f9d5f7 req-81baea76-2b7b-4a69-b477-4b7d12838b3c service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] No waiting events found dispatching network-vif-plugged-658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:17:30 user nova-compute[71498]: WARNING nova.compute.manager [req-401e7124-fba6-463f-9b4c-95d584f9d5f7 req-81baea76-2b7b-4a69-b477-4b7d12838b3c service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Received unexpected event network-vif-plugged-658d7098-ff69-45ed-8875-15a23a6bdb98 for instance with vm_state active and task_state None.
Apr 14 02:17:30 user nova-compute[71498]: DEBUG nova.compute.manager [req-401e7124-fba6-463f-9b4c-95d584f9d5f7 req-81baea76-2b7b-4a69-b477-4b7d12838b3c service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Received event network-vif-plugged-658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:17:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-401e7124-fba6-463f-9b4c-95d584f9d5f7 req-81baea76-2b7b-4a69-b477-4b7d12838b3c service nova] Acquiring lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:17:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-401e7124-fba6-463f-9b4c-95d584f9d5f7 req-81baea76-2b7b-4a69-b477-4b7d12838b3c service nova] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:17:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-401e7124-fba6-463f-9b4c-95d584f9d5f7 req-81baea76-2b7b-4a69-b477-4b7d12838b3c service nova] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:17:30 user nova-compute[71498]: DEBUG nova.compute.manager [req-401e7124-fba6-463f-9b4c-95d584f9d5f7 req-81baea76-2b7b-4a69-b477-4b7d12838b3c service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] No waiting events found dispatching network-vif-plugged-658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:17:30 user nova-compute[71498]: WARNING nova.compute.manager [req-401e7124-fba6-463f-9b4c-95d584f9d5f7 req-81baea76-2b7b-4a69-b477-4b7d12838b3c service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Received unexpected event network-vif-plugged-658d7098-ff69-45ed-8875-15a23a6bdb98 for instance with vm_state active and task_state None.
Apr 14 02:17:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:34 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:34 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:17:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:44 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:49 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:51 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._sync_power_states {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:17:51 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Triggering sync for uuid 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 {{(pid=71498) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 02:17:51 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Triggering sync for uuid 5b243a71-802b-40f4-a374-16ecc2bae0f2 {{(pid=71498) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 02:17:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:17:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:17:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "5b243a71-802b-40f4-a374-16ecc2bae0f2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:17:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "5b243a71-802b-40f4-a374-16ecc2bae0f2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:17:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:17:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "5b243a71-802b-40f4-a374-16ecc2bae0f2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:17:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:58 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:17:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:17:59 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:17:59 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 02:17:59 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Rebuilding the list of instances to heal {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 02:17:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-3f1e74ea-fe8b-4c37-aa30-21f7e17db259" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:17:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-3f1e74ea-fe8b-4c37-aa30-21f7e17db259" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:17:59 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 02:17:59 user nova-compute[71498]: DEBUG nova.objects.instance [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lazy-loading 'info_cache' on Instance uuid 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:17:59 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Updating instance_info_cache with network_info: [{"id": "658d7098-ff69-45ed-8875-15a23a6bdb98", "address": "fa:16:3e:3f:d1:37", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap658d7098-ff", "ovs_interfaceid": "658d7098-ff69-45ed-8875-15a23a6bdb98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:17:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-3f1e74ea-fe8b-4c37-aa30-21f7e17db259" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:17:59 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 02:18:02 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:18:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:18:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:18:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:18:02 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 02:18:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b243a71-802b-40f4-a374-16ecc2bae0f2/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:18:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b243a71-802b-40f4-a374-16ecc2bae0f2/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:18:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b243a71-802b-40f4-a374-16ecc2bae0f2/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:18:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b243a71-802b-40f4-a374-16ecc2bae0f2/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:18:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:18:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:18:02 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:18:03 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:18:03 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 02:18:03 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:18:03 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:18:03 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=8732MB free_disk=26.11874008178711GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 02:18:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:18:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:18:03 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:18:03 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 5b243a71-802b-40f4-a374-16ecc2bae0f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:18:03 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 02:18:03 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 02:18:03 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Refreshing inventories for resource provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 02:18:03 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Updating ProviderTree inventory for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 02:18:03 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Updating inventory in ProviderTree for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 02:18:03 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Refreshing aggregate associations for resource provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4, aggregates: None {{(pid=71498) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 02:18:03 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Refreshing trait associations for resource provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,HW_CPU_X86_SSE2 {{(pid=71498) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 02:18:03 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:18:03 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:18:03 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 02:18:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.358s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:18:04 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:18:05 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:18:06 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:18:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:18:09 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:18:10 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:18:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:18:14 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:18:14 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:18:15 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:18:15 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 02:18:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:18:19 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:18:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:18:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:18:34 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:18:34 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:18:34 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:18:34 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:18:34 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:18:34 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:18:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:18:43 user nova-compute[71498]: DEBUG nova.compute.manager [req-ce388957-26a2-42d4-9bd6-b387e931dfc6 req-d936e740-4a15-4e3a-a237-27a090c146b4 service nova] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Received event network-changed-ac234ca2-fa32-4f28-bcab-47b552c9b02e {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:18:43 user nova-compute[71498]: DEBUG nova.compute.manager [req-ce388957-26a2-42d4-9bd6-b387e931dfc6 req-d936e740-4a15-4e3a-a237-27a090c146b4 service nova] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Refreshing instance network info cache due to event network-changed-ac234ca2-fa32-4f28-bcab-47b552c9b02e. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 02:18:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ce388957-26a2-42d4-9bd6-b387e931dfc6 req-d936e740-4a15-4e3a-a237-27a090c146b4 service nova] Acquiring lock "refresh_cache-5b243a71-802b-40f4-a374-16ecc2bae0f2" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:18:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ce388957-26a2-42d4-9bd6-b387e931dfc6 req-d936e740-4a15-4e3a-a237-27a090c146b4 service nova] Acquired lock "refresh_cache-5b243a71-802b-40f4-a374-16ecc2bae0f2" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:18:43 user nova-compute[71498]: DEBUG nova.network.neutron [req-ce388957-26a2-42d4-9bd6-b387e931dfc6 req-d936e740-4a15-4e3a-a237-27a090c146b4 service nova] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Refreshing network info cache for port ac234ca2-fa32-4f28-bcab-47b552c9b02e {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 02:18:43 user nova-compute[71498]: DEBUG nova.network.neutron [req-ce388957-26a2-42d4-9bd6-b387e931dfc6 req-d936e740-4a15-4e3a-a237-27a090c146b4 service nova] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Updated VIF entry in instance network info cache for port ac234ca2-fa32-4f28-bcab-47b552c9b02e. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 02:18:43 user nova-compute[71498]: DEBUG nova.network.neutron [req-ce388957-26a2-42d4-9bd6-b387e931dfc6 req-d936e740-4a15-4e3a-a237-27a090c146b4 service nova] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Updating instance_info_cache with network_info: [{"id": "ac234ca2-fa32-4f28-bcab-47b552c9b02e", "address": "fa:16:3e:e8:72:72", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac234ca2-fa", "ovs_interfaceid": "ac234ca2-fa32-4f28-bcab-47b552c9b02e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:18:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-ce388957-26a2-42d4-9bd6-b387e931dfc6 req-d936e740-4a15-4e3a-a237-27a090c146b4 service nova] Releasing lock "refresh_cache-5b243a71-802b-40f4-a374-16ecc2bae0f2" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:18:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:18:44 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:18:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "5b243a71-802b-40f4-a374-16ecc2bae0f2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:18:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "5b243a71-802b-40f4-a374-16ecc2bae0f2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:18:44 user nova-compute[71498]: DEBUG nova.objects.instance [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lazy-loading 'flavor' on Instance uuid 5b243a71-802b-40f4-a374-16ecc2bae0f2 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:18:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "5b243a71-802b-40f4-a374-16ecc2bae0f2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:18:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "5b243a71-802b-40f4-a374-16ecc2bae0f2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:18:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "5b243a71-802b-40f4-a374-16ecc2bae0f2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:18:44 user nova-compute[71498]: INFO nova.compute.manager [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Attaching volume de3bdf10-3f9b-49fc-b630-83ff7b711656 to /dev/vdb
Apr 14 02:18:44 user nova-compute[71498]: DEBUG os_brick.utils [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:18:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:18:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:18:44 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97b966f-8dae-4cb3-95a9-0eb8fed73f01]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:18:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:18:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:18:44 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cccc53-b33a-4d24-a7cb-6648935d4b48]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:18:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:18:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:18:44 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9da555-1d6c-49bc-90f3-011d7df498b1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:18:44 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f390aa0f-d649-4cd4-b1a5-f6ca9fa3ef1d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:18:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:18:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 02:18:44 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 02:18:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:18:44 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 02:18:44 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 02:18:44 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ef96ff-12c9-4a2a-8f8f-27eb6256eade]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:18:44 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 02:18:44 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 02:18:44 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 02:18:44 user nova-compute[71498]: DEBUG os_brick.utils [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:18:44 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Updating existing volume attachment record: fb4e67e5-883d-4b94-8ac6-c75a48d6ef87 {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 02:18:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cqFTNOLU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:18:49 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:18:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:18:49 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:18:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:18:49 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 02:18:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c55c71-79f1-441b-b802-dd2c70ef2070]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 02:18:49 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1f0e94-e820-4d30-85fb-8f41d7f10114]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656] added
Apr 14 02:18:49 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b50b32-f3b1-4271-a85e-6a23e07c3abf]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[66700a70-6860-4e33-960c-381cdd2ba00e]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cqFTNOLU {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cqFTNOLU" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b11d23e-4cfc-41ab-8884-397569b928a7]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cqFTNOLU'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b71b638-e579-4314-89ee-fa6200b6d0a5]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af55650-1a56-4f51-ad08-726019ca4005]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 (non-flash)
Apr 14 02:18:49 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 (non-flash)
Apr 14 02:18:49 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb034ce-8e6e-47b4-a9ca-43abfba5ba2f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656, portal: 172.16.0.220,3260]
Apr 14 02:18:49 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656, portal: 172.16.0.220,3260] successful.
Apr 14 02:18:49 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b03efe-04ea-46d4-a065-c1da20ca7601]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[332bc8ce-db51-4b45-b9a7-70eb405cb3ab]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 (non-flash)
Apr 14 02:18:49 user nova-compute[71498]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 (non-flash)
Apr 14 02:18:49 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 (non-flash)
Apr 14 02:18:49 user nova-compute[71498]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 (non-flash)
Apr 14 02:18:49 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef002b0-c72b-4c54-9d7d-4db6e0eeeb21]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 02:18:49 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cqFTNOLU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 02:18:50 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:18:50 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23730653330386135', 'path': '/dev/sdc'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:18:50 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730653330386135', 'path': '/dev/sdc'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 02:18:50 user nova-compute[71498]: DEBUG nova.objects.instance [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lazy-loading 'flavor' on Instance uuid 5b243a71-802b-40f4-a374-16ecc2bae0f2 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:18:50 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 02:18:50 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:18:50 user nova-compute[71498]:   <source dev="/dev/sdc"/>
Apr 14 02:18:50 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 02:18:50 user nova-compute[71498]:   <serial>de3bdf10-3f9b-49fc-b630-83ff7b711656</serial>
Apr 14 02:18:50 user nova-compute[71498]: </disk>
Apr 14 02:18:50 user nova-compute[71498]:  {{(pid=71498) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 02:18:50 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:18:50 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:18:50 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] No VIF found with MAC fa:16:3e:e8:72:72, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 02:18:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-2bfc4e7f-d9fb-4ed5-b84c-f8adffd39a58 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "5b243a71-802b-40f4-a374-16ecc2bae0f2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.301s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:18:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "5b243a71-802b-40f4-a374-16ecc2bae0f2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:18:51 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "5b243a71-802b-40f4-a374-16ecc2bae0f2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:18:51 user nova-compute[71498]: INFO nova.compute.manager [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Detaching volume de3bdf10-3f9b-49fc-b630-83ff7b711656
Apr 14 02:18:51 user nova-compute[71498]: INFO nova.virt.block_device [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Attempting to driver detach volume de3bdf10-3f9b-49fc-b630-83ff7b711656 from mountpoint /dev/vdb
Apr 14 02:18:51 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Attempting to detach device vdb from instance 5b243a71-802b-40f4-a374-16ecc2bae0f2 from the persistent domain config. {{(pid=71498) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 02:18:51 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 02:18:51 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:18:51 user nova-compute[71498]:   <source dev="/dev/sdc"/>
Apr 14 02:18:51 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 02:18:51 user nova-compute[71498]:   <serial>de3bdf10-3f9b-49fc-b630-83ff7b711656</serial>
Apr 14 02:18:51 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 02:18:51 user nova-compute[71498]: </disk>
Apr 14 02:18:51 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 02:18:51 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Successfully detached device vdb from instance 5b243a71-802b-40f4-a374-16ecc2bae0f2 from the persistent domain config.
Apr 14 02:18:51 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5b243a71-802b-40f4-a374-16ecc2bae0f2 from the live domain config. {{(pid=71498) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 02:18:51 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 02:18:51 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:18:51 user nova-compute[71498]:   <source dev="/dev/sdc"/>
Apr 14 02:18:51 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 02:18:51 user nova-compute[71498]:   <serial>de3bdf10-3f9b-49fc-b630-83ff7b711656</serial>
Apr 14 02:18:51 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 02:18:51 user nova-compute[71498]: </disk>
Apr 14 02:18:51 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Received event <DeviceRemovedEvent: 1681438732.0962868, 5b243a71-802b-40f4-a374-16ecc2bae0f2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71498) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5b243a71-802b-40f4-a374-16ecc2bae0f2 {{(pid=71498) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 02:18:52 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Successfully detached device vdb from instance 5b243a71-802b-40f4-a374-16ecc2bae0f2 from the live domain config.
Apr 14 02:18:52 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cqFTNOLU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:18:52 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:18:52 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0177e760-ee17-4e9d-a295-65968b705139]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 02:18:52 user nova-compute[71498]: No targets found.
Apr 14 02:18:52 user nova-compute[71498]: iSNS:
Apr 14 02:18:52 user nova-compute[71498]: No targets found.
Apr 14 02:18:52 user nova-compute[71498]: STATIC:
Apr 14 02:18:52 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656
Apr 14 02:18:52 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 02:18:52 user nova-compute[71498]:                 Iface Name: default
Apr 14 02:18:52 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51
Apr 14 02:18:52 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 02:18:52 user nova-compute[71498]:                 Iface Name: default
Apr 14 02:18:52 user nova-compute[71498]: FIRMWARE:
Apr 14 02:18:52 user nova-compute[71498]: No targets found.
Apr 14 02:18:52 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 02:18:52 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 02:18:52 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24dbf45-cf3f-4c7d-831a-9d6d3e0f6d70]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f905ece-c46c-4149-ba90-c40e009c0539]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 (non-flash)
Apr 14 02:18:52 user nova-compute[71498]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 (non-flash)
Apr 14 02:18:52 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 (non-flash)
Apr 14 02:18:52 user nova-compute[71498]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 (non-flash)
Apr 14 02:18:52 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51c46a0c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656'): ({'sdc'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Removing single pathed devices sdc {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[203a4444-79d1-48e7-967f-77dacd1fa4b6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff607a4-1c32-4bcf-894c-91daca3acc60]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Flushing IO for device /dev/sdc {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a77a69-4fd2-4d2e-bd76-1f556c79584c]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5506a459-0f26-4443-b9ad-8cd54de95b61]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] SCSI volumes sdc have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14ff47e-acea-4227-9900-7b6f6116add6]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c377d20-9ddb-42bf-95ef-4cfae34b7f93]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656, portal: 172.16.0.220,3260]
Apr 14 02:18:52 user nova-compute[71498]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656, portal: 172.16.0.220,3260] successful.
Apr 14 02:18:52 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3bdf10-3f9b-49fc-b630-83ff7b711656 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5036ff-bf52-483c-a965-cf3c4d1afd4a]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] <== disconnect_volume: return (296ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:18:52 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 02:18:53 user nova-compute[71498]: DEBUG nova.objects.instance [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lazy-loading 'flavor' on Instance uuid 5b243a71-802b-40f4-a374-16ecc2bae0f2 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:18:53 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d11dff16-8e93-413d-99ec-68bf2e78324d tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "5b243a71-802b-40f4-a374-16ecc2bae0f2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.590s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:18:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:18:54 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:18:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:18:59 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:18:59 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:18:59 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 02:18:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-5b243a71-802b-40f4-a374-16ecc2bae0f2" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:18:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-5b243a71-802b-40f4-a374-16ecc2bae0f2" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:18:59 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 02:18:59 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Updating instance_info_cache with network_info: [{"id": "ac234ca2-fa32-4f28-bcab-47b552c9b02e", "address": "fa:16:3e:e8:72:72", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac234ca2-fa", "ovs_interfaceid": "ac234ca2-fa32-4f28-bcab-47b552c9b02e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:18:59 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-5b243a71-802b-40f4-a374-16ecc2bae0f2" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:18:59 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 02:18:59 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:19:03 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:19:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:19:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:19:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:19:03 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 02:19:03 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b243a71-802b-40f4-a374-16ecc2bae0f2/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:19:03 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b243a71-802b-40f4-a374-16ecc2bae0f2/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:19:03 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b243a71-802b-40f4-a374-16ecc2bae0f2/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:19:03 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b243a71-802b-40f4-a374-16ecc2bae0f2/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:19:03 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:19:03 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:19:03 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:19:04 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:19:04 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71498) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 02:19:04 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:19:04 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:19:04 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:19:04 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=8700MB free_disk=26.11764907836914GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 02:19:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:19:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:19:04 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:19:04 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 5b243a71-802b-40f4-a374-16ecc2bae0f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:19:04 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 02:19:04 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 02:19:04 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:19:04 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:19:04 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 02:19:04 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.207s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:19:05 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:19:06 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:19:09 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:19:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:19:11 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:19:11 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:19:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:19:14 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:19:14 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:19:14 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:19:14 user nova-compute[71498]: DEBUG nova.compute.manager [req-d6c8b44f-bdb9-4138-92e9-94fdf9da5b89 req-23965817-fefe-478e-a39a-27927c6aa5bb service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Received event network-changed-658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:19:14 user nova-compute[71498]: DEBUG nova.compute.manager [req-d6c8b44f-bdb9-4138-92e9-94fdf9da5b89 req-23965817-fefe-478e-a39a-27927c6aa5bb service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Refreshing instance network info cache due to event network-changed-658d7098-ff69-45ed-8875-15a23a6bdb98. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 02:19:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d6c8b44f-bdb9-4138-92e9-94fdf9da5b89 req-23965817-fefe-478e-a39a-27927c6aa5bb service nova] Acquiring lock "refresh_cache-3f1e74ea-fe8b-4c37-aa30-21f7e17db259" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:19:14 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d6c8b44f-bdb9-4138-92e9-94fdf9da5b89 req-23965817-fefe-478e-a39a-27927c6aa5bb service nova] Acquired lock "refresh_cache-3f1e74ea-fe8b-4c37-aa30-21f7e17db259" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:19:14 user nova-compute[71498]: DEBUG nova.network.neutron [req-d6c8b44f-bdb9-4138-92e9-94fdf9da5b89 req-23965817-fefe-478e-a39a-27927c6aa5bb service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Refreshing network info cache for port 658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 02:19:15 user nova-compute[71498]: DEBUG nova.network.neutron [req-d6c8b44f-bdb9-4138-92e9-94fdf9da5b89 req-23965817-fefe-478e-a39a-27927c6aa5bb service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Updated VIF entry in instance network info cache for port 658d7098-ff69-45ed-8875-15a23a6bdb98. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 02:19:15 user nova-compute[71498]: DEBUG nova.network.neutron [req-d6c8b44f-bdb9-4138-92e9-94fdf9da5b89 req-23965817-fefe-478e-a39a-27927c6aa5bb service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Updating instance_info_cache with network_info: [{"id": "658d7098-ff69-45ed-8875-15a23a6bdb98", "address": "fa:16:3e:3f:d1:37", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap658d7098-ff", "ovs_interfaceid": "658d7098-ff69-45ed-8875-15a23a6bdb98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:19:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-d6c8b44f-bdb9-4138-92e9-94fdf9da5b89 req-23965817-fefe-478e-a39a-27927c6aa5bb service nova] Releasing lock "refresh_cache-3f1e74ea-fe8b-4c37-aa30-21f7e17db259" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:19:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:19:15 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:19:15 user nova-compute[71498]: INFO nova.compute.manager [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Detaching volume 8e519936-e25f-479c-a1c3-f8fcb9f1af51
Apr 14 02:19:15 user nova-compute[71498]: INFO nova.virt.block_device [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Attempting to driver detach volume 8e519936-e25f-479c-a1c3-f8fcb9f1af51 from mountpoint /dev/vdb
Apr 14 02:19:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Attempting to detach device vdb from instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 from the persistent domain config. {{(pid=71498) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 02:19:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 02:19:15 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:19:15 user nova-compute[71498]:   <source dev="/dev/sdb"/>
Apr 14 02:19:15 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 02:19:15 user nova-compute[71498]:   <serial>8e519936-e25f-479c-a1c3-f8fcb9f1af51</serial>
Apr 14 02:19:15 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 02:19:15 user nova-compute[71498]: </disk>
Apr 14 02:19:15 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 02:19:15 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Successfully detached device vdb from instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 from the persistent domain config.
Apr 14 02:19:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 from the live domain config. {{(pid=71498) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 02:19:15 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 02:19:15 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:19:15 user nova-compute[71498]:   <source dev="/dev/sdb"/>
Apr 14 02:19:15 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 02:19:15 user nova-compute[71498]:   <serial>8e519936-e25f-479c-a1c3-f8fcb9f1af51</serial>
Apr 14 02:19:15 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 02:19:15 user nova-compute[71498]: </disk>
Apr 14 02:19:15 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Received event <DeviceRemovedEvent: 1681438756.054425, 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71498) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 {{(pid=71498) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 02:19:16 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Successfully detached device vdb from instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 from the live domain config.
Apr 14 02:19:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTcCjGIz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:19:16 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:19:16 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cb6345-e8fa-4fee-9613-88281f0c2538]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 02:19:16 user nova-compute[71498]: No targets found.
Apr 14 02:19:16 user nova-compute[71498]: iSNS:
Apr 14 02:19:16 user nova-compute[71498]: No targets found.
Apr 14 02:19:16 user nova-compute[71498]: STATIC:
Apr 14 02:19:16 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51
Apr 14 02:19:16 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 02:19:16 user nova-compute[71498]:                 Iface Name: default
Apr 14 02:19:16 user nova-compute[71498]: FIRMWARE:
Apr 14 02:19:16 user nova-compute[71498]: No targets found.
Apr 14 02:19:16 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 02:19:16 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 02:19:16 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdaa8ef-18de-492b-9638-7590b12f8d45]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[939f0cb3-6c73-4880-84d7-75fc69ed2c1d]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 (non-flash)
Apr 14 02:19:16 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 (non-flash)
Apr 14 02:19:16 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52013695a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51'): ({'sdb'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Removing single pathed devices sdb {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b317a3-f087-41d5-b47b-c8705851e5a2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[08383c53-2241-4fbb-9c58-bdcf7d342530]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Flushing IO for device /dev/sdb {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbb01dc-8057-48c4-8138-374b10904d48]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.028s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af88398-8dda-4ce1-aa91-48bd0d595582]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] SCSI volumes sdb have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb9717f-a76b-4044-ba66-c1a9d96f4e8d]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b49257c-2c99-4585-8ddd-48bc35f77fd2]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51, portal: 172.16.0.220,3260]
Apr 14 02:19:16 user nova-compute[71498]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51, portal: 172.16.0.220,3260] successful.
Apr 14 02:19:16 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e519936-e25f-479c-a1c3-f8fcb9f1af51 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e759db60-fd2e-4da2-a87a-d6ee099e87da]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] <== disconnect_volume: return (281ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG nova.compute.manager [req-c15b5356-a9be-45e9-811a-4d50a2e57024 req-5f4f9be0-e0f0-4b4f-8d79-b4402bbb7fe7 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Received event network-changed-658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG nova.compute.manager [req-c15b5356-a9be-45e9-811a-4d50a2e57024 req-5f4f9be0-e0f0-4b4f-8d79-b4402bbb7fe7 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Refreshing instance network info cache due to event network-changed-658d7098-ff69-45ed-8875-15a23a6bdb98. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c15b5356-a9be-45e9-811a-4d50a2e57024 req-5f4f9be0-e0f0-4b4f-8d79-b4402bbb7fe7 service nova] Acquiring lock "refresh_cache-3f1e74ea-fe8b-4c37-aa30-21f7e17db259" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c15b5356-a9be-45e9-811a-4d50a2e57024 req-5f4f9be0-e0f0-4b4f-8d79-b4402bbb7fe7 service nova] Acquired lock "refresh_cache-3f1e74ea-fe8b-4c37-aa30-21f7e17db259" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:19:16 user nova-compute[71498]: DEBUG nova.network.neutron [req-c15b5356-a9be-45e9-811a-4d50a2e57024 req-5f4f9be0-e0f0-4b4f-8d79-b4402bbb7fe7 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Refreshing network info cache for port 658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 02:19:17 user nova-compute[71498]: DEBUG nova.network.neutron [req-c15b5356-a9be-45e9-811a-4d50a2e57024 req-5f4f9be0-e0f0-4b4f-8d79-b4402bbb7fe7 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Updated VIF entry in instance network info cache for port 658d7098-ff69-45ed-8875-15a23a6bdb98. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 02:19:17 user nova-compute[71498]: DEBUG nova.network.neutron [req-c15b5356-a9be-45e9-811a-4d50a2e57024 req-5f4f9be0-e0f0-4b4f-8d79-b4402bbb7fe7 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Updating instance_info_cache with network_info: [{"id": "658d7098-ff69-45ed-8875-15a23a6bdb98", "address": "fa:16:3e:3f:d1:37", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap658d7098-ff", "ovs_interfaceid": "658d7098-ff69-45ed-8875-15a23a6bdb98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:19:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-c15b5356-a9be-45e9-811a-4d50a2e57024 req-5f4f9be0-e0f0-4b4f-8d79-b4402bbb7fe7 service nova] Releasing lock "refresh_cache-3f1e74ea-fe8b-4c37-aa30-21f7e17db259" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:19:17 user nova-compute[71498]: DEBUG nova.objects.instance [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lazy-loading 'flavor' on Instance uuid 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:19:17 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-06f1ead4-077d-4dcf-b536-0d340e8de914 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.786s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:19:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:19:19 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:19:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:19:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:19:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:19:34 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:19:39 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:19:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-513ea079-60fa-4076-b897-ca919016e306 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "5b243a71-802b-40f4-a374-16ecc2bae0f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:19:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-513ea079-60fa-4076-b897-ca919016e306 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "5b243a71-802b-40f4-a374-16ecc2bae0f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:19:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-513ea079-60fa-4076-b897-ca919016e306 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "5b243a71-802b-40f4-a374-16ecc2bae0f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:19:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-513ea079-60fa-4076-b897-ca919016e306 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "5b243a71-802b-40f4-a374-16ecc2bae0f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:19:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-513ea079-60fa-4076-b897-ca919016e306 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "5b243a71-802b-40f4-a374-16ecc2bae0f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:19:41 user nova-compute[71498]: INFO nova.compute.manager [None req-513ea079-60fa-4076-b897-ca919016e306 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Terminating instance
Apr 14 02:19:41 user nova-compute[71498]: DEBUG nova.compute.manager [None req-513ea079-60fa-4076-b897-ca919016e306 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 02:19:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:19:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:19:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:19:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-f322988c-6efb-4de0-a6d8-7887a0fb5f69 req-76d648f7-a812-4f43-bbe2-587aea4c548b service nova] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Received event network-vif-unplugged-ac234ca2-fa32-4f28-bcab-47b552c9b02e {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:19:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f322988c-6efb-4de0-a6d8-7887a0fb5f69 req-76d648f7-a812-4f43-bbe2-587aea4c548b service nova] Acquiring lock "5b243a71-802b-40f4-a374-16ecc2bae0f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:19:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f322988c-6efb-4de0-a6d8-7887a0fb5f69 req-76d648f7-a812-4f43-bbe2-587aea4c548b service nova] Lock "5b243a71-802b-40f4-a374-16ecc2bae0f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:19:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-f322988c-6efb-4de0-a6d8-7887a0fb5f69 req-76d648f7-a812-4f43-bbe2-587aea4c548b service nova] Lock "5b243a71-802b-40f4-a374-16ecc2bae0f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:19:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-f322988c-6efb-4de0-a6d8-7887a0fb5f69 req-76d648f7-a812-4f43-bbe2-587aea4c548b service nova] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] No waiting events found dispatching network-vif-unplugged-ac234ca2-fa32-4f28-bcab-47b552c9b02e {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:19:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-f322988c-6efb-4de0-a6d8-7887a0fb5f69 req-76d648f7-a812-4f43-bbe2-587aea4c548b service nova] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Received event network-vif-unplugged-ac234ca2-fa32-4f28-bcab-47b552c9b02e for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 02:19:42 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Instance destroyed successfully.
Apr 14 02:19:42 user nova-compute[71498]: DEBUG nova.objects.instance [None req-513ea079-60fa-4076-b897-ca919016e306 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lazy-loading 'resources' on Instance uuid 5b243a71-802b-40f4-a374-16ecc2bae0f2 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:19:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-513ea079-60fa-4076-b897-ca919016e306 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:16:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-872821442',display_name='tempest-AttachVolumeNegativeTest-server-872821442',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-872821442',id=46,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsISeJYcsQzj300xI0rFprFbRIr/LQtgaSqSbXJ1Pr6kf8uYfeXju7g2gvvzsDVFTZUYIhmhRe5xZaNG1dr1NLOQ1SqimNbr3mSTWJJiZg26iWZwNGUe2i7uw8Bs59tSQ==',key_name='tempest-keypair-192458830',keypairs=<?>,launch_index=0,launched_at=2023-04-14T02:16:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0dcde6e918d64d70b69d2d81e1bdbe79',ramdisk_id='',reservation_id='r-zhonkx70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1854704348',owner_user_name='tempest-AttachVolumeNegativeTest-1854704348-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T02:16:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='168a0142cf984aacb1f087adcaa96468',uuid=5b243a71-802b-40f4-a374-16ecc2bae0f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac234ca2-fa32-4f28-bcab-47b552c9b02e", "address": "fa:16:3e:e8:72:72", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac234ca2-fa", "ovs_interfaceid": "ac234ca2-fa32-4f28-bcab-47b552c9b02e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 02:19:42 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-513ea079-60fa-4076-b897-ca919016e306 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Converting VIF {"id": "ac234ca2-fa32-4f28-bcab-47b552c9b02e", "address": "fa:16:3e:e8:72:72", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac234ca2-fa", "ovs_interfaceid": "ac234ca2-fa32-4f28-bcab-47b552c9b02e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:19:42 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-513ea079-60fa-4076-b897-ca919016e306 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:72:72,bridge_name='br-int',has_traffic_filtering=True,id=ac234ca2-fa32-4f28-bcab-47b552c9b02e,network=Network(981c880a-2147-4da6-8021-a03d0aee3f3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac234ca2-fa') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:19:42 user nova-compute[71498]: DEBUG os_vif [None req-513ea079-60fa-4076-b897-ca919016e306 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:72:72,bridge_name='br-int',has_traffic_filtering=True,id=ac234ca2-fa32-4f28-bcab-47b552c9b02e,network=Network(981c880a-2147-4da6-8021-a03d0aee3f3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac234ca2-fa') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 02:19:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:19:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac234ca2-fa, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:19:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:19:42 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:19:42 user nova-compute[71498]: INFO os_vif [None req-513ea079-60fa-4076-b897-ca919016e306 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:72:72,bridge_name='br-int',has_traffic_filtering=True,id=ac234ca2-fa32-4f28-bcab-47b552c9b02e,network=Network(981c880a-2147-4da6-8021-a03d0aee3f3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac234ca2-fa')
Apr 14 02:19:42 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-513ea079-60fa-4076-b897-ca919016e306 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Deleting instance files /opt/stack/data/nova/instances/5b243a71-802b-40f4-a374-16ecc2bae0f2_del
Apr 14 02:19:42 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-513ea079-60fa-4076-b897-ca919016e306 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Deletion of /opt/stack/data/nova/instances/5b243a71-802b-40f4-a374-16ecc2bae0f2_del complete
Apr 14 02:19:42 user nova-compute[71498]: INFO nova.compute.manager [None req-513ea079-60fa-4076-b897-ca919016e306 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 14 02:19:42 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-513ea079-60fa-4076-b897-ca919016e306 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 02:19:42 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 02:19:42 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 02:19:43 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:19:43 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Took 0.78 seconds to deallocate network for instance.
Apr 14 02:19:43 user nova-compute[71498]: DEBUG nova.compute.manager [req-c7c9aa80-291d-48b8-bfda-38ffbe0befcf req-3bfff320-a0eb-4a82-a2f5-4f13e2565033 service nova] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Received event network-vif-deleted-ac234ca2-fa32-4f28-bcab-47b552c9b02e {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:19:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-513ea079-60fa-4076-b897-ca919016e306 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:19:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-513ea079-60fa-4076-b897-ca919016e306 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:19:43 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-513ea079-60fa-4076-b897-ca919016e306 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:19:43 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-513ea079-60fa-4076-b897-ca919016e306 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:19:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-513ea079-60fa-4076-b897-ca919016e306 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:19:43 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-513ea079-60fa-4076-b897-ca919016e306 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Deleted allocations for instance 5b243a71-802b-40f4-a374-16ecc2bae0f2
Apr 14 02:19:43 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-513ea079-60fa-4076-b897-ca919016e306 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "5b243a71-802b-40f4-a374-16ecc2bae0f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.974s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:19:44 user nova-compute[71498]: DEBUG nova.compute.manager [req-fa389a5a-0234-4234-b69f-62a48f7f9cd5 req-f8e6a92c-ceb7-44d6-9571-35a1ba8ec1ce service nova] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Received event network-vif-plugged-ac234ca2-fa32-4f28-bcab-47b552c9b02e {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:19:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-fa389a5a-0234-4234-b69f-62a48f7f9cd5 req-f8e6a92c-ceb7-44d6-9571-35a1ba8ec1ce service nova] Acquiring lock "5b243a71-802b-40f4-a374-16ecc2bae0f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:19:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-fa389a5a-0234-4234-b69f-62a48f7f9cd5 req-f8e6a92c-ceb7-44d6-9571-35a1ba8ec1ce service nova] Lock "5b243a71-802b-40f4-a374-16ecc2bae0f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:19:44 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-fa389a5a-0234-4234-b69f-62a48f7f9cd5 req-f8e6a92c-ceb7-44d6-9571-35a1ba8ec1ce service nova] Lock "5b243a71-802b-40f4-a374-16ecc2bae0f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:19:44 user nova-compute[71498]: DEBUG nova.compute.manager [req-fa389a5a-0234-4234-b69f-62a48f7f9cd5 req-f8e6a92c-ceb7-44d6-9571-35a1ba8ec1ce service nova] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] No waiting events found dispatching network-vif-plugged-ac234ca2-fa32-4f28-bcab-47b552c9b02e {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:19:44 user nova-compute[71498]: WARNING nova.compute.manager [req-fa389a5a-0234-4234-b69f-62a48f7f9cd5 req-f8e6a92c-ceb7-44d6-9571-35a1ba8ec1ce service nova] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Received unexpected event network-vif-plugged-ac234ca2-fa32-4f28-bcab-47b552c9b02e for instance with vm_state deleted and task_state None.
Apr 14 02:19:47 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:19:52 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:19:57 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681438782.7028291, 5b243a71-802b-40f4-a374-16ecc2bae0f2 => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:19:57 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] VM Stopped (Lifecycle Event)
Apr 14 02:19:57 user nova-compute[71498]: DEBUG nova.compute.manager [None req-3dace958-c1b5-49d4-a24c-a910a35f562e None None] [instance: 5b243a71-802b-40f4-a374-16ecc2bae0f2] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:19:57 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:19:59 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:20:00 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:20:00 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 02:20:00 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Rebuilding the list of instances to heal {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 02:20:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-3f1e74ea-fe8b-4c37-aa30-21f7e17db259" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:20:00 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-3f1e74ea-fe8b-4c37-aa30-21f7e17db259" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:20:00 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 02:20:00 user nova-compute[71498]: DEBUG nova.objects.instance [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lazy-loading 'info_cache' on Instance uuid 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:20:01 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Updating instance_info_cache with network_info: [{"id": "658d7098-ff69-45ed-8875-15a23a6bdb98", "address": "fa:16:3e:3f:d1:37", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap658d7098-ff", "ovs_interfaceid": "658d7098-ff69-45ed-8875-15a23a6bdb98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:20:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-3f1e74ea-fe8b-4c37-aa30-21f7e17db259" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:20:01 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 02:20:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:20:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:20:04 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:20:05 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:20:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:20:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:20:05 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:20:05 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 02:20:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:20:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:20:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:20:05 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:20:06 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:20:06 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:20:06 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=8774MB free_disk=26.136470794677734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 02:20:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:20:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:20:06 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:20:06 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 02:20:06 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 02:20:06 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:20:06 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:20:06 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 02:20:06 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:20:07 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:20:08 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:20:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-13330480-0417-401c-acca-933e92759f88 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:20:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-13330480-0417-401c-acca-933e92759f88 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:20:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-13330480-0417-401c-acca-933e92759f88 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:20:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-13330480-0417-401c-acca-933e92759f88 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:20:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-13330480-0417-401c-acca-933e92759f88 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:20:09 user nova-compute[71498]: INFO nova.compute.manager [None req-13330480-0417-401c-acca-933e92759f88 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Terminating instance
Apr 14 02:20:09 user nova-compute[71498]: DEBUG nova.compute.manager [None req-13330480-0417-401c-acca-933e92759f88 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 02:20:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:20:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:20:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:20:09 user nova-compute[71498]: DEBUG nova.compute.manager [req-69f26b7a-57c1-4d3d-a459-63f163d326f1 req-b7b01840-999f-46cd-9164-a0619c11ab52 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Received event network-vif-unplugged-658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:20:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-69f26b7a-57c1-4d3d-a459-63f163d326f1 req-b7b01840-999f-46cd-9164-a0619c11ab52 service nova] Acquiring lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:20:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-69f26b7a-57c1-4d3d-a459-63f163d326f1 req-b7b01840-999f-46cd-9164-a0619c11ab52 service nova] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:20:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-69f26b7a-57c1-4d3d-a459-63f163d326f1 req-b7b01840-999f-46cd-9164-a0619c11ab52 service nova] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:20:09 user nova-compute[71498]: DEBUG nova.compute.manager [req-69f26b7a-57c1-4d3d-a459-63f163d326f1 req-b7b01840-999f-46cd-9164-a0619c11ab52 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] No waiting events found dispatching network-vif-unplugged-658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:20:09 user nova-compute[71498]: DEBUG nova.compute.manager [req-69f26b7a-57c1-4d3d-a459-63f163d326f1 req-b7b01840-999f-46cd-9164-a0619c11ab52 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Received event network-vif-unplugged-658d7098-ff69-45ed-8875-15a23a6bdb98 for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 02:20:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:20:09 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Instance destroyed successfully.
Apr 14 02:20:09 user nova-compute[71498]: DEBUG nova.objects.instance [None req-13330480-0417-401c-acca-933e92759f88 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lazy-loading 'resources' on Instance uuid 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:20:09 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-13330480-0417-401c-acca-933e92759f88 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:15:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-684753578',display_name='tempest-TestMinimumBasicScenario-server-684753578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-684753578',id=45,image_ref='0f1079ad-d248-4167-b5fd-2792d9e7c59f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/8dDuRjCJcjSWFSlIIQBjaCQYsWY9jcPIgqBXOlo6NSNyeF/zqlrB4m5QH/AVXVYI5JCwYqy+IR/fGoWCXNpPwugqxmAh3nJdTZo0B2P/965Ah2uH7rPja1jX0NXwcFQ==',key_name='tempest-TestMinimumBasicScenario-232131221',keypairs=<?>,launch_index=0,launched_at=2023-04-14T02:15:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20723e8ba2f5480b8c17e6c4fc8fff9f',ramdisk_id='',reservation_id='r-ef0gwdn3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0f1079ad-d248-4167-b5fd-2792d9e7c59f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1976287714',owner_user_name='tempest-TestMinimumBasicScenario-1976287714-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T02:17:31Z,user_data=None,user_id='19633f8d769c4e50b5e6c9a75497b510',uuid=3f1e74ea-fe8b-4c37-aa30-21f7e17db259,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "658d7098-ff69-45ed-8875-15a23a6bdb98", "address": "fa:16:3e:3f:d1:37", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap658d7098-ff", "ovs_interfaceid": "658d7098-ff69-45ed-8875-15a23a6bdb98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 02:20:09 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-13330480-0417-401c-acca-933e92759f88 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Converting VIF {"id": "658d7098-ff69-45ed-8875-15a23a6bdb98", "address": "fa:16:3e:3f:d1:37", "network": {"id": "6a2a0716-97e3-42a7-bdf8-5f5548cf550b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-586729419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20723e8ba2f5480b8c17e6c4fc8fff9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap658d7098-ff", "ovs_interfaceid": "658d7098-ff69-45ed-8875-15a23a6bdb98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:20:09 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-13330480-0417-401c-acca-933e92759f88 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:d1:37,bridge_name='br-int',has_traffic_filtering=True,id=658d7098-ff69-45ed-8875-15a23a6bdb98,network=Network(6a2a0716-97e3-42a7-bdf8-5f5548cf550b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap658d7098-ff') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:20:09 user nova-compute[71498]: DEBUG os_vif [None req-13330480-0417-401c-acca-933e92759f88 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:d1:37,bridge_name='br-int',has_traffic_filtering=True,id=658d7098-ff69-45ed-8875-15a23a6bdb98,network=Network(6a2a0716-97e3-42a7-bdf8-5f5548cf550b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap658d7098-ff') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 02:20:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:20:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap658d7098-ff, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:20:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:20:09 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:20:09 user nova-compute[71498]: INFO os_vif [None req-13330480-0417-401c-acca-933e92759f88 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:d1:37,bridge_name='br-int',has_traffic_filtering=True,id=658d7098-ff69-45ed-8875-15a23a6bdb98,network=Network(6a2a0716-97e3-42a7-bdf8-5f5548cf550b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap658d7098-ff')
Apr 14 02:20:09 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-13330480-0417-401c-acca-933e92759f88 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Deleting instance files /opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259_del
Apr 14 02:20:09 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-13330480-0417-401c-acca-933e92759f88 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Deletion of /opt/stack/data/nova/instances/3f1e74ea-fe8b-4c37-aa30-21f7e17db259_del complete
Apr 14 02:20:10 user nova-compute[71498]: INFO nova.compute.manager [None req-13330480-0417-401c-acca-933e92759f88 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 14 02:20:10 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-13330480-0417-401c-acca-933e92759f88 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 02:20:10 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 02:20:10 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 02:20:10 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:20:10 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Took 0.44 seconds to deallocate network for instance.
Apr 14 02:20:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-13330480-0417-401c-acca-933e92759f88 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:20:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-13330480-0417-401c-acca-933e92759f88 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:20:10 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-13330480-0417-401c-acca-933e92759f88 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:20:10 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-13330480-0417-401c-acca-933e92759f88 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:20:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-13330480-0417-401c-acca-933e92759f88 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.120s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:20:10 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-13330480-0417-401c-acca-933e92759f88 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Deleted allocations for instance 3f1e74ea-fe8b-4c37-aa30-21f7e17db259
Apr 14 02:20:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-13330480-0417-401c-acca-933e92759f88 tempest-TestMinimumBasicScenario-1976287714 tempest-TestMinimumBasicScenario-1976287714-project-member] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.578s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:20:11 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:20:11 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:20:11 user nova-compute[71498]: DEBUG nova.compute.manager [req-97ba9f5c-3bae-4fdc-ab0c-3116c080cd53 req-995af365-87aa-4dff-a7b7-ee0f054a3e26 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Received event network-vif-plugged-658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:20:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-97ba9f5c-3bae-4fdc-ab0c-3116c080cd53 req-995af365-87aa-4dff-a7b7-ee0f054a3e26 service nova] Acquiring lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:20:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-97ba9f5c-3bae-4fdc-ab0c-3116c080cd53 req-995af365-87aa-4dff-a7b7-ee0f054a3e26 service nova] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:20:11 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-97ba9f5c-3bae-4fdc-ab0c-3116c080cd53 req-995af365-87aa-4dff-a7b7-ee0f054a3e26 service nova] Lock "3f1e74ea-fe8b-4c37-aa30-21f7e17db259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:20:11 user nova-compute[71498]: DEBUG nova.compute.manager [req-97ba9f5c-3bae-4fdc-ab0c-3116c080cd53 req-995af365-87aa-4dff-a7b7-ee0f054a3e26 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] No waiting events found dispatching network-vif-plugged-658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:20:11 user nova-compute[71498]: WARNING nova.compute.manager [req-97ba9f5c-3bae-4fdc-ab0c-3116c080cd53 req-995af365-87aa-4dff-a7b7-ee0f054a3e26 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Received unexpected event network-vif-plugged-658d7098-ff69-45ed-8875-15a23a6bdb98 for instance with vm_state deleted and task_state None.
Apr 14 02:20:11 user nova-compute[71498]: DEBUG nova.compute.manager [req-97ba9f5c-3bae-4fdc-ab0c-3116c080cd53 req-995af365-87aa-4dff-a7b7-ee0f054a3e26 service nova] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Received event network-vif-deleted-658d7098-ff69-45ed-8875-15a23a6bdb98 {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:20:14 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:20:16 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:20:16 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:20:16 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 02:20:19 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:20:24 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681438809.9254827, 3f1e74ea-fe8b-4c37-aa30-21f7e17db259 => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:20:24 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] VM Stopped (Lifecycle Event)
Apr 14 02:20:24 user nova-compute[71498]: DEBUG nova.compute.manager [None req-167839a7-69b5-4d61-ae57-5a675005be49 None None] [instance: 3f1e74ea-fe8b-4c37-aa30-21f7e17db259] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:20:24 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:20:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:20:32 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:20:34 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:20:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:20:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:20:36 user nova-compute[71498]: DEBUG nova.compute.manager [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Starting instance... {{(pid=71498) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 02:20:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:20:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:20:36 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71498) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 02:20:36 user nova-compute[71498]: INFO nova.compute.claims [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Claim successful on node user
Apr 14 02:20:36 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:20:36 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:20:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.180s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:20:36 user nova-compute[71498]: DEBUG nova.compute.manager [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Start building networks asynchronously for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 02:20:36 user nova-compute[71498]: DEBUG nova.compute.manager [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Allocating IP information in the background. {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 02:20:36 user nova-compute[71498]: DEBUG nova.network.neutron [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] allocate_for_instance() {{(pid=71498) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 02:20:36 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 02:20:36 user nova-compute[71498]: DEBUG nova.compute.manager [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Start building block device mappings for instance. {{(pid=71498) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 02:20:36 user nova-compute[71498]: DEBUG nova.policy [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '168a0142cf984aacb1f087adcaa96468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcde6e918d64d70b69d2d81e1bdbe79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71498) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 02:20:36 user nova-compute[71498]: DEBUG nova.compute.manager [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Start spawning the instance on the hypervisor. {{(pid=71498) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 02:20:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Creating instance directory {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 02:20:36 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Creating image(s)
Apr 14 02:20:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:20:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "/opt/stack/data/nova/instances/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:20:36 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "/opt/stack/data/nova/instances/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:20:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:20:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.127s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:20:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "333810887cb0690cf24573eea678c5eae35f73ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:20:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:20:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:20:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.130s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:20:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/disk 1073741824 {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:20:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab,backing_fmt=raw /opt/stack/data/nova/instances/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/disk 1073741824" returned: 0 in 0.057s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:20:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "333810887cb0690cf24573eea678c5eae35f73ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:20:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:20:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/333810887cb0690cf24573eea678c5eae35f73ab --force-share --output=json" returned: 0 in 0.131s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:20:37 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/disk. size=1073741824 {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 02:20:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:20:37 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:20:37 user nova-compute[71498]: DEBUG nova.virt.disk.api [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Cannot resize image /opt/stack/data/nova/instances/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/disk to a smaller size. {{(pid=71498) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 02:20:37 user nova-compute[71498]: DEBUG nova.objects.instance [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lazy-loading 'migration_context' on Instance uuid ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:20:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Created local disks {{(pid=71498) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 02:20:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Ensure instance console log exists: /opt/stack/data/nova/instances/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/console.log {{(pid=71498) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 02:20:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:20:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:20:37 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:20:37 user nova-compute[71498]: DEBUG nova.network.neutron [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Successfully created port: 08d38961-6fe0-4d59-b9a3-c9cd6aa4090d {{(pid=71498) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG nova.network.neutron [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Successfully updated port: 08d38961-6fe0-4d59-b9a3-c9cd6aa4090d {{(pid=71498) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "refresh_cache-ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquired lock "refresh_cache-ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG nova.network.neutron [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Building network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG nova.compute.manager [req-bbe1a869-f770-491d-a405-0aba10f2cef5 req-de3bcaa3-b044-4ca0-8b2b-ceb342290a35 service nova] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Received event network-changed-08d38961-6fe0-4d59-b9a3-c9cd6aa4090d {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG nova.compute.manager [req-bbe1a869-f770-491d-a405-0aba10f2cef5 req-de3bcaa3-b044-4ca0-8b2b-ceb342290a35 service nova] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Refreshing instance network info cache due to event network-changed-08d38961-6fe0-4d59-b9a3-c9cd6aa4090d. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-bbe1a869-f770-491d-a405-0aba10f2cef5 req-de3bcaa3-b044-4ca0-8b2b-ceb342290a35 service nova] Acquiring lock "refresh_cache-ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG nova.network.neutron [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Instance cache missing network info. {{(pid=71498) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG nova.network.neutron [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Updating instance_info_cache with network_info: [{"id": "08d38961-6fe0-4d59-b9a3-c9cd6aa4090d", "address": "fa:16:3e:a3:50:a6", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d38961-6f", "ovs_interfaceid": "08d38961-6fe0-4d59-b9a3-c9cd6aa4090d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Releasing lock "refresh_cache-ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG nova.compute.manager [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Instance network_info: |[{"id": "08d38961-6fe0-4d59-b9a3-c9cd6aa4090d", "address": "fa:16:3e:a3:50:a6", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d38961-6f", "ovs_interfaceid": "08d38961-6fe0-4d59-b9a3-c9cd6aa4090d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71498) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-bbe1a869-f770-491d-a405-0aba10f2cef5 req-de3bcaa3-b044-4ca0-8b2b-ceb342290a35 service nova] Acquired lock "refresh_cache-ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG nova.network.neutron [req-bbe1a869-f770-491d-a405-0aba10f2cef5 req-de3bcaa3-b044-4ca0-8b2b-ceb342290a35 service nova] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Refreshing network info cache for port 08d38961-6fe0-4d59-b9a3-c9cd6aa4090d {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Start _get_guest_xml network_info=[{"id": "08d38961-6fe0-4d59-b9a3-c9cd6aa4090d", "address": "fa:16:3e:a3:50:a6", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d38961-6f", "ovs_interfaceid": "08d38961-6fe0-4d59-b9a3-c9cd6aa4090d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'guest_format': None, 'boot_index': 0, 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'b1bc26f9-63fb-4bff-8f72-f1e49544441d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 02:20:38 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:20:38 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:20:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71498) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T01:38:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T01:36:55Z,direct_url=<?>,disk_format='qcow2',id=b1bc26f9-63fb-4bff-8f72-f1e49544441d,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='3663dea83d234eeca8dc09f5d706a616',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T01:36:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Flavor limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Image limits 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Flavor pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Image pref 0:0:0 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Got 1 possible topologies {{(pid=71498) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG nova.virt.hardware [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71498) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:20:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-88389981',display_name='tempest-AttachVolumeNegativeTest-server-88389981',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-88389981',id=47,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPLfE1rE74YlC3HVCnY5X9V9ZRoJtteTcjHTuXtxQMXJGMfgwDqGgobT1jivwoFE8bcp3Yn7U5hUHqV4pZkavYxjmoni61h+szpfB3XYIKH4/0TcePqZHK+VUovC8PPgA==',key_name='tempest-keypair-1626924443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0dcde6e918d64d70b69d2d81e1bdbe79',ramdisk_id='',reservation_id='r-auh8ztvc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1854704348',owner_user_name='tempest-AttachVolumeNegativeTest-1854704348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T02:20:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='168a0142cf984aacb1f087adcaa96468',uuid=ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08d38961-6fe0-4d59-b9a3-c9cd6aa4090d", "address": "fa:16:3e:a3:50:a6", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d38961-6f", "ovs_interfaceid": "08d38961-6fe0-4d59-b9a3-c9cd6aa4090d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71498) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Converting VIF {"id": "08d38961-6fe0-4d59-b9a3-c9cd6aa4090d", "address": "fa:16:3e:a3:50:a6", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d38961-6f", "ovs_interfaceid": "08d38961-6fe0-4d59-b9a3-c9cd6aa4090d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:50:a6,bridge_name='br-int',has_traffic_filtering=True,id=08d38961-6fe0-4d59-b9a3-c9cd6aa4090d,network=Network(981c880a-2147-4da6-8021-a03d0aee3f3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d38961-6f') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG nova.objects.instance [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lazy-loading 'pci_devices' on Instance uuid ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] End _get_guest_xml xml=<domain type="kvm">
Apr 14 02:20:38 user nova-compute[71498]:   <uuid>ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f</uuid>
Apr 14 02:20:38 user nova-compute[71498]:   <name>instance-0000002f</name>
Apr 14 02:20:38 user nova-compute[71498]:   <memory>131072</memory>
Apr 14 02:20:38 user nova-compute[71498]:   <vcpu>1</vcpu>
Apr 14 02:20:38 user nova-compute[71498]:   <metadata>
Apr 14 02:20:38 user nova-compute[71498]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 02:20:38 user nova-compute[71498]:       <nova:package version="0.0.0"/>
Apr 14 02:20:38 user nova-compute[71498]:       <nova:name>tempest-AttachVolumeNegativeTest-server-88389981</nova:name>
Apr 14 02:20:38 user nova-compute[71498]:       <nova:creationTime>2023-04-14 02:20:38</nova:creationTime>
Apr 14 02:20:38 user nova-compute[71498]:       <nova:flavor name="m1.nano">
Apr 14 02:20:38 user nova-compute[71498]:         <nova:memory>128</nova:memory>
Apr 14 02:20:38 user nova-compute[71498]:         <nova:disk>1</nova:disk>
Apr 14 02:20:38 user nova-compute[71498]:         <nova:swap>0</nova:swap>
Apr 14 02:20:38 user nova-compute[71498]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 02:20:38 user nova-compute[71498]:         <nova:vcpus>1</nova:vcpus>
Apr 14 02:20:38 user nova-compute[71498]:       </nova:flavor>
Apr 14 02:20:38 user nova-compute[71498]:       <nova:owner>
Apr 14 02:20:38 user nova-compute[71498]:         <nova:user uuid="168a0142cf984aacb1f087adcaa96468">tempest-AttachVolumeNegativeTest-1854704348-project-member</nova:user>
Apr 14 02:20:38 user nova-compute[71498]:         <nova:project uuid="0dcde6e918d64d70b69d2d81e1bdbe79">tempest-AttachVolumeNegativeTest-1854704348</nova:project>
Apr 14 02:20:38 user nova-compute[71498]:       </nova:owner>
Apr 14 02:20:38 user nova-compute[71498]:       <nova:root type="image" uuid="b1bc26f9-63fb-4bff-8f72-f1e49544441d"/>
Apr 14 02:20:38 user nova-compute[71498]:       <nova:ports>
Apr 14 02:20:38 user nova-compute[71498]:         <nova:port uuid="08d38961-6fe0-4d59-b9a3-c9cd6aa4090d">
Apr 14 02:20:38 user nova-compute[71498]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 02:20:38 user nova-compute[71498]:         </nova:port>
Apr 14 02:20:38 user nova-compute[71498]:       </nova:ports>
Apr 14 02:20:38 user nova-compute[71498]:     </nova:instance>
Apr 14 02:20:38 user nova-compute[71498]:   </metadata>
Apr 14 02:20:38 user nova-compute[71498]:   <sysinfo type="smbios">
Apr 14 02:20:38 user nova-compute[71498]:     <system>
Apr 14 02:20:38 user nova-compute[71498]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 02:20:38 user nova-compute[71498]:       <entry name="product">OpenStack Nova</entry>
Apr 14 02:20:38 user nova-compute[71498]:       <entry name="version">0.0.0</entry>
Apr 14 02:20:38 user nova-compute[71498]:       <entry name="serial">ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f</entry>
Apr 14 02:20:38 user nova-compute[71498]:       <entry name="uuid">ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f</entry>
Apr 14 02:20:38 user nova-compute[71498]:       <entry name="family">Virtual Machine</entry>
Apr 14 02:20:38 user nova-compute[71498]:     </system>
Apr 14 02:20:38 user nova-compute[71498]:   </sysinfo>
Apr 14 02:20:38 user nova-compute[71498]:   <os>
Apr 14 02:20:38 user nova-compute[71498]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 02:20:38 user nova-compute[71498]:     <boot dev="hd"/>
Apr 14 02:20:38 user nova-compute[71498]:     <smbios mode="sysinfo"/>
Apr 14 02:20:38 user nova-compute[71498]:   </os>
Apr 14 02:20:38 user nova-compute[71498]:   <features>
Apr 14 02:20:38 user nova-compute[71498]:     <acpi/>
Apr 14 02:20:38 user nova-compute[71498]:     <apic/>
Apr 14 02:20:38 user nova-compute[71498]:     <vmcoreinfo/>
Apr 14 02:20:38 user nova-compute[71498]:   </features>
Apr 14 02:20:38 user nova-compute[71498]:   <clock offset="utc">
Apr 14 02:20:38 user nova-compute[71498]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 02:20:38 user nova-compute[71498]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 02:20:38 user nova-compute[71498]:     <timer name="hpet" present="no"/>
Apr 14 02:20:38 user nova-compute[71498]:   </clock>
Apr 14 02:20:38 user nova-compute[71498]:   <cpu mode="custom" match="exact">
Apr 14 02:20:38 user nova-compute[71498]:     <model>Nehalem</model>
Apr 14 02:20:38 user nova-compute[71498]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 02:20:38 user nova-compute[71498]:   </cpu>
Apr 14 02:20:38 user nova-compute[71498]:   <devices>
Apr 14 02:20:38 user nova-compute[71498]:     <disk type="file" device="disk">
Apr 14 02:20:38 user nova-compute[71498]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 02:20:38 user nova-compute[71498]:       <source file="/opt/stack/data/nova/instances/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/disk"/>
Apr 14 02:20:38 user nova-compute[71498]:       <target dev="vda" bus="virtio"/>
Apr 14 02:20:38 user nova-compute[71498]:     </disk>
Apr 14 02:20:38 user nova-compute[71498]:     <interface type="ethernet">
Apr 14 02:20:38 user nova-compute[71498]:       <mac address="fa:16:3e:a3:50:a6"/>
Apr 14 02:20:38 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 02:20:38 user nova-compute[71498]:       <mtu size="1442"/>
Apr 14 02:20:38 user nova-compute[71498]:       <target dev="tap08d38961-6f"/>
Apr 14 02:20:38 user nova-compute[71498]:     </interface>
Apr 14 02:20:38 user nova-compute[71498]:     <serial type="pty">
Apr 14 02:20:38 user nova-compute[71498]:       <log file="/opt/stack/data/nova/instances/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/console.log" append="off"/>
Apr 14 02:20:38 user nova-compute[71498]:     </serial>
Apr 14 02:20:38 user nova-compute[71498]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 02:20:38 user nova-compute[71498]:     <video>
Apr 14 02:20:38 user nova-compute[71498]:       <model type="virtio"/>
Apr 14 02:20:38 user nova-compute[71498]:     </video>
Apr 14 02:20:38 user nova-compute[71498]:     <rng model="virtio">
Apr 14 02:20:38 user nova-compute[71498]:       <backend model="random">/dev/urandom</backend>
Apr 14 02:20:38 user nova-compute[71498]:     </rng>
Apr 14 02:20:38 user nova-compute[71498]:     <controller type="usb" index="0" model="none"/>
Apr 14 02:20:38 user nova-compute[71498]:     <memballoon model="virtio">
Apr 14 02:20:38 user nova-compute[71498]:       <stats period="10"/>
Apr 14 02:20:38 user nova-compute[71498]:     </memballoon>
Apr 14 02:20:38 user nova-compute[71498]:   </devices>
Apr 14 02:20:38 user nova-compute[71498]: </domain>
Apr 14 02:20:38 user nova-compute[71498]:  {{(pid=71498) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:20:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-88389981',display_name='tempest-AttachVolumeNegativeTest-server-88389981',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-88389981',id=47,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPLfE1rE74YlC3HVCnY5X9V9ZRoJtteTcjHTuXtxQMXJGMfgwDqGgobT1jivwoFE8bcp3Yn7U5hUHqV4pZkavYxjmoni61h+szpfB3XYIKH4/0TcePqZHK+VUovC8PPgA==',key_name='tempest-keypair-1626924443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0dcde6e918d64d70b69d2d81e1bdbe79',ramdisk_id='',reservation_id='r-auh8ztvc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1854704348',owner_user_name='tempest-AttachVolumeNegativeTest-1854704348-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T02:20:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='168a0142cf984aacb1f087adcaa96468',uuid=ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08d38961-6fe0-4d59-b9a3-c9cd6aa4090d", "address": "fa:16:3e:a3:50:a6", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d38961-6f", "ovs_interfaceid": "08d38961-6fe0-4d59-b9a3-c9cd6aa4090d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Converting VIF {"id": "08d38961-6fe0-4d59-b9a3-c9cd6aa4090d", "address": "fa:16:3e:a3:50:a6", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d38961-6f", "ovs_interfaceid": "08d38961-6fe0-4d59-b9a3-c9cd6aa4090d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:50:a6,bridge_name='br-int',has_traffic_filtering=True,id=08d38961-6fe0-4d59-b9a3-c9cd6aa4090d,network=Network(981c880a-2147-4da6-8021-a03d0aee3f3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d38961-6f') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG os_vif [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:50:a6,bridge_name='br-int',has_traffic_filtering=True,id=08d38961-6fe0-4d59-b9a3-c9cd6aa4090d,network=Network(981c880a-2147-4da6-8021-a03d0aee3f3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d38961-6f') {{(pid=71498) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08d38961-6f, may_exist=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap08d38961-6f, col_values=(('external_ids', {'iface-id': '08d38961-6fe0-4d59-b9a3-c9cd6aa4090d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:50:a6', 'vm-uuid': 'ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f'}),)) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:20:38 user nova-compute[71498]: INFO os_vif [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:50:a6,bridge_name='br-int',has_traffic_filtering=True,id=08d38961-6fe0-4d59-b9a3-c9cd6aa4090d,network=Network(981c880a-2147-4da6-8021-a03d0aee3f3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d38961-6f')
Apr 14 02:20:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:20:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] No VIF found with MAC fa:16:3e:a3:50:a6, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 02:20:39 user nova-compute[71498]: DEBUG nova.network.neutron [req-bbe1a869-f770-491d-a405-0aba10f2cef5 req-de3bcaa3-b044-4ca0-8b2b-ceb342290a35 service nova] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Updated VIF entry in instance network info cache for port 08d38961-6fe0-4d59-b9a3-c9cd6aa4090d. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 02:20:39 user nova-compute[71498]: DEBUG nova.network.neutron [req-bbe1a869-f770-491d-a405-0aba10f2cef5 req-de3bcaa3-b044-4ca0-8b2b-ceb342290a35 service nova] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Updating instance_info_cache with network_info: [{"id": "08d38961-6fe0-4d59-b9a3-c9cd6aa4090d", "address": "fa:16:3e:a3:50:a6", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d38961-6f", "ovs_interfaceid": "08d38961-6fe0-4d59-b9a3-c9cd6aa4090d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:20:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-bbe1a869-f770-491d-a405-0aba10f2cef5 req-de3bcaa3-b044-4ca0-8b2b-ceb342290a35 service nova] Releasing lock "refresh_cache-ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:20:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:20:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:20:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:20:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:20:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-10296c0a-e9f9-4ed1-be31-c3f809317671 req-895e11ca-0a06-419e-9b87-f31cbcde2226 service nova] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Received event network-vif-plugged-08d38961-6fe0-4d59-b9a3-c9cd6aa4090d {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:20:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-10296c0a-e9f9-4ed1-be31-c3f809317671 req-895e11ca-0a06-419e-9b87-f31cbcde2226 service nova] Acquiring lock "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:20:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-10296c0a-e9f9-4ed1-be31-c3f809317671 req-895e11ca-0a06-419e-9b87-f31cbcde2226 service nova] Lock "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:20:40 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-10296c0a-e9f9-4ed1-be31-c3f809317671 req-895e11ca-0a06-419e-9b87-f31cbcde2226 service nova] Lock "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:20:40 user nova-compute[71498]: DEBUG nova.compute.manager [req-10296c0a-e9f9-4ed1-be31-c3f809317671 req-895e11ca-0a06-419e-9b87-f31cbcde2226 service nova] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] No waiting events found dispatching network-vif-plugged-08d38961-6fe0-4d59-b9a3-c9cd6aa4090d {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:20:40 user nova-compute[71498]: WARNING nova.compute.manager [req-10296c0a-e9f9-4ed1-be31-c3f809317671 req-895e11ca-0a06-419e-9b87-f31cbcde2226 service nova] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Received unexpected event network-vif-plugged-08d38961-6fe0-4d59-b9a3-c9cd6aa4090d for instance with vm_state building and task_state spawning.
Apr 14 02:20:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:20:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:20:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:20:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:20:42 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681438842.1944838, ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f => Resumed> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:20:42 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] VM Resumed (Lifecycle Event)
Apr 14 02:20:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Instance event wait completed in 0 seconds for  {{(pid=71498) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 02:20:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Guest created on hypervisor {{(pid=71498) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 02:20:42 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Instance spawned successfully.
Apr 14 02:20:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 02:20:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:20:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 02:20:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Found default for hw_cdrom_bus of ide {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:20:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Found default for hw_disk_bus of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:20:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Found default for hw_input_bus of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:20:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Found default for hw_pointer_model of None {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:20:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Found default for hw_video_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:20:42 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Found default for hw_vif_model of virtio {{(pid=71498) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 02:20:42 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 02:20:42 user nova-compute[71498]: DEBUG nova.virt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Emitting event <LifecycleEvent: 1681438842.1962495, ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f => Started> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:20:42 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] VM Started (Lifecycle Event)
Apr 14 02:20:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:20:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71498) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 02:20:42 user nova-compute[71498]: INFO nova.compute.manager [None req-d0170308-0176-429c-b298-160fda25d12f None None] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 02:20:42 user nova-compute[71498]: INFO nova.compute.manager [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Took 5.34 seconds to spawn the instance on the hypervisor.
Apr 14 02:20:42 user nova-compute[71498]: DEBUG nova.compute.manager [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:20:42 user nova-compute[71498]: INFO nova.compute.manager [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Took 5.83 seconds to build instance.
Apr 14 02:20:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-92d93d19-8a18-4695-bd7e-465fc9410ed9 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.932s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:20:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-cd10efd6-cb31-4b65-8426-cfbdd60a30dc req-c260ff35-e5ec-4a21-a857-149de8697d7e service nova] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Received event network-vif-plugged-08d38961-6fe0-4d59-b9a3-c9cd6aa4090d {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:20:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-cd10efd6-cb31-4b65-8426-cfbdd60a30dc req-c260ff35-e5ec-4a21-a857-149de8697d7e service nova] Acquiring lock "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:20:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-cd10efd6-cb31-4b65-8426-cfbdd60a30dc req-c260ff35-e5ec-4a21-a857-149de8697d7e service nova] Lock "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:20:42 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-cd10efd6-cb31-4b65-8426-cfbdd60a30dc req-c260ff35-e5ec-4a21-a857-149de8697d7e service nova] Lock "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:20:42 user nova-compute[71498]: DEBUG nova.compute.manager [req-cd10efd6-cb31-4b65-8426-cfbdd60a30dc req-c260ff35-e5ec-4a21-a857-149de8697d7e service nova] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] No waiting events found dispatching network-vif-plugged-08d38961-6fe0-4d59-b9a3-c9cd6aa4090d {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:20:42 user nova-compute[71498]: WARNING nova.compute.manager [req-cd10efd6-cb31-4b65-8426-cfbdd60a30dc req-c260ff35-e5ec-4a21-a857-149de8697d7e service nova] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Received unexpected event network-vif-plugged-08d38961-6fe0-4d59-b9a3-c9cd6aa4090d for instance with vm_state active and task_state None.
Apr 14 02:20:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:20:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:20:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:20:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:20:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:20:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:20:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:20:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:20:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:20:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:20:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:20:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:20:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:20:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:20:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:20:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:21:00 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:21:01 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:21:01 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 02:21:01 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Rebuilding the list of instances to heal {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 02:21:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:21:01 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:21:01 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 02:21:01 user nova-compute[71498]: DEBUG nova.objects.instance [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lazy-loading 'info_cache' on Instance uuid ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:21:02 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:21:02 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Updating instance_info_cache with network_info: [{"id": "08d38961-6fe0-4d59-b9a3-c9cd6aa4090d", "address": "fa:16:3e:a3:50:a6", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d38961-6f", "ovs_interfaceid": "08d38961-6fe0-4d59-b9a3-c9cd6aa4090d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:21:02 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:21:02 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 02:21:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:21:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:21:05 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:21:05 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:21:07 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:21:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:21:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:21:07 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:21:07 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 02:21:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:21:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:21:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:21:07 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:21:08 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:21:08 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:21:08 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=8857MB free_disk=26.164520263671875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 02:21:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:21:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:21:08 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:21:08 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 02:21:08 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 02:21:08 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:21:08 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:21:08 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 02:21:08 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:21:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:21:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:21:10 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:21:12 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:21:12 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:21:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:21:14 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:21:16 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:21:16 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 02:21:17 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:21:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:21:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:21:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:21:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:21:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:21:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:21:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:21:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:21:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:21:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:21:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:21:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:21:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:21:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:21:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:21:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:21:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:21:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:21:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:21:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:21:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:21:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:21:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:21:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:21:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:21:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:21:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:21:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:21:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:21:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:21:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:22:01 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:22:03 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:22:03 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 02:22:03 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Rebuilding the list of instances to heal {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 02:22:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:22:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:22:03 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 02:22:03 user nova-compute[71498]: DEBUG nova.objects.instance [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lazy-loading 'info_cache' on Instance uuid ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:22:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:22:03 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Updating instance_info_cache with network_info: [{"id": "08d38961-6fe0-4d59-b9a3-c9cd6aa4090d", "address": "fa:16:3e:a3:50:a6", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d38961-6f", "ovs_interfaceid": "08d38961-6fe0-4d59-b9a3-c9cd6aa4090d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:22:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:22:03 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 02:22:05 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:22:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:22:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:22:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:22:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:22:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:22:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:22:09 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:22:09 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:22:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:22:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:22:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:22:09 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 02:22:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:22:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:22:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:22:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:22:10 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:22:10 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:22:10 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=8868MB free_disk=26.163909912109375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 02:22:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:22:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:22:10 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:22:10 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 02:22:10 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 02:22:10 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:22:10 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:22:10 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 02:22:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:22:13 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:22:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:22:14 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:22:14 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:22:14 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Cleaning up deleted instances {{(pid=71498) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 02:22:14 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] There are 0 instances to clean {{(pid=71498) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 02:22:17 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:22:18 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:22:18 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 02:22:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:22:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:22:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:22:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:22:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:22:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:22:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:22:25 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:22:25 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Cleaning up deleted instances with incomplete migration  {{(pid=71498) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 02:22:27 user nova-compute[71498]: DEBUG nova.compute.manager [req-b9475a91-06bd-46e8-b6a9-e0ec8aebe961 req-671b65ea-d1c1-4f65-87a1-43563f5911a1 service nova] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Received event network-changed-08d38961-6fe0-4d59-b9a3-c9cd6aa4090d {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:22:27 user nova-compute[71498]: DEBUG nova.compute.manager [req-b9475a91-06bd-46e8-b6a9-e0ec8aebe961 req-671b65ea-d1c1-4f65-87a1-43563f5911a1 service nova] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Refreshing instance network info cache due to event network-changed-08d38961-6fe0-4d59-b9a3-c9cd6aa4090d. {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 02:22:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b9475a91-06bd-46e8-b6a9-e0ec8aebe961 req-671b65ea-d1c1-4f65-87a1-43563f5911a1 service nova] Acquiring lock "refresh_cache-ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:22:27 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b9475a91-06bd-46e8-b6a9-e0ec8aebe961 req-671b65ea-d1c1-4f65-87a1-43563f5911a1 service nova] Acquired lock "refresh_cache-ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:22:27 user nova-compute[71498]: DEBUG nova.network.neutron [req-b9475a91-06bd-46e8-b6a9-e0ec8aebe961 req-671b65ea-d1c1-4f65-87a1-43563f5911a1 service nova] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Refreshing network info cache for port 08d38961-6fe0-4d59-b9a3-c9cd6aa4090d {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 02:22:28 user nova-compute[71498]: DEBUG nova.network.neutron [req-b9475a91-06bd-46e8-b6a9-e0ec8aebe961 req-671b65ea-d1c1-4f65-87a1-43563f5911a1 service nova] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Updated VIF entry in instance network info cache for port 08d38961-6fe0-4d59-b9a3-c9cd6aa4090d. {{(pid=71498) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 02:22:28 user nova-compute[71498]: DEBUG nova.network.neutron [req-b9475a91-06bd-46e8-b6a9-e0ec8aebe961 req-671b65ea-d1c1-4f65-87a1-43563f5911a1 service nova] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Updating instance_info_cache with network_info: [{"id": "08d38961-6fe0-4d59-b9a3-c9cd6aa4090d", "address": "fa:16:3e:a3:50:a6", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d38961-6f", "ovs_interfaceid": "08d38961-6fe0-4d59-b9a3-c9cd6aa4090d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:22:28 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b9475a91-06bd-46e8-b6a9-e0ec8aebe961 req-671b65ea-d1c1-4f65-87a1-43563f5911a1 service nova] Releasing lock "refresh_cache-ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:22:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4993-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:22:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:22:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:22:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:22:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:22:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:22:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:22:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:22:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:22:31 user nova-compute[71498]: DEBUG nova.objects.instance [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lazy-loading 'flavor' on Instance uuid ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:22:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:22:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:22:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:22:31 user nova-compute[71498]: INFO nova.compute.manager [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Attaching volume 24bbdf6a-5311-490b-bece-4364727d75d9 to /dev/vdb
Apr 14 02:22:31 user nova-compute[71498]: DEBUG os_brick.utils [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:22:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:22:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:22:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc4c971-a01d-468f-b59e-b1e651810c73]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:123e743e6113\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:22:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:22:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:22:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca312689-c47b-4030-a569-1bea8b97bf50]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:22:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:22:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:22:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c6c2ba-9c07-4d96-bc59-52b3a02e529f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:22:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4aa4db7-04a8-4fee-a907-53987844cd55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:22:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Running cmd (subprocess): nvme version {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:22:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] 'nvme version' failed. Not Retrying. {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 02:22:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] nvme not present on system {{(pid=71498) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 02:22:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:22:31 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 02:22:31 user nova-compute[71498]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 02:22:31 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b50d8f-3a06-4583-8a14-202c83a923cb]: (4, '') {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:22:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71498) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 02:22:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 02:22:31 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.lightos [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] LIGHTOS: no hostnqn found. {{(pid=71498) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 02:22:31 user nova-compute[71498]: DEBUG os_brick.utils [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:123e743e6113', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:22:31 user nova-compute[71498]: DEBUG nova.virt.block_device [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Updating existing volume attachment record: e5d8397d-ee20-4bfa-9761-c8d107a2f60e {{(pid=71498) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 02:22:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:22:33 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Calling os-brick to attach iSCSI Volume {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sxZeHApK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:22:36 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:22:36 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:22:36 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:22:36 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:22:36 user nova-compute[71498]: INFO os_brick.initiator.connectors.iscsi [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 02:22:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 -p 172.16.0.220:3260 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe30850-23c9-47f7-acb7-49b13229e6b8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 02:22:36 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 -p 172.16.0.220:3260 --interface default --op new {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[988aa01b-ecbb-42bf-b69c-aae8d81ff88b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9] added\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9] added
Apr 14 02:22:36 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13ae237-45bb-495a-8ec2-64ea7910f732]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b849b0c-45cb-4107-9013-3107ffdd2cec]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sxZeHApK {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sxZeHApK" returned: 0 in 0.055s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27ccfcc-f0fd-497d-be5d-580fc600717b]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sxZeHApK'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0d78bf-0dd1-4f2d-b519-db6b1ec883ef]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f79dc3-4745-4478-baf1-d0dc7df389e0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 02:22:36 user nova-compute[71498]:  {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 02:22:36 user nova-compute[71498]:  {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:22:36 user nova-compute[71498]: WARNING os_brick.initiator.connectors.iscsi [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 02:22:36 user nova-compute[71498]: 
Apr 14 02:22:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 -p 172.16.0.220:3260 --login {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de6d577-ef71-4e98-a447-74a3f8816b7a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9, portal: 172.16.0.220,3260]
Apr 14 02:22:36 user nova-compute[71498]: Login to [iface: default, target: iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9, portal: 172.16.0.220,3260] successful.
Apr 14 02:22:36 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c8f33d-3d9d-43fd-bbed-ad5dfe95cb29]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3191d0-8805-4f5f-952d-9308c254dda8]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 (non-flash)
Apr 14 02:22:36 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 (non-flash)
Apr 14 02:22:36 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Connected to 172.16.0.220:3260 {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=71498) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71498) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14248a9-4d41-4a7c-8bf3-6a17a13821c0]: (4, ('- - 0', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71498) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 02:22:36 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sxZeHApK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71498) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 02:22:37 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:22:37 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23735343563323133', 'path': '/dev/sdb'} {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:22:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735343563323133', 'path': '/dev/sdb'} {{(pid=71498) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 02:22:37 user nova-compute[71498]: DEBUG nova.objects.instance [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lazy-loading 'flavor' on Instance uuid ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:22:37 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 02:22:37 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:22:37 user nova-compute[71498]:   <source dev="/dev/sdb"/>
Apr 14 02:22:37 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 02:22:37 user nova-compute[71498]:   <serial>24bbdf6a-5311-490b-bece-4364727d75d9</serial>
Apr 14 02:22:37 user nova-compute[71498]: </disk>
Apr 14 02:22:37 user nova-compute[71498]:  {{(pid=71498) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 02:22:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] No BDM found with device name vda, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:22:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71498) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 02:22:38 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] No VIF found with MAC fa:16:3e:a3:50:a6, not building metadata {{(pid=71498) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 02:22:38 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d49506f7-fb2f-4a4f-acda-ef21e87fb89a tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.775s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:22:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:22:38 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:22:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:22:39 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:22:39 user nova-compute[71498]: INFO nova.compute.manager [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Detaching volume 24bbdf6a-5311-490b-bece-4364727d75d9
Apr 14 02:22:39 user nova-compute[71498]: INFO nova.virt.block_device [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Attempting to driver detach volume 24bbdf6a-5311-490b-bece-4364727d75d9 from mountpoint /dev/vdb
Apr 14 02:22:39 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Attempting to detach device vdb from instance ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f from the persistent domain config. {{(pid=71498) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 02:22:39 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 02:22:39 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:22:39 user nova-compute[71498]:   <source dev="/dev/sdb"/>
Apr 14 02:22:39 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 02:22:39 user nova-compute[71498]:   <serial>24bbdf6a-5311-490b-bece-4364727d75d9</serial>
Apr 14 02:22:39 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 02:22:39 user nova-compute[71498]: </disk>
Apr 14 02:22:39 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 02:22:39 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Successfully detached device vdb from instance ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f from the persistent domain config.
Apr 14 02:22:39 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f from the live domain config. {{(pid=71498) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 02:22:39 user nova-compute[71498]: DEBUG nova.virt.libvirt.guest [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 02:22:39 user nova-compute[71498]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 02:22:39 user nova-compute[71498]:   <source dev="/dev/sdb"/>
Apr 14 02:22:39 user nova-compute[71498]:   <target dev="vdb" bus="virtio"/>
Apr 14 02:22:39 user nova-compute[71498]:   <serial>24bbdf6a-5311-490b-bece-4364727d75d9</serial>
Apr 14 02:22:39 user nova-compute[71498]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 02:22:39 user nova-compute[71498]: </disk>
Apr 14 02:22:39 user nova-compute[71498]:  {{(pid=71498) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 02:22:39 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-d0170308-0176-429c-b298-160fda25d12f None None] Received event <DeviceRemovedEvent: 1681438959.9248855, ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71498) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 02:22:39 user nova-compute[71498]: DEBUG nova.virt.libvirt.driver [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f {{(pid=71498) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 02:22:39 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Successfully detached device vdb from instance ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f from the live domain config.
Apr 14 02:22:39 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] calling os-brick to detach iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 02:22:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51f4114f40>, {'target_iqn': 'iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sxZeHApK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 02:22:39 user nova-compute[71498]: WARNING os_brick.initiator.connectors.base [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 02:22:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 02:22:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 02:22:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:22:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:22:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e79da91-806c-476a-a65f-98cbb6e66906]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:22:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 02:22:39 user nova-compute[71498]: No targets found.
Apr 14 02:22:39 user nova-compute[71498]: iSNS:
Apr 14 02:22:39 user nova-compute[71498]: No targets found.
Apr 14 02:22:39 user nova-compute[71498]: STATIC:
Apr 14 02:22:39 user nova-compute[71498]: Target: iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9
Apr 14 02:22:39 user nova-compute[71498]:         Portal: 172.16.0.220:3260,-1
Apr 14 02:22:39 user nova-compute[71498]:                 Iface Name: default
Apr 14 02:22:39 user nova-compute[71498]: FIRMWARE:
Apr 14 02:22:39 user nova-compute[71498]: No targets found.
Apr 14 02:22:39 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:22:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 02:22:39 user nova-compute[71498]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 02:22:39 user nova-compute[71498]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71498) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 02:22:39 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9', 0)] {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 02:22:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:22:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:22:39 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc0df97-2d73-4e96-a0b9-9e6eb6da86ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:22:39 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb2ba77-7bb3-4cb3-9f11-3a5b183e7ba1]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 (non-flash)\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 (non-flash)
Apr 14 02:22:40 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 (non-flash)
Apr 14 02:22:40 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51c46a2f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9'): ({'sdb'}, set())}) {{(pid=71498) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Removing single pathed devices sdb {{(pid=71498) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6779e579-5acc-457d-9354-a1ebd98a80b2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[841085c6-5e63-43d9-80ee-8aab47d62d20]: (4, ('ok\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Flushing IO for device /dev/sdb {{(pid=71498) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[700553cf-974e-4b1b-bfe2-0bd49a530fbd]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71498) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f721e7ab-0fb7-4b11-9352-1403a579a90f]: (4, ('1', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG os_brick.initiator.linuxscsi [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] SCSI volumes sdb have been removed. {{(pid=71498) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9')] {{(pid=71498) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a62301b-63ed-4e63-a5f2-b0ef076837f8]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 -p 172.16.0.220:3260 --logout {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db1e491-9f51-42a0-9f30-9b904b83cfe1]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9, portal: 172.16.0.220,3260]
Apr 14 02:22:40 user nova-compute[71498]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9, portal: 172.16.0.220,3260] successful.
Apr 14 02:22:40 user nova-compute[71498]:  stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 -p 172.16.0.220:3260 --op delete {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24bbdf6a-5311-490b-bece-4364727d75d9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81721) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb45f9fa-0b3b-4875-8d5a-7e00800e84c6]: (4, ('', '')) {{(pid=81721) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71498) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.base [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] <== disconnect_volume: return (284ms) None {{(pid=71498) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Disconnected iSCSI Volume {{(pid=71498) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 02:22:40 user nova-compute[71498]: DEBUG nova.objects.instance [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lazy-loading 'flavor' on Instance uuid ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:22:41 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-fe8671d3-d5cd-4be7-84d5-56d683cd6209 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.637s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:22:43 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:22:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:22:43 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:22:48 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:22:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:22:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:22:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:22:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:22:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:22:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:22:53 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:22:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:22:58 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:23:02 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:23:03 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:23:03 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 02:23:03 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Rebuilding the list of instances to heal {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 02:23:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "refresh_cache-ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 02:23:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquired lock "refresh_cache-ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 02:23:03 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Forcefully refreshing network info cache for instance {{(pid=71498) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 02:23:03 user nova-compute[71498]: DEBUG nova.objects.instance [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lazy-loading 'info_cache' on Instance uuid ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:23:03 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:23:03 user nova-compute[71498]: DEBUG nova.network.neutron [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Updating instance_info_cache with network_info: [{"id": "08d38961-6fe0-4d59-b9a3-c9cd6aa4090d", "address": "fa:16:3e:a3:50:a6", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d38961-6f", "ovs_interfaceid": "08d38961-6fe0-4d59-b9a3-c9cd6aa4090d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:23:03 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Releasing lock "refresh_cache-ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" {{(pid=71498) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 02:23:04 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Updated the network info_cache for instance {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 02:23:07 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:23:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:23:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:23:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:23:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:23:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:23:08 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:23:09 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:23:09 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:23:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:23:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:23:09 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:23:09 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 02:23:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:23:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:23:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/disk --force-share --output=json {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 02:23:09 user nova-compute[71498]: DEBUG oslo_concurrency.processutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 02:23:10 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:23:10 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:23:10 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=8841MB free_disk=26.162837982177734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 02:23:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:23:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:23:10 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Instance ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71498) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 02:23:10 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 02:23:10 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 02:23:10 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Refreshing inventories for resource provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 02:23:10 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Updating ProviderTree inventory for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 02:23:10 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Updating inventory in ProviderTree for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 02:23:10 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Refreshing aggregate associations for resource provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4, aggregates: None {{(pid=71498) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 02:23:10 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Refreshing trait associations for resource provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,HW_CPU_X86_SSE2 {{(pid=71498) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 02:23:10 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:23:10 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:23:10 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 02:23:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.439s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:23:13 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:23:13 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:23:14 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:23:15 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:23:18 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:23:19 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:23:19 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:23:19 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 02:23:23 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:23:28 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:23:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f03ac132-613c-47a2-ad1f-6e1a00b60421 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:23:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f03ac132-613c-47a2-ad1f-6e1a00b60421 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:23:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f03ac132-613c-47a2-ad1f-6e1a00b60421 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:23:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f03ac132-613c-47a2-ad1f-6e1a00b60421 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:23:29 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f03ac132-613c-47a2-ad1f-6e1a00b60421 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:23:29 user nova-compute[71498]: INFO nova.compute.manager [None req-f03ac132-613c-47a2-ad1f-6e1a00b60421 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Terminating instance
Apr 14 02:23:29 user nova-compute[71498]: DEBUG nova.compute.manager [None req-f03ac132-613c-47a2-ad1f-6e1a00b60421 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Start destroying the instance on the hypervisor. {{(pid=71498) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 02:23:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:23:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:23:29 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:23:30 user nova-compute[71498]: DEBUG nova.compute.manager [req-b795d1f5-d491-4b33-8b17-186dee72346f req-e19e2db9-503b-4131-8e29-15310f7d987d service nova] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Received event network-vif-unplugged-08d38961-6fe0-4d59-b9a3-c9cd6aa4090d {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:23:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b795d1f5-d491-4b33-8b17-186dee72346f req-e19e2db9-503b-4131-8e29-15310f7d987d service nova] Acquiring lock "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:23:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b795d1f5-d491-4b33-8b17-186dee72346f req-e19e2db9-503b-4131-8e29-15310f7d987d service nova] Lock "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:23:30 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-b795d1f5-d491-4b33-8b17-186dee72346f req-e19e2db9-503b-4131-8e29-15310f7d987d service nova] Lock "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:23:30 user nova-compute[71498]: DEBUG nova.compute.manager [req-b795d1f5-d491-4b33-8b17-186dee72346f req-e19e2db9-503b-4131-8e29-15310f7d987d service nova] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] No waiting events found dispatching network-vif-unplugged-08d38961-6fe0-4d59-b9a3-c9cd6aa4090d {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:23:30 user nova-compute[71498]: DEBUG nova.compute.manager [req-b795d1f5-d491-4b33-8b17-186dee72346f req-e19e2db9-503b-4131-8e29-15310f7d987d service nova] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Received event network-vif-unplugged-08d38961-6fe0-4d59-b9a3-c9cd6aa4090d for instance with task_state deleting. {{(pid=71498) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 02:23:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:23:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:23:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:23:30 user nova-compute[71498]: INFO nova.virt.libvirt.driver [-] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Instance destroyed successfully.
Apr 14 02:23:30 user nova-compute[71498]: DEBUG nova.objects.instance [None req-f03ac132-613c-47a2-ad1f-6e1a00b60421 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lazy-loading 'resources' on Instance uuid ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f {{(pid=71498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 02:23:30 user nova-compute[71498]: DEBUG nova.virt.libvirt.vif [None req-f03ac132-613c-47a2-ad1f-6e1a00b60421 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T02:20:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-88389981',display_name='tempest-AttachVolumeNegativeTest-server-88389981',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-88389981',id=47,image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPLfE1rE74YlC3HVCnY5X9V9ZRoJtteTcjHTuXtxQMXJGMfgwDqGgobT1jivwoFE8bcp3Yn7U5hUHqV4pZkavYxjmoni61h+szpfB3XYIKH4/0TcePqZHK+VUovC8PPgA==',key_name='tempest-keypair-1626924443',keypairs=<?>,launch_index=0,launched_at=2023-04-14T02:20:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0dcde6e918d64d70b69d2d81e1bdbe79',ramdisk_id='',reservation_id='r-auh8ztvc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b1bc26f9-63fb-4bff-8f72-f1e49544441d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1854704348',owner_user_name='tempest-AttachVolumeNegativeTest-1854704348-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T02:20:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='168a0142cf984aacb1f087adcaa96468',uuid=ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08d38961-6fe0-4d59-b9a3-c9cd6aa4090d", "address": "fa:16:3e:a3:50:a6", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d38961-6f", "ovs_interfaceid": "08d38961-6fe0-4d59-b9a3-c9cd6aa4090d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 02:23:30 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-f03ac132-613c-47a2-ad1f-6e1a00b60421 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Converting VIF {"id": "08d38961-6fe0-4d59-b9a3-c9cd6aa4090d", "address": "fa:16:3e:a3:50:a6", "network": {"id": "981c880a-2147-4da6-8021-a03d0aee3f3d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1797907857-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcde6e918d64d70b69d2d81e1bdbe79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d38961-6f", "ovs_interfaceid": "08d38961-6fe0-4d59-b9a3-c9cd6aa4090d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 02:23:30 user nova-compute[71498]: DEBUG nova.network.os_vif_util [None req-f03ac132-613c-47a2-ad1f-6e1a00b60421 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:50:a6,bridge_name='br-int',has_traffic_filtering=True,id=08d38961-6fe0-4d59-b9a3-c9cd6aa4090d,network=Network(981c880a-2147-4da6-8021-a03d0aee3f3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d38961-6f') {{(pid=71498) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 02:23:30 user nova-compute[71498]: DEBUG os_vif [None req-f03ac132-613c-47a2-ad1f-6e1a00b60421 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:50:a6,bridge_name='br-int',has_traffic_filtering=True,id=08d38961-6fe0-4d59-b9a3-c9cd6aa4090d,network=Network(981c880a-2147-4da6-8021-a03d0aee3f3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d38961-6f') {{(pid=71498) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 02:23:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:23:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08d38961-6f, bridge=br-int, if_exists=True) {{(pid=71498) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 02:23:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:23:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:23:30 user nova-compute[71498]: INFO os_vif [None req-f03ac132-613c-47a2-ad1f-6e1a00b60421 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:50:a6,bridge_name='br-int',has_traffic_filtering=True,id=08d38961-6fe0-4d59-b9a3-c9cd6aa4090d,network=Network(981c880a-2147-4da6-8021-a03d0aee3f3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d38961-6f')
Apr 14 02:23:30 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-f03ac132-613c-47a2-ad1f-6e1a00b60421 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Deleting instance files /opt/stack/data/nova/instances/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f_del
Apr 14 02:23:30 user nova-compute[71498]: INFO nova.virt.libvirt.driver [None req-f03ac132-613c-47a2-ad1f-6e1a00b60421 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Deletion of /opt/stack/data/nova/instances/ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f_del complete
Apr 14 02:23:30 user nova-compute[71498]: INFO nova.compute.manager [None req-f03ac132-613c-47a2-ad1f-6e1a00b60421 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 14 02:23:30 user nova-compute[71498]: DEBUG oslo.service.loopingcall [None req-f03ac132-613c-47a2-ad1f-6e1a00b60421 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71498) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 02:23:30 user nova-compute[71498]: DEBUG nova.compute.manager [-] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Deallocating network for instance {{(pid=71498) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 02:23:30 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] deallocate_for_instance() {{(pid=71498) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 02:23:31 user nova-compute[71498]: DEBUG nova.network.neutron [-] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Updating instance_info_cache with network_info: [] {{(pid=71498) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 02:23:31 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Took 0.69 seconds to deallocate network for instance.
Apr 14 02:23:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f03ac132-613c-47a2-ad1f-6e1a00b60421 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:23:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f03ac132-613c-47a2-ad1f-6e1a00b60421 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:23:31 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-f03ac132-613c-47a2-ad1f-6e1a00b60421 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:23:31 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-f03ac132-613c-47a2-ad1f-6e1a00b60421 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:23:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f03ac132-613c-47a2-ad1f-6e1a00b60421 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.121s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:23:31 user nova-compute[71498]: INFO nova.scheduler.client.report [None req-f03ac132-613c-47a2-ad1f-6e1a00b60421 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Deleted allocations for instance ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f
Apr 14 02:23:31 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-f03ac132-613c-47a2-ad1f-6e1a00b60421 tempest-AttachVolumeNegativeTest-1854704348 tempest-AttachVolumeNegativeTest-1854704348-project-member] Lock "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.836s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:23:32 user nova-compute[71498]: DEBUG nova.compute.manager [req-7e278455-2fa6-4705-a619-0bb1a58c010c req-f376ba20-3ab7-4c34-a819-14191f5b48d4 service nova] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Received event network-vif-plugged-08d38961-6fe0-4d59-b9a3-c9cd6aa4090d {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:23:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7e278455-2fa6-4705-a619-0bb1a58c010c req-f376ba20-3ab7-4c34-a819-14191f5b48d4 service nova] Acquiring lock "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:23:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7e278455-2fa6-4705-a619-0bb1a58c010c req-f376ba20-3ab7-4c34-a819-14191f5b48d4 service nova] Lock "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:23:32 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [req-7e278455-2fa6-4705-a619-0bb1a58c010c req-f376ba20-3ab7-4c34-a819-14191f5b48d4 service nova] Lock "ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:23:32 user nova-compute[71498]: DEBUG nova.compute.manager [req-7e278455-2fa6-4705-a619-0bb1a58c010c req-f376ba20-3ab7-4c34-a819-14191f5b48d4 service nova] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] No waiting events found dispatching network-vif-plugged-08d38961-6fe0-4d59-b9a3-c9cd6aa4090d {{(pid=71498) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 02:23:32 user nova-compute[71498]: WARNING nova.compute.manager [req-7e278455-2fa6-4705-a619-0bb1a58c010c req-f376ba20-3ab7-4c34-a819-14191f5b48d4 service nova] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Received unexpected event network-vif-plugged-08d38961-6fe0-4d59-b9a3-c9cd6aa4090d for instance with vm_state deleted and task_state None.
Apr 14 02:23:32 user nova-compute[71498]: DEBUG nova.compute.manager [req-7e278455-2fa6-4705-a619-0bb1a58c010c req-f376ba20-3ab7-4c34-a819-14191f5b48d4 service nova] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Received event network-vif-deleted-08d38961-6fe0-4d59-b9a3-c9cd6aa4090d {{(pid=71498) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 02:23:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:23:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:23:45 user nova-compute[71498]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681439010.4777758, ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f => Stopped> {{(pid=71498) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 02:23:45 user nova-compute[71498]: INFO nova.compute.manager [-] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] VM Stopped (Lifecycle Event)
Apr 14 02:23:45 user nova-compute[71498]: DEBUG nova.compute.manager [None req-f794bdde-03f7-42be-aa87-8f91f9fc853b None None] [instance: ed9c7dd1-f40f-4bc2-9dda-bdb065c2572f] Checking state {{(pid=71498) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 02:23:45 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:23:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:23:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:23:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:23:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:23:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:23:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:23:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:24:00 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:24:04 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:24:04 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 02:24:04 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Rebuilding the list of instances to heal {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 02:24:04 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Didn't find any instances for network info cache update. {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 02:24:04 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:24:05 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:24:08 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:24:09 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:24:10 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:24:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:24:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:24:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:24:10 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 02:24:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:24:10 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:24:10 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:24:10 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=8963MB free_disk=26.181896209716797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 02:24:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:24:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:24:10 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 02:24:10 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 02:24:10 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:24:10 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:24:10 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 02:24:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:24:12 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:24:15 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:24:17 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:24:20 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:24:20 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:24:20 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:24:21 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:24:21 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 02:24:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:24:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:24:34 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:24:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:24:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:24:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:24:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:24:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:24:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:24:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:24:45 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:24:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:24:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:25:00 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:25:00 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:25:00 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:25:00 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:25:00 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:25:00 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:25:05 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:25:06 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:25:06 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Starting heal instance info cache {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 02:25:06 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Rebuilding the list of instances to heal {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 02:25:06 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Didn't find any instances for network info cache update. {{(pid=71498) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 02:25:06 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:25:09 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:25:10 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:25:10 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager.update_available_resource {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:25:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:25:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:25:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:25:10 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Auditing locally available compute resources for user (node: user) {{(pid=71498) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 02:25:10 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:25:10 user nova-compute[71498]: WARNING nova.virt.libvirt.driver [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 02:25:10 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Hypervisor/Node resource view: name=user free_ram=8941MB free_disk=26.171241760253906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=71498) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 02:25:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 02:25:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 02:25:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:25:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:25:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:25:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:25:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:25:10 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:25:10 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 02:25:10 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71498) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 02:25:10 user nova-compute[71498]: DEBUG nova.compute.provider_tree [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed in ProviderTree for provider: 5d1e0d73-5203-4561-b5ca-56519acd0ff4 {{(pid=71498) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 02:25:10 user nova-compute[71498]: DEBUG nova.scheduler.client.report [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Inventory has not changed for provider 5d1e0d73-5203-4561-b5ca-56519acd0ff4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71498) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 02:25:10 user nova-compute[71498]: DEBUG nova.compute.resource_tracker [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Compute_service record updated for user:user {{(pid=71498) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 02:25:10 user nova-compute[71498]: DEBUG oslo_concurrency.lockutils [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.105s {{(pid=71498) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 02:25:12 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:25:15 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:25:15 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:25:19 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:25:20 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:25:20 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:25:23 user nova-compute[71498]: DEBUG oslo_service.periodic_task [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71498) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 02:25:23 user nova-compute[71498]: DEBUG nova.compute.manager [None req-d3025482-f5cb-42b8-9004-cc023e3e7f6e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71498) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 02:25:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:25:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:25:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71498) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 02:25:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:25:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71498) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 02:25:25 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:25:30 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:25:35 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:25:40 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:25:45 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 02:25:50 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:25:55 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 02:26:00 user nova-compute[71498]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71498) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}